Running Suite: Kubernetes e2e suite =================================== Random Seed: 1629285912 - Will randomize all specs Will run 5484 specs Running in parallel across 10 nodes Aug 18 11:25:13.924: INFO: >>> kubeConfig: /root/.kube/config Aug 18 11:25:13.929: INFO: Waiting up to 30m0s for all (but 0) nodes to be schedulable Aug 18 11:25:13.957: INFO: Waiting up to 10m0s for all pods (need at least 0) in namespace 'kube-system' to be running and ready Aug 18 11:25:14.022: INFO: The status of Pod cmk-init-discover-node1-bxznx is Succeeded, skipping waiting Aug 18 11:25:14.022: INFO: The status of Pod cmk-init-discover-node2-6b2kz is Succeeded, skipping waiting Aug 18 11:25:14.022: INFO: 40 / 42 pods in namespace 'kube-system' are running and ready (0 seconds elapsed) Aug 18 11:25:14.022: INFO: expected 8 pod replicas in namespace 'kube-system', 8 are Running and Ready. Aug 18 11:25:14.022: INFO: Waiting up to 5m0s for all daemonsets in namespace 'kube-system' to start Aug 18 11:25:14.033: INFO: 2 / 2 pods ready in namespace 'kube-system' in daemonset 'cmk' (0 seconds elapsed) Aug 18 11:25:14.033: INFO: 5 / 5 pods ready in namespace 'kube-system' in daemonset 'kube-flannel' (0 seconds elapsed) Aug 18 11:25:14.033: INFO: 0 / 0 pods ready in namespace 'kube-system' in daemonset 'kube-flannel-ds-arm' (0 seconds elapsed) Aug 18 11:25:14.033: INFO: 0 / 0 pods ready in namespace 'kube-system' in daemonset 'kube-flannel-ds-arm64' (0 seconds elapsed) Aug 18 11:25:14.033: INFO: 0 / 0 pods ready in namespace 'kube-system' in daemonset 'kube-flannel-ds-ppc64le' (0 seconds elapsed) Aug 18 11:25:14.033: INFO: 0 / 0 pods ready in namespace 'kube-system' in daemonset 'kube-flannel-ds-s390x' (0 seconds elapsed) Aug 18 11:25:14.033: INFO: 5 / 5 pods ready in namespace 'kube-system' in daemonset 'kube-multus-ds-amd64' (0 seconds elapsed) Aug 18 11:25:14.033: INFO: 5 / 5 pods ready in namespace 'kube-system' in daemonset 'kube-proxy' (0 seconds elapsed) Aug 18 11:25:14.033: INFO: 2 / 2 pods ready in namespace 'kube-system' in daemonset 'node-feature-discovery-worker' (0 seconds elapsed) Aug 18 11:25:14.033: INFO: 2 / 2 pods ready in namespace 'kube-system' in daemonset 'sriov-net-dp-kube-sriov-device-plugin-amd64' (0 seconds elapsed) Aug 18 11:25:14.033: INFO: e2e test version: v1.19.12 Aug 18 11:25:14.034: INFO: kube-apiserver version: v1.19.8 Aug 18 11:25:14.034: INFO: >>> kubeConfig: /root/.kube/config Aug 18 11:25:14.038: INFO: Cluster IP family: ipv4 SSSSSS ------------------------------ Aug 18 11:25:14.036: INFO: >>> kubeConfig: /root/.kube/config Aug 18 11:25:14.055: INFO: Cluster IP family: ipv4 SSS ------------------------------ Aug 18 11:25:14.036: INFO: >>> kubeConfig: /root/.kube/config Aug 18 11:25:14.059: INFO: Cluster IP family: ipv4 SS ------------------------------ Aug 18 11:25:14.036: INFO: >>> kubeConfig: /root/.kube/config Aug 18 11:25:14.061: INFO: Cluster IP family: ipv4 Aug 18 11:25:14.040: INFO: >>> kubeConfig: /root/.kube/config Aug 18 11:25:14.062: INFO: Cluster IP family: ipv4 Aug 18 11:25:14.042: INFO: >>> kubeConfig: /root/.kube/config Aug 18 11:25:14.063: INFO: Cluster IP family: ipv4 SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ Aug 18 11:25:14.070: INFO: >>> kubeConfig: /root/.kube/config Aug 18 11:25:14.093: INFO: Cluster IP family: ipv4 SSSSSS ------------------------------ Aug 18 11:25:14.078: INFO: >>> kubeConfig: /root/.kube/config Aug 18 11:25:14.098: INFO: Cluster IP family: ipv4 SSSS ------------------------------ Aug 18 11:25:14.080: INFO: >>> kubeConfig: /root/.kube/config Aug 18 11:25:14.101: INFO: Cluster IP family: ipv4 SS ------------------------------ Aug 18 11:25:14.078: INFO: >>> kubeConfig: /root/.kube/config Aug 18 11:25:14.102: INFO: Cluster IP family: ipv4 SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [k8s.io] [sig-node] Pods Extended /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:25:14.103: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename pods Aug 18 11:25:14.130: INFO: Found PodSecurityPolicies; testing pod creation to see if PodSecurityPolicy is enabled Aug 18 11:25:14.132: INFO: Error creating dryrun pod; assuming PodSecurityPolicy is disabled: admission webhook "cmk.intel.com" does not support dry run STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [k8s.io] Pods Set QOS Class /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/pods.go:150 [It] should be set on Pods with matching resource requests and limits for memory and cpu [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: creating the pod STEP: submitting the pod to kubernetes STEP: verifying QOS class is set on the pod [AfterEach] [k8s.io] [sig-node] Pods Extended /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:25:14.151: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "pods-7441" for this suite. •SSS ------------------------------ {"msg":"PASSED [k8s.io] [sig-node] Pods Extended [k8s.io] Pods Set QOS Class should be set on Pods with matching resource requests and limits for memory and cpu [Conformance]","total":-1,"completed":1,"skipped":0,"failed":0} SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-network] Ingress API /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:25:14.075: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename ingress Aug 18 11:25:14.097: INFO: Found PodSecurityPolicies; testing pod creation to see if PodSecurityPolicy is enabled Aug 18 11:25:14.098: INFO: Error creating dryrun pod; assuming PodSecurityPolicy is disabled: admission webhook "cmk.intel.com" does not support dry run STEP: Waiting for a default service account to be provisioned in namespace [It] should support creating Ingress API operations [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: getting /apis STEP: getting /apis/networking.k8s.io STEP: getting /apis/networking.k8s.iov1 STEP: creating STEP: getting STEP: listing STEP: watching Aug 18 11:25:14.130: INFO: starting watch STEP: cluster-wide listing STEP: cluster-wide watching Aug 18 11:25:14.133: INFO: starting watch STEP: patching STEP: updating Aug 18 11:25:14.143: INFO: waiting for watch events with expected annotations Aug 18 11:25:14.143: INFO: saw patched and updated annotations STEP: patching /status STEP: updating /status STEP: get /status STEP: deleting STEP: deleting a collection [AfterEach] [sig-network] Ingress API /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:25:14.173: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "ingress-9778" for this suite. •SSSS ------------------------------ {"msg":"PASSED [sig-network] Ingress API should support creating Ingress API operations [Conformance]","total":-1,"completed":1,"skipped":5,"failed":0} SSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-api-machinery] Secrets /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:25:14.186: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename secrets STEP: Waiting for a default service account to be provisioned in namespace [It] should patch a secret [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: creating a secret STEP: listing secrets in all namespaces to ensure that there are more than zero STEP: patching the secret STEP: deleting the secret using a LabelSelector STEP: listing secrets in all namespaces, searching for label name and value in patch [AfterEach] [sig-api-machinery] Secrets /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:25:14.231: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "secrets-1305" for this suite. • ------------------------------ {"msg":"PASSED [sig-api-machinery] Secrets should patch a secret [Conformance]","total":-1,"completed":2,"skipped":13,"failed":0} S ------------------------------ [BeforeEach] [k8s.io] Lease /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:25:14.217: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename lease-test Aug 18 11:25:14.676: INFO: Found PodSecurityPolicies; testing pod creation to see if PodSecurityPolicy is enabled Aug 18 11:25:14.678: INFO: Error creating dryrun pod; assuming PodSecurityPolicy is disabled: admission webhook "cmk.intel.com" does not support dry run STEP: Waiting for a default service account to be provisioned in namespace [It] lease API should be available [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 [AfterEach] [k8s.io] Lease /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:25:14.721: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "lease-test-2907" for this suite. • ------------------------------ {"msg":"PASSED [k8s.io] Lease lease API should be available [Conformance]","total":-1,"completed":1,"skipped":61,"failed":0} SSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-api-machinery] Watchers /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:25:14.769: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename watch STEP: Waiting for a default service account to be provisioned in namespace [It] should be able to start watching from a specific resource version [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: creating a new configmap STEP: modifying the configmap once STEP: modifying the configmap a second time STEP: deleting the configmap STEP: creating a watch on configmaps from the resource version returned by the first update STEP: Expecting to observe notifications for all changes to the configmap after the first update Aug 18 11:25:14.995: INFO: Got : MODIFIED &ConfigMap{ObjectMeta:{e2e-watch-test-resource-version watch-9139 /api/v1/namespaces/watch-9139/configmaps/e2e-watch-test-resource-version faa082e4-3c50-44ce-8a9a-9ebdbc8d106c 53543 0 2021-08-18 11:25:14 +0000 UTC map[watch-this-configmap:from-resource-version] map[] [] [] [{e2e.test Update v1 2021-08-18 11:25:14 +0000 UTC FieldsV1 {"f:data":{".":{},"f:mutation":{}},"f:metadata":{"f:labels":{".":{},"f:watch-this-configmap":{}}}}}]},Data:map[string]string{mutation: 2,},BinaryData:map[string][]byte{},Immutable:nil,} Aug 18 11:25:14.996: INFO: Got : DELETED &ConfigMap{ObjectMeta:{e2e-watch-test-resource-version watch-9139 /api/v1/namespaces/watch-9139/configmaps/e2e-watch-test-resource-version faa082e4-3c50-44ce-8a9a-9ebdbc8d106c 53544 0 2021-08-18 11:25:14 +0000 UTC map[watch-this-configmap:from-resource-version] map[] [] [] [{e2e.test Update v1 2021-08-18 11:25:14 +0000 UTC FieldsV1 {"f:data":{".":{},"f:mutation":{}},"f:metadata":{"f:labels":{".":{},"f:watch-this-configmap":{}}}}}]},Data:map[string]string{mutation: 2,},BinaryData:map[string][]byte{},Immutable:nil,} [AfterEach] [sig-api-machinery] Watchers /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:25:14.996: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "watch-9139" for this suite. • ------------------------------ {"msg":"PASSED [sig-api-machinery] Watchers should be able to start watching from a specific resource version [Conformance]","total":-1,"completed":2,"skipped":80,"failed":0} SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-api-machinery] Garbage collector /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:25:14.130: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename gc Aug 18 11:25:14.149: INFO: Found PodSecurityPolicies; testing pod creation to see if PodSecurityPolicy is enabled Aug 18 11:25:14.151: INFO: Error creating dryrun pod; assuming PodSecurityPolicy is disabled: admission webhook "cmk.intel.com" does not support dry run STEP: Waiting for a default service account to be provisioned in namespace [It] should not be blocked by dependency circle [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:25:14.189: INFO: pod1.ObjectMeta.OwnerReferences=[]v1.OwnerReference{v1.OwnerReference{APIVersion:"v1", Kind:"Pod", Name:"pod3", UID:"66b6edbc-9304-407c-b1c6-1431608b93e4", Controller:(*bool)(0xc00436c0a2), BlockOwnerDeletion:(*bool)(0xc00436c0a3)}} Aug 18 11:25:14.193: INFO: pod2.ObjectMeta.OwnerReferences=[]v1.OwnerReference{v1.OwnerReference{APIVersion:"v1", Kind:"Pod", Name:"pod1", UID:"0b41b381-7bf4-49a0-9173-1aa6302abfa9", Controller:(*bool)(0xc003f7bcb2), BlockOwnerDeletion:(*bool)(0xc003f7bcb3)}} Aug 18 11:25:14.196: INFO: pod3.ObjectMeta.OwnerReferences=[]v1.OwnerReference{v1.OwnerReference{APIVersion:"v1", Kind:"Pod", Name:"pod2", UID:"81706f5d-9d99-4f6e-8594-ceeac15cf09c", Controller:(*bool)(0xc0038667fa), BlockOwnerDeletion:(*bool)(0xc0038667fb)}} [AfterEach] [sig-api-machinery] Garbage collector /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:25:19.202: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "gc-3181" for this suite. • [SLOW TEST:5.084 seconds] [sig-api-machinery] Garbage collector /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23 should not be blocked by dependency circle [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-api-machinery] Garbage collector should not be blocked by dependency circle [Conformance]","total":-1,"completed":1,"skipped":14,"failed":0} SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:25:14.060: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename webhook Aug 18 11:25:14.081: INFO: Found PodSecurityPolicies; testing pod creation to see if PodSecurityPolicy is enabled Aug 18 11:25:14.084: INFO: Error creating dryrun pod; assuming PodSecurityPolicy is disabled: admission webhook "cmk.intel.com" does not support dry run STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:87 STEP: Setting up server cert STEP: Create role binding to let webhook read extension-apiserver-authentication STEP: Deploying the webhook pod STEP: Wait for the deployment to be ready Aug 18 11:25:14.456: INFO: deployment "sample-webhook-deployment" doesn't have the required revision set Aug 18 11:25:16.464: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882714, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882714, loc:(*time.Location)(0x77169a0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882714, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882714, loc:(*time.Location)(0x77169a0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-cbccbf6bb\" is progressing."}}, CollisionCount:(*int32)(nil)} Aug 18 11:25:18.467: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882714, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882714, loc:(*time.Location)(0x77169a0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882714, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882714, loc:(*time.Location)(0x77169a0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-cbccbf6bb\" is progressing."}}, CollisionCount:(*int32)(nil)} Aug 18 11:25:20.467: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882714, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882714, loc:(*time.Location)(0x77169a0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882714, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882714, loc:(*time.Location)(0x77169a0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-cbccbf6bb\" is progressing."}}, CollisionCount:(*int32)(nil)} Aug 18 11:25:22.467: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882714, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882714, loc:(*time.Location)(0x77169a0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882714, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882714, loc:(*time.Location)(0x77169a0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-cbccbf6bb\" is progressing."}}, CollisionCount:(*int32)(nil)} Aug 18 11:25:24.467: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882714, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882714, loc:(*time.Location)(0x77169a0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882714, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882714, loc:(*time.Location)(0x77169a0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-cbccbf6bb\" is progressing."}}, CollisionCount:(*int32)(nil)} STEP: Deploying the webhook service STEP: Verifying the service has paired with the endpoint Aug 18 11:25:27.473: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1 [It] patching/updating a validating webhook should work [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating a validating webhook configuration STEP: Creating a configMap that does not comply to the validation webhook rules STEP: Updating a validating webhook configuration's rules to not include the create operation STEP: Creating a configMap that does not comply to the validation webhook rules STEP: Patching a validating webhook configuration's rules to include the create operation STEP: Creating a configMap that does not comply to the validation webhook rules [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:25:27.520: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "webhook-9053" for this suite. STEP: Destroying namespace "webhook-9053-markers" for this suite. [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:102 • [SLOW TEST:13.495 seconds] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23 patching/updating a validating webhook should work [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] patching/updating a validating webhook should work [Conformance]","total":-1,"completed":1,"skipped":1,"failed":0} SS ------------------------------ [BeforeEach] [k8s.io] Variable Expansion /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:25:14.116: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename var-expansion Aug 18 11:25:14.137: INFO: Found PodSecurityPolicies; testing pod creation to see if PodSecurityPolicy is enabled Aug 18 11:25:14.139: INFO: Error creating dryrun pod; assuming PodSecurityPolicy is disabled: admission webhook "cmk.intel.com" does not support dry run STEP: Waiting for a default service account to be provisioned in namespace [It] should allow composing env vars into new env vars [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating a pod to test env composition Aug 18 11:25:14.154: INFO: Waiting up to 5m0s for pod "var-expansion-6c703c35-060d-4142-802f-9624e18c3269" in namespace "var-expansion-5109" to be "Succeeded or Failed" Aug 18 11:25:14.155: INFO: Pod "var-expansion-6c703c35-060d-4142-802f-9624e18c3269": Phase="Pending", Reason="", readiness=false. Elapsed: 1.639586ms Aug 18 11:25:16.159: INFO: Pod "var-expansion-6c703c35-060d-4142-802f-9624e18c3269": Phase="Pending", Reason="", readiness=false. Elapsed: 2.005502506s Aug 18 11:25:18.163: INFO: Pod "var-expansion-6c703c35-060d-4142-802f-9624e18c3269": Phase="Pending", Reason="", readiness=false. Elapsed: 4.009352171s Aug 18 11:25:20.166: INFO: Pod "var-expansion-6c703c35-060d-4142-802f-9624e18c3269": Phase="Pending", Reason="", readiness=false. Elapsed: 6.011808826s Aug 18 11:25:22.169: INFO: Pod "var-expansion-6c703c35-060d-4142-802f-9624e18c3269": Phase="Pending", Reason="", readiness=false. Elapsed: 8.014973306s Aug 18 11:25:24.171: INFO: Pod "var-expansion-6c703c35-060d-4142-802f-9624e18c3269": Phase="Pending", Reason="", readiness=false. Elapsed: 10.017152905s Aug 18 11:25:26.175: INFO: Pod "var-expansion-6c703c35-060d-4142-802f-9624e18c3269": Phase="Pending", Reason="", readiness=false. Elapsed: 12.020819475s Aug 18 11:25:28.177: INFO: Pod "var-expansion-6c703c35-060d-4142-802f-9624e18c3269": Phase="Succeeded", Reason="", readiness=false. Elapsed: 14.022949914s STEP: Saw pod success Aug 18 11:25:28.177: INFO: Pod "var-expansion-6c703c35-060d-4142-802f-9624e18c3269" satisfied condition "Succeeded or Failed" Aug 18 11:25:28.178: INFO: Trying to get logs from node node1 pod var-expansion-6c703c35-060d-4142-802f-9624e18c3269 container dapi-container: STEP: delete the pod Aug 18 11:25:28.197: INFO: Waiting for pod var-expansion-6c703c35-060d-4142-802f-9624e18c3269 to disappear Aug 18 11:25:28.198: INFO: Pod var-expansion-6c703c35-060d-4142-802f-9624e18c3269 no longer exists [AfterEach] [k8s.io] Variable Expansion /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:25:28.198: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "var-expansion-5109" for this suite. • [SLOW TEST:14.090 seconds] [k8s.io] Variable Expansion /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 should allow composing env vars into new env vars [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [k8s.io] Variable Expansion should allow composing env vars into new env vars [NodeConformance] [Conformance]","total":-1,"completed":1,"skipped":21,"failed":0} SSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:25:19.339: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename crd-publish-openapi STEP: Waiting for a default service account to be provisioned in namespace [It] works for CRD without validation schema [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:25:19.358: INFO: >>> kubeConfig: /root/.kube/config STEP: client-side validation (kubectl create and apply) allows request with any unknown properties Aug 18 11:25:27.293: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=crd-publish-openapi-226 --namespace=crd-publish-openapi-226 create -f -' Aug 18 11:25:27.728: INFO: stderr: "" Aug 18 11:25:27.728: INFO: stdout: "e2e-test-crd-publish-openapi-7588-crd.crd-publish-openapi-test-empty.example.com/test-cr created\n" Aug 18 11:25:27.729: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=crd-publish-openapi-226 --namespace=crd-publish-openapi-226 delete e2e-test-crd-publish-openapi-7588-crds test-cr' Aug 18 11:25:27.889: INFO: stderr: "" Aug 18 11:25:27.889: INFO: stdout: "e2e-test-crd-publish-openapi-7588-crd.crd-publish-openapi-test-empty.example.com \"test-cr\" deleted\n" Aug 18 11:25:27.889: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=crd-publish-openapi-226 --namespace=crd-publish-openapi-226 apply -f -' Aug 18 11:25:28.147: INFO: stderr: "" Aug 18 11:25:28.147: INFO: stdout: "e2e-test-crd-publish-openapi-7588-crd.crd-publish-openapi-test-empty.example.com/test-cr created\n" Aug 18 11:25:28.147: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=crd-publish-openapi-226 --namespace=crd-publish-openapi-226 delete e2e-test-crd-publish-openapi-7588-crds test-cr' Aug 18 11:25:28.294: INFO: stderr: "" Aug 18 11:25:28.294: INFO: stdout: "e2e-test-crd-publish-openapi-7588-crd.crd-publish-openapi-test-empty.example.com \"test-cr\" deleted\n" STEP: kubectl explain works to explain CR without validation schema Aug 18 11:25:28.294: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=crd-publish-openapi-226 explain e2e-test-crd-publish-openapi-7588-crds' Aug 18 11:25:28.579: INFO: stderr: "" Aug 18 11:25:28.579: INFO: stdout: "KIND: E2e-test-crd-publish-openapi-7588-crd\nVERSION: crd-publish-openapi-test-empty.example.com/v1\n\nDESCRIPTION:\n \n" [AfterEach] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:25:31.477: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "crd-publish-openapi-226" for this suite. • [SLOW TEST:12.146 seconds] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23 works for CRD without validation schema [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] works for CRD without validation schema [Conformance]","total":-1,"completed":2,"skipped":70,"failed":0} SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-storage] Projected downwardAPI /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:25:15.113: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename projected STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-storage] Projected downwardAPI /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/projected_downwardapi.go:42 [It] should update annotations on modification [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating the pod Aug 18 11:25:31.670: INFO: Successfully updated pod "annotationupdate82644dc6-3cfd-4661-bded-195aec7821ac" [AfterEach] [sig-storage] Projected downwardAPI /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:25:33.682: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "projected-7958" for this suite. • [SLOW TEST:18.577 seconds] [sig-storage] Projected downwardAPI /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/projected_downwardapi.go:36 should update annotations on modification [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-storage] Projected downwardAPI should update annotations on modification [NodeConformance] [Conformance]","total":-1,"completed":3,"skipped":131,"failed":0} SSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-auth] ServiceAccounts /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:25:14.197: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename svcaccounts Aug 18 11:25:14.479: INFO: Found PodSecurityPolicies; testing pod creation to see if PodSecurityPolicy is enabled Aug 18 11:25:14.480: INFO: Error creating dryrun pod; assuming PodSecurityPolicy is disabled: admission webhook "cmk.intel.com" does not support dry run STEP: Waiting for a default service account to be provisioned in namespace [It] should mount an API token into pods [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: getting the auto-created API token STEP: reading a file in the container Aug 18 11:25:33.014: INFO: Running '/usr/local/bin/kubectl exec --namespace=svcaccounts-4859 pod-service-account-ae3911f3-ebbf-4d21-9026-956a8890dcab -c=test -- cat /var/run/secrets/kubernetes.io/serviceaccount/token' STEP: reading a file in the container Aug 18 11:25:33.618: INFO: Running '/usr/local/bin/kubectl exec --namespace=svcaccounts-4859 pod-service-account-ae3911f3-ebbf-4d21-9026-956a8890dcab -c=test -- cat /var/run/secrets/kubernetes.io/serviceaccount/ca.crt' STEP: reading a file in the container Aug 18 11:25:34.209: INFO: Running '/usr/local/bin/kubectl exec --namespace=svcaccounts-4859 pod-service-account-ae3911f3-ebbf-4d21-9026-956a8890dcab -c=test -- cat /var/run/secrets/kubernetes.io/serviceaccount/namespace' [AfterEach] [sig-auth] ServiceAccounts /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:25:34.688: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "svcaccounts-4859" for this suite. • [SLOW TEST:20.500 seconds] [sig-auth] ServiceAccounts /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/auth/framework.go:23 should mount an API token into pods [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-auth] ServiceAccounts should mount an API token into pods [Conformance]","total":-1,"completed":1,"skipped":65,"failed":0} SSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:25:14.192: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename crd-publish-openapi STEP: Waiting for a default service account to be provisioned in namespace [It] updates the published spec when one version gets renamed [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: set up a multi version CRD Aug 18 11:25:14.277: INFO: >>> kubeConfig: /root/.kube/config STEP: rename a version STEP: check the new version name is served STEP: check the old version name is removed STEP: check the other version is not changed [AfterEach] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:25:37.150: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "crd-publish-openapi-8378" for this suite. • [SLOW TEST:22.966 seconds] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23 updates the published spec when one version gets renamed [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] updates the published spec when one version gets renamed [Conformance]","total":-1,"completed":2,"skipped":9,"failed":0} SSS ------------------------------ [BeforeEach] [sig-api-machinery] CustomResourceDefinition resources [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:25:37.170: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename custom-resource-definition STEP: Waiting for a default service account to be provisioned in namespace [It] should include custom resource definition resources in discovery documents [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: fetching the /apis discovery document STEP: finding the apiextensions.k8s.io API group in the /apis discovery document STEP: finding the apiextensions.k8s.io/v1 API group/version in the /apis discovery document STEP: fetching the /apis/apiextensions.k8s.io discovery document STEP: finding the apiextensions.k8s.io/v1 API group/version in the /apis/apiextensions.k8s.io discovery document STEP: fetching the /apis/apiextensions.k8s.io/v1 discovery document STEP: finding customresourcedefinitions resources in the /apis/apiextensions.k8s.io/v1 discovery document [AfterEach] [sig-api-machinery] CustomResourceDefinition resources [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:25:37.193: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "custom-resource-definition-4002" for this suite. • ------------------------------ {"msg":"PASSED [sig-api-machinery] CustomResourceDefinition resources [Privileged:ClusterAdmin] should include custom resource definition resources in discovery documents [Conformance]","total":-1,"completed":3,"skipped":12,"failed":0} SSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [k8s.io] InitContainer [NodeConformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:25:14.086: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename init-container Aug 18 11:25:14.107: INFO: Found PodSecurityPolicies; testing pod creation to see if PodSecurityPolicy is enabled Aug 18 11:25:14.109: INFO: Error creating dryrun pod; assuming PodSecurityPolicy is disabled: admission webhook "cmk.intel.com" does not support dry run STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [k8s.io] InitContainer [NodeConformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/init_container.go:162 [It] should invoke init containers on a RestartNever pod [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: creating the pod Aug 18 11:25:14.112: INFO: PodSpec: initContainers in spec.initContainers [AfterEach] [k8s.io] InitContainer [NodeConformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:25:37.880: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "init-container-1169" for this suite. • [SLOW TEST:23.803 seconds] [k8s.io] InitContainer [NodeConformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 should invoke init containers on a RestartNever pod [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [k8s.io] InitContainer [NodeConformance] should invoke init containers on a RestartNever pod [Conformance]","total":-1,"completed":1,"skipped":7,"failed":0} SSS ------------------------------ [BeforeEach] [sig-storage] Projected downwardAPI /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:25:37.253: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename projected STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-storage] Projected downwardAPI /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/projected_downwardapi.go:42 [It] should provide container's cpu request [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating a pod to test downward API volume plugin Aug 18 11:25:37.285: INFO: Waiting up to 5m0s for pod "downwardapi-volume-ca62c7f2-da30-4fbf-a588-97bb5f7cfd67" in namespace "projected-6131" to be "Succeeded or Failed" Aug 18 11:25:37.287: INFO: Pod "downwardapi-volume-ca62c7f2-da30-4fbf-a588-97bb5f7cfd67": Phase="Pending", Reason="", readiness=false. Elapsed: 1.716937ms Aug 18 11:25:39.289: INFO: Pod "downwardapi-volume-ca62c7f2-da30-4fbf-a588-97bb5f7cfd67": Phase="Pending", Reason="", readiness=false. Elapsed: 2.004254747s Aug 18 11:25:41.292: INFO: Pod "downwardapi-volume-ca62c7f2-da30-4fbf-a588-97bb5f7cfd67": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.007080122s STEP: Saw pod success Aug 18 11:25:41.292: INFO: Pod "downwardapi-volume-ca62c7f2-da30-4fbf-a588-97bb5f7cfd67" satisfied condition "Succeeded or Failed" Aug 18 11:25:41.294: INFO: Trying to get logs from node node2 pod downwardapi-volume-ca62c7f2-da30-4fbf-a588-97bb5f7cfd67 container client-container: STEP: delete the pod Aug 18 11:25:41.313: INFO: Waiting for pod downwardapi-volume-ca62c7f2-da30-4fbf-a588-97bb5f7cfd67 to disappear Aug 18 11:25:41.315: INFO: Pod downwardapi-volume-ca62c7f2-da30-4fbf-a588-97bb5f7cfd67 no longer exists [AfterEach] [sig-storage] Projected downwardAPI /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:25:41.315: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "projected-6131" for this suite. • ------------------------------ {"msg":"PASSED [sig-storage] Projected downwardAPI should provide container's cpu request [NodeConformance] [Conformance]","total":-1,"completed":4,"skipped":32,"failed":0} SSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:25:27.562: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename webhook STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:87 STEP: Setting up server cert STEP: Create role binding to let webhook read extension-apiserver-authentication STEP: Deploying the webhook pod STEP: Wait for the deployment to be ready Aug 18 11:25:28.061: INFO: deployment "sample-webhook-deployment" doesn't have the required revision set Aug 18 11:25:30.068: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882728, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882728, loc:(*time.Location)(0x77169a0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882728, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882728, loc:(*time.Location)(0x77169a0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-cbccbf6bb\" is progressing."}}, CollisionCount:(*int32)(nil)} Aug 18 11:25:32.072: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882728, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882728, loc:(*time.Location)(0x77169a0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882728, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882728, loc:(*time.Location)(0x77169a0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-cbccbf6bb\" is progressing."}}, CollisionCount:(*int32)(nil)} Aug 18 11:25:34.071: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882728, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882728, loc:(*time.Location)(0x77169a0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882728, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882728, loc:(*time.Location)(0x77169a0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-cbccbf6bb\" is progressing."}}, CollisionCount:(*int32)(nil)} STEP: Deploying the webhook service STEP: Verifying the service has paired with the endpoint Aug 18 11:25:37.079: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1 [It] should mutate custom resource with different stored version [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:25:37.082: INFO: >>> kubeConfig: /root/.kube/config STEP: Registering the mutating webhook for custom resource e2e-test-webhook-9462-crds.webhook.example.com via the AdmissionRegistration API STEP: Creating a custom resource while v1 is storage version STEP: Patching Custom Resource Definition to set v2 as storage STEP: Patching the custom resource while v2 is storage version [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:25:43.208: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "webhook-9898" for this suite. STEP: Destroying namespace "webhook-9898-markers" for this suite. [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:102 • [SLOW TEST:15.680 seconds] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23 should mutate custom resource with different stored version [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should mutate custom resource with different stored version [Conformance]","total":-1,"completed":2,"skipped":3,"failed":0} SSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-storage] EmptyDir volumes /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:25:33.741: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename emptydir STEP: Waiting for a default service account to be provisioned in namespace [It] pod should support shared volumes between containers [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating Pod STEP: Waiting for the pod running STEP: Geting the pod STEP: Reading file content from the nginx-container Aug 18 11:25:43.794: INFO: ExecWithOptions {Command:[/bin/sh -c cat /usr/share/volumeshare/shareddata.txt] Namespace:emptydir-4215 PodName:pod-sharedvolume-52a700cb-f297-4eac-b8dc-e923c789293d ContainerName:busybox-main-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:false} Aug 18 11:25:43.794: INFO: >>> kubeConfig: /root/.kube/config Aug 18 11:25:44.083: INFO: Exec stderr: "" [AfterEach] [sig-storage] EmptyDir volumes /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:25:44.083: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "emptydir-4215" for this suite. • [SLOW TEST:10.350 seconds] [sig-storage] EmptyDir volumes /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/empty_dir.go:42 pod should support shared volumes between containers [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-storage] EmptyDir volumes pod should support shared volumes between containers [Conformance]","total":-1,"completed":4,"skipped":151,"failed":0} SSSSSS ------------------------------ [BeforeEach] [sig-cli] Kubectl client /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:25:44.107: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename kubectl STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-cli] Kubectl client /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/kubectl.go:247 [It] should check if Kubernetes master services is included in cluster-info [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: validating cluster-info Aug 18 11:25:44.127: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-1269 cluster-info' Aug 18 11:25:44.295: INFO: stderr: "" Aug 18 11:25:44.295: INFO: stdout: "\x1b[0;32mKubernetes master\x1b[0m is running at \x1b[0;33mhttps://10.10.190.202:6443\x1b[0m\n\nTo further debug and diagnose cluster problems, use 'kubectl cluster-info dump'.\n" [AfterEach] [sig-cli] Kubectl client /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:25:44.295: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "kubectl-1269" for this suite. • ------------------------------ {"msg":"PASSED [sig-cli] Kubectl client Kubectl cluster-info should check if Kubernetes master services is included in cluster-info [Conformance]","total":-1,"completed":5,"skipped":157,"failed":0} SSSSSSSSSS ------------------------------ [BeforeEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:25:14.242: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename services STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:782 [It] should have session affinity work for service with type clusterIP [LinuxOnly] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: creating service in namespace services-3074 STEP: creating service affinity-clusterip in namespace services-3074 STEP: creating replication controller affinity-clusterip in namespace services-3074 I0818 11:25:14.736383 27 runners.go:190] Created replication controller with name: affinity-clusterip, namespace: services-3074, replica count: 3 I0818 11:25:17.787377 27 runners.go:190] affinity-clusterip Pods: 3 out of 3 created, 0 running, 3 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0818 11:25:20.787717 27 runners.go:190] affinity-clusterip Pods: 3 out of 3 created, 0 running, 3 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0818 11:25:23.788010 27 runners.go:190] affinity-clusterip Pods: 3 out of 3 created, 0 running, 3 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0818 11:25:26.788592 27 runners.go:190] affinity-clusterip Pods: 3 out of 3 created, 0 running, 3 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0818 11:25:29.788837 27 runners.go:190] affinity-clusterip Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0818 11:25:32.789606 27 runners.go:190] affinity-clusterip Pods: 3 out of 3 created, 3 running, 0 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady Aug 18 11:25:32.794: INFO: Creating new exec pod Aug 18 11:25:39.812: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-3074 exec execpod-affinity56rj5 -- /bin/sh -x -c nc -zv -t -w 2 affinity-clusterip 80' Aug 18 11:25:40.069: INFO: stderr: "+ nc -zv -t -w 2 affinity-clusterip 80\nConnection to affinity-clusterip 80 port [tcp/http] succeeded!\n" Aug 18 11:25:40.069: INFO: stdout: "" Aug 18 11:25:40.071: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-3074 exec execpod-affinity56rj5 -- /bin/sh -x -c nc -zv -t -w 2 10.233.16.57 80' Aug 18 11:25:40.325: INFO: stderr: "+ nc -zv -t -w 2 10.233.16.57 80\nConnection to 10.233.16.57 80 port [tcp/http] succeeded!\n" Aug 18 11:25:40.325: INFO: stdout: "" Aug 18 11:25:40.325: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-3074 exec execpod-affinity56rj5 -- /bin/sh -x -c for i in $(seq 0 15); do echo; curl -q -s --connect-timeout 2 http://10.233.16.57:80/ ; done' Aug 18 11:25:40.635: INFO: stderr: "+ seq 0 15\n+ echo\n+ curl -q -s --connect-timeout 2 http://10.233.16.57:80/\n+ echo\n+ curl -q -s --connect-timeout 2 http://10.233.16.57:80/\n+ echo\n+ curl -q -s --connect-timeout 2 http://10.233.16.57:80/\n+ echo\n+ curl -q -s --connect-timeout 2 http://10.233.16.57:80/\n+ echo\n+ curl -q -s --connect-timeout 2 http://10.233.16.57:80/\n+ echo\n+ curl -q -s --connect-timeout 2 http://10.233.16.57:80/\n+ echo\n+ curl -q -s --connect-timeout 2 http://10.233.16.57:80/\n+ echo\n+ curl -q -s --connect-timeout 2 http://10.233.16.57:80/\n+ echo\n+ curl -q -s --connect-timeout 2 http://10.233.16.57:80/\n+ echo\n+ curl -q -s --connect-timeout 2 http://10.233.16.57:80/\n+ echo\n+ curl -q -s --connect-timeout 2 http://10.233.16.57:80/\n+ echo\n+ curl -q -s --connect-timeout 2 http://10.233.16.57:80/\n+ echo\n+ curl -q -s --connect-timeout 2 http://10.233.16.57:80/\n+ echo\n+ curl -q -s --connect-timeout 2 http://10.233.16.57:80/\n+ echo\n+ curl -q -s --connect-timeout 2 http://10.233.16.57:80/\n+ echo\n+ curl -q -s --connect-timeout 2 http://10.233.16.57:80/\n" Aug 18 11:25:40.635: INFO: stdout: "\naffinity-clusterip-9mkfl\naffinity-clusterip-9mkfl\naffinity-clusterip-9mkfl\naffinity-clusterip-9mkfl\naffinity-clusterip-9mkfl\naffinity-clusterip-9mkfl\naffinity-clusterip-9mkfl\naffinity-clusterip-9mkfl\naffinity-clusterip-9mkfl\naffinity-clusterip-9mkfl\naffinity-clusterip-9mkfl\naffinity-clusterip-9mkfl\naffinity-clusterip-9mkfl\naffinity-clusterip-9mkfl\naffinity-clusterip-9mkfl\naffinity-clusterip-9mkfl" Aug 18 11:25:40.635: INFO: Received response from host: affinity-clusterip-9mkfl Aug 18 11:25:40.635: INFO: Received response from host: affinity-clusterip-9mkfl Aug 18 11:25:40.635: INFO: Received response from host: affinity-clusterip-9mkfl Aug 18 11:25:40.635: INFO: Received response from host: affinity-clusterip-9mkfl Aug 18 11:25:40.635: INFO: Received response from host: affinity-clusterip-9mkfl Aug 18 11:25:40.635: INFO: Received response from host: affinity-clusterip-9mkfl Aug 18 11:25:40.635: INFO: Received response from host: affinity-clusterip-9mkfl Aug 18 11:25:40.635: INFO: Received response from host: affinity-clusterip-9mkfl Aug 18 11:25:40.635: INFO: Received response from host: affinity-clusterip-9mkfl Aug 18 11:25:40.635: INFO: Received response from host: affinity-clusterip-9mkfl Aug 18 11:25:40.635: INFO: Received response from host: affinity-clusterip-9mkfl Aug 18 11:25:40.635: INFO: Received response from host: affinity-clusterip-9mkfl Aug 18 11:25:40.635: INFO: Received response from host: affinity-clusterip-9mkfl Aug 18 11:25:40.635: INFO: Received response from host: affinity-clusterip-9mkfl Aug 18 11:25:40.635: INFO: Received response from host: affinity-clusterip-9mkfl Aug 18 11:25:40.635: INFO: Received response from host: affinity-clusterip-9mkfl Aug 18 11:25:40.635: INFO: Cleaning up the exec pod STEP: deleting ReplicationController affinity-clusterip in namespace services-3074, will wait for the garbage collector to delete the pods Aug 18 11:25:40.699: INFO: Deleting ReplicationController affinity-clusterip took: 4.98482ms Aug 18 11:25:40.800: INFO: Terminating ReplicationController affinity-clusterip pods took: 100.272922ms [AfterEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:25:47.912: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "services-3074" for this suite. [AfterEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:786 • [SLOW TEST:33.677 seconds] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/framework.go:23 should have session affinity work for service with type clusterIP [LinuxOnly] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-network] Services should have session affinity work for service with type clusterIP [LinuxOnly] [Conformance]","total":-1,"completed":3,"skipped":14,"failed":0} SSSSSSS ------------------------------ [BeforeEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:25:37.898: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename services STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:782 [It] should serve multiport endpoints from pods [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: creating service multi-endpoint-test in namespace services-32 STEP: waiting up to 3m0s for service multi-endpoint-test in namespace services-32 to expose endpoints map[] Aug 18 11:25:37.925: INFO: Failed go get Endpoints object: endpoints "multi-endpoint-test" not found Aug 18 11:25:38.930: INFO: successfully validated that service multi-endpoint-test in namespace services-32 exposes endpoints map[] STEP: Creating pod pod1 in namespace services-32 STEP: waiting up to 3m0s for service multi-endpoint-test in namespace services-32 to expose endpoints map[pod1:[100]] Aug 18 11:25:41.951: INFO: successfully validated that service multi-endpoint-test in namespace services-32 exposes endpoints map[pod1:[100]] STEP: Creating pod pod2 in namespace services-32 STEP: waiting up to 3m0s for service multi-endpoint-test in namespace services-32 to expose endpoints map[pod1:[100] pod2:[101]] Aug 18 11:25:45.971: INFO: Unexpected endpoints: found map[4461ca03-d863-49ed-8bfe-5131bb336903:[100]], expected map[pod1:[100] pod2:[101]], will retry Aug 18 11:25:47.978: INFO: successfully validated that service multi-endpoint-test in namespace services-32 exposes endpoints map[pod1:[100] pod2:[101]] STEP: Deleting pod pod1 in namespace services-32 STEP: waiting up to 3m0s for service multi-endpoint-test in namespace services-32 to expose endpoints map[pod2:[101]] Aug 18 11:25:48.002: INFO: successfully validated that service multi-endpoint-test in namespace services-32 exposes endpoints map[pod2:[101]] STEP: Deleting pod pod2 in namespace services-32 STEP: waiting up to 3m0s for service multi-endpoint-test in namespace services-32 to expose endpoints map[] Aug 18 11:25:48.013: INFO: successfully validated that service multi-endpoint-test in namespace services-32 exposes endpoints map[] [AfterEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:25:48.023: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "services-32" for this suite. [AfterEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:786 • [SLOW TEST:10.133 seconds] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/framework.go:23 should serve multiport endpoints from pods [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-network] Services should serve multiport endpoints from pods [Conformance]","total":-1,"completed":2,"skipped":10,"failed":0} S ------------------------------ [BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:25:43.298: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename webhook STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:87 STEP: Setting up server cert STEP: Create role binding to let webhook read extension-apiserver-authentication STEP: Deploying the webhook pod STEP: Wait for the deployment to be ready Aug 18 11:25:43.583: INFO: deployment "sample-webhook-deployment" doesn't have the required revision set Aug 18 11:25:45.593: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882743, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882743, loc:(*time.Location)(0x77169a0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882743, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882743, loc:(*time.Location)(0x77169a0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-cbccbf6bb\" is progressing."}}, CollisionCount:(*int32)(nil)} Aug 18 11:25:47.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882743, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882743, loc:(*time.Location)(0x77169a0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882743, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882743, loc:(*time.Location)(0x77169a0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-cbccbf6bb\" is progressing."}}, CollisionCount:(*int32)(nil)} STEP: Deploying the webhook service STEP: Verifying the service has paired with the endpoint Aug 18 11:25:50.601: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1 [It] should include webhook resources in discovery documents [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: fetching the /apis discovery document STEP: finding the admissionregistration.k8s.io API group in the /apis discovery document STEP: finding the admissionregistration.k8s.io/v1 API group/version in the /apis discovery document STEP: fetching the /apis/admissionregistration.k8s.io discovery document STEP: finding the admissionregistration.k8s.io/v1 API group/version in the /apis/admissionregistration.k8s.io discovery document STEP: fetching the /apis/admissionregistration.k8s.io/v1 discovery document STEP: finding mutatingwebhookconfigurations and validatingwebhookconfigurations resources in the /apis/admissionregistration.k8s.io/v1 discovery document [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:25:50.608: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "webhook-4170" for this suite. STEP: Destroying namespace "webhook-4170-markers" for this suite. [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:102 • [SLOW TEST:7.345 seconds] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23 should include webhook resources in discovery documents [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should include webhook resources in discovery documents [Conformance]","total":-1,"completed":3,"skipped":28,"failed":0} SSSS ------------------------------ [BeforeEach] [k8s.io] [sig-node] Events /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:25:41.373: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename events STEP: Waiting for a default service account to be provisioned in namespace [It] should be sent by kubelets and the scheduler about pods scheduling and running [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: creating the pod STEP: submitting the pod to kubernetes STEP: verifying the pod is in kubernetes STEP: retrieving the pod Aug 18 11:25:49.412: INFO: &Pod{ObjectMeta:{send-events-3631e1bd-25f0-429b-965f-fa6f9edce626 events-5166 /api/v1/namespaces/events-5166/pods/send-events-3631e1bd-25f0-429b-965f-fa6f9edce626 86f94c40-1026-4b56-a7f9-042512a0a63b 54369 0 2021-08-18 11:25:41 +0000 UTC map[name:foo time:390993417] map[k8s.v1.cni.cncf.io/network-status:[{ "name": "default-cni-network", "interface": "eth0", "ips": [ "10.244.4.205" ], "mac": "ce:bf:71:36:08:9c", "default": true, "dns": {} }] k8s.v1.cni.cncf.io/networks-status:[{ "name": "default-cni-network", "interface": "eth0", "ips": [ "10.244.4.205" ], "mac": "ce:bf:71:36:08:9c", "default": true, "dns": {} }] kubernetes.io/psp:collectd] [] [] [{e2e.test Update v1 2021-08-18 11:25:41 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{".":{},"f:name":{},"f:time":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"p\"}":{".":{},"f:args":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:ports":{".":{},"k:{\"containerPort\":80,\"protocol\":\"TCP\"}":{".":{},"f:containerPort":{},"f:protocol":{}}},"f:resources":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}} {multus Update v1 2021-08-18 11:25:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:k8s.v1.cni.cncf.io/network-status":{},"f:k8s.v1.cni.cncf.io/networks-status":{}}}}} {kubelet Update v1 2021-08-18 11:25:47 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:phase":{},"f:podIP":{},"f:podIPs":{".":{},"k:{\"ip\":\"10.244.4.205\"}":{".":{},"f:ip":{}}},"f:startTime":{}}}}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:default-token-n4cj6,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:&SecretVolumeSource{SecretName:default-token-n4cj6,Items:[]KeyToPath{},DefaultMode:*420,Optional:nil,},NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:p,Image:k8s.gcr.io/e2e-test-images/agnhost:2.20,Command:[],Args:[serve-hostname],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:,HostPort:0,ContainerPort:80,Protocol:TCP,HostIP:,},},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:default-token-n4cj6,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:Always,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*30,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:node1,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,},Status:PodStatus{Phase:Running,Conditions:[]PodCondition{PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-08-18 11:25:41 +0000 UTC,Reason:,Message:,},PodCondition{Type:Ready,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-08-18 11:25:47 +0000 UTC,Reason:,Message:,},PodCondition{Type:ContainersReady,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-08-18 11:25:47 +0000 UTC,Reason:,Message:,},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-08-18 11:25:41 +0000 UTC,Reason:,Message:,},},Message:,Reason:,HostIP:10.10.190.207,PodIP:10.244.4.205,StartTime:2021-08-18 11:25:41 +0000 UTC,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:p,State:ContainerState{Waiting:nil,Running:&ContainerStateRunning{StartedAt:2021-08-18 11:25:45 +0000 UTC,},Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:true,RestartCount:0,Image:k8s.gcr.io/e2e-test-images/agnhost:2.20,ImageID:docker-pullable://k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0,ContainerID:docker://f1e67d3bbae65bc12a35472758c35b508a6e78684b72c9d54f1329c608a9881a,Started:*true,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{PodIP{IP:10.244.4.205,},},EphemeralContainerStatuses:[]ContainerStatus{},},} STEP: checking for scheduler event about the pod Aug 18 11:25:51.417: INFO: Saw scheduler event for our pod. STEP: checking for kubelet event about the pod Aug 18 11:25:53.420: INFO: Saw kubelet event for our pod. STEP: deleting the pod [AfterEach] [k8s.io] [sig-node] Events /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:25:53.425: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "events-5166" for this suite. • [SLOW TEST:12.060 seconds] [k8s.io] [sig-node] Events /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 should be sent by kubelets and the scheduler about pods scheduling and running [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [k8s.io] [sig-node] Events should be sent by kubelets and the scheduler about pods scheduling and running [Conformance]","total":-1,"completed":5,"skipped":54,"failed":0} SSS ------------------------------ [BeforeEach] [sig-storage] EmptyDir volumes /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:25:47.937: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename emptydir STEP: Waiting for a default service account to be provisioned in namespace [It] should support (root,0777,tmpfs) [LinuxOnly] [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating a pod to test emptydir 0777 on tmpfs Aug 18 11:25:47.978: INFO: Waiting up to 5m0s for pod "pod-5f8ee762-b531-4de3-baa0-82871c4123db" in namespace "emptydir-8410" to be "Succeeded or Failed" Aug 18 11:25:47.983: INFO: Pod "pod-5f8ee762-b531-4de3-baa0-82871c4123db": Phase="Pending", Reason="", readiness=false. Elapsed: 4.78497ms Aug 18 11:25:49.987: INFO: Pod "pod-5f8ee762-b531-4de3-baa0-82871c4123db": Phase="Pending", Reason="", readiness=false. Elapsed: 2.008531547s Aug 18 11:25:51.990: INFO: Pod "pod-5f8ee762-b531-4de3-baa0-82871c4123db": Phase="Pending", Reason="", readiness=false. Elapsed: 4.011666339s Aug 18 11:25:53.993: INFO: Pod "pod-5f8ee762-b531-4de3-baa0-82871c4123db": Phase="Succeeded", Reason="", readiness=false. Elapsed: 6.015425099s STEP: Saw pod success Aug 18 11:25:53.993: INFO: Pod "pod-5f8ee762-b531-4de3-baa0-82871c4123db" satisfied condition "Succeeded or Failed" Aug 18 11:25:53.996: INFO: Trying to get logs from node node2 pod pod-5f8ee762-b531-4de3-baa0-82871c4123db container test-container: STEP: delete the pod Aug 18 11:25:54.010: INFO: Waiting for pod pod-5f8ee762-b531-4de3-baa0-82871c4123db to disappear Aug 18 11:25:54.011: INFO: Pod pod-5f8ee762-b531-4de3-baa0-82871c4123db no longer exists [AfterEach] [sig-storage] EmptyDir volumes /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:25:54.012: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "emptydir-8410" for this suite. • [SLOW TEST:6.082 seconds] [sig-storage] EmptyDir volumes /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/empty_dir.go:42 should support (root,0777,tmpfs) [LinuxOnly] [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-storage] EmptyDir volumes should support (root,0777,tmpfs) [LinuxOnly] [NodeConformance] [Conformance]","total":-1,"completed":4,"skipped":21,"failed":0} SSSSSSS ------------------------------ [BeforeEach] [sig-storage] Projected secret /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:25:48.036: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename projected STEP: Waiting for a default service account to be provisioned in namespace [It] should be consumable from pods in volume as non-root with defaultMode and fsGroup set [LinuxOnly] [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating projection with secret that has name projected-secret-test-7c2b094e-2735-4a82-978a-e5897b2631b9 STEP: Creating a pod to test consume secrets Aug 18 11:25:48.069: INFO: Waiting up to 5m0s for pod "pod-projected-secrets-9bd184c9-7a45-444a-b249-3232080a1563" in namespace "projected-8955" to be "Succeeded or Failed" Aug 18 11:25:48.071: INFO: Pod "pod-projected-secrets-9bd184c9-7a45-444a-b249-3232080a1563": Phase="Pending", Reason="", readiness=false. Elapsed: 2.504929ms Aug 18 11:25:50.074: INFO: Pod "pod-projected-secrets-9bd184c9-7a45-444a-b249-3232080a1563": Phase="Pending", Reason="", readiness=false. Elapsed: 2.005044887s Aug 18 11:25:52.078: INFO: Pod "pod-projected-secrets-9bd184c9-7a45-444a-b249-3232080a1563": Phase="Pending", Reason="", readiness=false. Elapsed: 4.008883619s Aug 18 11:25:54.083: INFO: Pod "pod-projected-secrets-9bd184c9-7a45-444a-b249-3232080a1563": Phase="Succeeded", Reason="", readiness=false. Elapsed: 6.014401209s STEP: Saw pod success Aug 18 11:25:54.083: INFO: Pod "pod-projected-secrets-9bd184c9-7a45-444a-b249-3232080a1563" satisfied condition "Succeeded or Failed" Aug 18 11:25:54.086: INFO: Trying to get logs from node node2 pod pod-projected-secrets-9bd184c9-7a45-444a-b249-3232080a1563 container projected-secret-volume-test: STEP: delete the pod Aug 18 11:25:54.099: INFO: Waiting for pod pod-projected-secrets-9bd184c9-7a45-444a-b249-3232080a1563 to disappear Aug 18 11:25:54.101: INFO: Pod pod-projected-secrets-9bd184c9-7a45-444a-b249-3232080a1563 no longer exists [AfterEach] [sig-storage] Projected secret /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:25:54.102: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "projected-8955" for this suite. • [SLOW TEST:6.074 seconds] [sig-storage] Projected secret /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/projected_secret.go:35 should be consumable from pods in volume as non-root with defaultMode and fsGroup set [LinuxOnly] [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-storage] Projected secret should be consumable from pods in volume as non-root with defaultMode and fsGroup set [LinuxOnly] [NodeConformance] [Conformance]","total":-1,"completed":3,"skipped":11,"failed":0} SSSS ------------------------------ [BeforeEach] [sig-storage] Projected configMap /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:25:50.659: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename projected STEP: Waiting for a default service account to be provisioned in namespace [It] should be consumable in multiple volumes in the same pod [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating configMap with name projected-configmap-test-volume-1931e3f2-db65-46a4-bcf3-1768950294ea STEP: Creating a pod to test consume configMaps Aug 18 11:25:50.701: INFO: Waiting up to 5m0s for pod "pod-projected-configmaps-87a79617-dd9e-4549-84ad-065a82d051c8" in namespace "projected-1526" to be "Succeeded or Failed" Aug 18 11:25:50.704: INFO: Pod "pod-projected-configmaps-87a79617-dd9e-4549-84ad-065a82d051c8": Phase="Pending", Reason="", readiness=false. Elapsed: 2.72032ms Aug 18 11:25:52.707: INFO: Pod "pod-projected-configmaps-87a79617-dd9e-4549-84ad-065a82d051c8": Phase="Pending", Reason="", readiness=false. Elapsed: 2.006450567s Aug 18 11:25:54.710: INFO: Pod "pod-projected-configmaps-87a79617-dd9e-4549-84ad-065a82d051c8": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.009075605s STEP: Saw pod success Aug 18 11:25:54.710: INFO: Pod "pod-projected-configmaps-87a79617-dd9e-4549-84ad-065a82d051c8" satisfied condition "Succeeded or Failed" Aug 18 11:25:54.712: INFO: Trying to get logs from node node2 pod pod-projected-configmaps-87a79617-dd9e-4549-84ad-065a82d051c8 container projected-configmap-volume-test: STEP: delete the pod Aug 18 11:25:54.836: INFO: Waiting for pod pod-projected-configmaps-87a79617-dd9e-4549-84ad-065a82d051c8 to disappear Aug 18 11:25:54.839: INFO: Pod pod-projected-configmaps-87a79617-dd9e-4549-84ad-065a82d051c8 no longer exists [AfterEach] [sig-storage] Projected configMap /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:25:54.839: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "projected-1526" for this suite. • ------------------------------ {"msg":"PASSED [sig-storage] Projected configMap should be consumable in multiple volumes in the same pod [NodeConformance] [Conformance]","total":-1,"completed":4,"skipped":32,"failed":0} SSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-storage] Subpath /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:25:34.738: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename subpath STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] Atomic writer volumes /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/subpath.go:38 STEP: Setting up data [It] should support subpaths with secret pod [LinuxOnly] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating pod pod-subpath-test-secret-wbpb STEP: Creating a pod to test atomic-volume-subpath Aug 18 11:25:34.777: INFO: Waiting up to 5m0s for pod "pod-subpath-test-secret-wbpb" in namespace "subpath-5112" to be "Succeeded or Failed" Aug 18 11:25:34.779: INFO: Pod "pod-subpath-test-secret-wbpb": Phase="Pending", Reason="", readiness=false. Elapsed: 2.674853ms Aug 18 11:25:36.783: INFO: Pod "pod-subpath-test-secret-wbpb": Phase="Pending", Reason="", readiness=false. Elapsed: 2.005979178s Aug 18 11:25:38.785: INFO: Pod "pod-subpath-test-secret-wbpb": Phase="Running", Reason="", readiness=true. Elapsed: 4.00867305s Aug 18 11:25:40.788: INFO: Pod "pod-subpath-test-secret-wbpb": Phase="Running", Reason="", readiness=true. Elapsed: 6.01125353s Aug 18 11:25:42.791: INFO: Pod "pod-subpath-test-secret-wbpb": Phase="Running", Reason="", readiness=true. Elapsed: 8.014084404s Aug 18 11:25:44.793: INFO: Pod "pod-subpath-test-secret-wbpb": Phase="Running", Reason="", readiness=true. Elapsed: 10.016702341s Aug 18 11:25:46.797: INFO: Pod "pod-subpath-test-secret-wbpb": Phase="Running", Reason="", readiness=true. Elapsed: 12.020015291s Aug 18 11:25:48.801: INFO: Pod "pod-subpath-test-secret-wbpb": Phase="Running", Reason="", readiness=true. Elapsed: 14.02408316s Aug 18 11:25:50.804: INFO: Pod "pod-subpath-test-secret-wbpb": Phase="Running", Reason="", readiness=true. Elapsed: 16.027394103s Aug 18 11:25:52.807: INFO: Pod "pod-subpath-test-secret-wbpb": Phase="Running", Reason="", readiness=true. Elapsed: 18.030566513s Aug 18 11:25:54.811: INFO: Pod "pod-subpath-test-secret-wbpb": Phase="Running", Reason="", readiness=true. Elapsed: 20.033874577s Aug 18 11:25:56.816: INFO: Pod "pod-subpath-test-secret-wbpb": Phase="Running", Reason="", readiness=true. Elapsed: 22.039412885s Aug 18 11:25:58.819: INFO: Pod "pod-subpath-test-secret-wbpb": Phase="Succeeded", Reason="", readiness=false. Elapsed: 24.042251365s STEP: Saw pod success Aug 18 11:25:58.819: INFO: Pod "pod-subpath-test-secret-wbpb" satisfied condition "Succeeded or Failed" Aug 18 11:25:58.821: INFO: Trying to get logs from node node2 pod pod-subpath-test-secret-wbpb container test-container-subpath-secret-wbpb: STEP: delete the pod Aug 18 11:25:58.835: INFO: Waiting for pod pod-subpath-test-secret-wbpb to disappear Aug 18 11:25:58.837: INFO: Pod pod-subpath-test-secret-wbpb no longer exists STEP: Deleting pod pod-subpath-test-secret-wbpb Aug 18 11:25:58.837: INFO: Deleting pod "pod-subpath-test-secret-wbpb" in namespace "subpath-5112" [AfterEach] [sig-storage] Subpath /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:25:58.840: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "subpath-5112" for this suite. • [SLOW TEST:24.109 seconds] [sig-storage] Subpath /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/framework.go:23 Atomic writer volumes /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/subpath.go:34 should support subpaths with secret pod [LinuxOnly] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ [BeforeEach] [sig-cli] Kubectl client /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:25:28.242: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename kubectl STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-cli] Kubectl client /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/kubectl.go:247 [BeforeEach] Update Demo /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/kubectl.go:299 [It] should scale a replication controller [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: creating a replication controller Aug 18 11:25:28.263: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-800 create -f -' Aug 18 11:25:28.575: INFO: stderr: "" Aug 18 11:25:28.575: INFO: stdout: "replicationcontroller/update-demo-nautilus created\n" STEP: waiting for all containers in name=update-demo pods to come up. Aug 18 11:25:28.575: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-800 get pods -o template --template={{range.items}}{{.metadata.name}} {{end}} -l name=update-demo' Aug 18 11:25:28.717: INFO: stderr: "" Aug 18 11:25:28.717: INFO: stdout: "update-demo-nautilus-9wcjs update-demo-nautilus-crtn2 " Aug 18 11:25:28.717: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-800 get pods update-demo-nautilus-9wcjs -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}' Aug 18 11:25:28.879: INFO: stderr: "" Aug 18 11:25:28.879: INFO: stdout: "" Aug 18 11:25:28.879: INFO: update-demo-nautilus-9wcjs is created but not running Aug 18 11:25:33.880: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-800 get pods -o template --template={{range.items}}{{.metadata.name}} {{end}} -l name=update-demo' Aug 18 11:25:34.048: INFO: stderr: "" Aug 18 11:25:34.048: INFO: stdout: "update-demo-nautilus-9wcjs update-demo-nautilus-crtn2 " Aug 18 11:25:34.048: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-800 get pods update-demo-nautilus-9wcjs -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}' Aug 18 11:25:34.207: INFO: stderr: "" Aug 18 11:25:34.207: INFO: stdout: "true" Aug 18 11:25:34.207: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-800 get pods update-demo-nautilus-9wcjs -o template --template={{if (exists . "spec" "containers")}}{{range .spec.containers}}{{if eq .name "update-demo"}}{{.image}}{{end}}{{end}}{{end}}' Aug 18 11:25:34.340: INFO: stderr: "" Aug 18 11:25:34.340: INFO: stdout: "gcr.io/kubernetes-e2e-test-images/nautilus:1.0" Aug 18 11:25:34.340: INFO: validating pod update-demo-nautilus-9wcjs Aug 18 11:25:34.344: INFO: got data: { "image": "nautilus.jpg" } Aug 18 11:25:34.344: INFO: Unmarshalled json jpg/img => {nautilus.jpg} , expecting nautilus.jpg . Aug 18 11:25:34.344: INFO: update-demo-nautilus-9wcjs is verified up and running Aug 18 11:25:34.344: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-800 get pods update-demo-nautilus-crtn2 -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}' Aug 18 11:25:34.507: INFO: stderr: "" Aug 18 11:25:34.507: INFO: stdout: "" Aug 18 11:25:34.507: INFO: update-demo-nautilus-crtn2 is created but not running Aug 18 11:25:39.508: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-800 get pods -o template --template={{range.items}}{{.metadata.name}} {{end}} -l name=update-demo' Aug 18 11:25:39.690: INFO: stderr: "" Aug 18 11:25:39.690: INFO: stdout: "update-demo-nautilus-9wcjs update-demo-nautilus-crtn2 " Aug 18 11:25:39.690: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-800 get pods update-demo-nautilus-9wcjs -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}' Aug 18 11:25:39.845: INFO: stderr: "" Aug 18 11:25:39.845: INFO: stdout: "true" Aug 18 11:25:39.846: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-800 get pods update-demo-nautilus-9wcjs -o template --template={{if (exists . "spec" "containers")}}{{range .spec.containers}}{{if eq .name "update-demo"}}{{.image}}{{end}}{{end}}{{end}}' Aug 18 11:25:40.007: INFO: stderr: "" Aug 18 11:25:40.007: INFO: stdout: "gcr.io/kubernetes-e2e-test-images/nautilus:1.0" Aug 18 11:25:40.007: INFO: validating pod update-demo-nautilus-9wcjs Aug 18 11:25:40.010: INFO: got data: { "image": "nautilus.jpg" } Aug 18 11:25:40.010: INFO: Unmarshalled json jpg/img => {nautilus.jpg} , expecting nautilus.jpg . Aug 18 11:25:40.010: INFO: update-demo-nautilus-9wcjs is verified up and running Aug 18 11:25:40.010: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-800 get pods update-demo-nautilus-crtn2 -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}' Aug 18 11:25:40.173: INFO: stderr: "" Aug 18 11:25:40.173: INFO: stdout: "true" Aug 18 11:25:40.173: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-800 get pods update-demo-nautilus-crtn2 -o template --template={{if (exists . "spec" "containers")}}{{range .spec.containers}}{{if eq .name "update-demo"}}{{.image}}{{end}}{{end}}{{end}}' Aug 18 11:25:40.327: INFO: stderr: "" Aug 18 11:25:40.328: INFO: stdout: "gcr.io/kubernetes-e2e-test-images/nautilus:1.0" Aug 18 11:25:40.328: INFO: validating pod update-demo-nautilus-crtn2 Aug 18 11:25:40.331: INFO: got data: { "image": "nautilus.jpg" } Aug 18 11:25:40.331: INFO: Unmarshalled json jpg/img => {nautilus.jpg} , expecting nautilus.jpg . Aug 18 11:25:40.331: INFO: update-demo-nautilus-crtn2 is verified up and running STEP: scaling down the replication controller Aug 18 11:25:40.340: INFO: scanned /root for discovery docs: Aug 18 11:25:40.340: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-800 scale rc update-demo-nautilus --replicas=1 --timeout=5m' Aug 18 11:25:40.536: INFO: stderr: "" Aug 18 11:25:40.536: INFO: stdout: "replicationcontroller/update-demo-nautilus scaled\n" STEP: waiting for all containers in name=update-demo pods to come up. Aug 18 11:25:40.536: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-800 get pods -o template --template={{range.items}}{{.metadata.name}} {{end}} -l name=update-demo' Aug 18 11:25:40.710: INFO: stderr: "" Aug 18 11:25:40.710: INFO: stdout: "update-demo-nautilus-9wcjs update-demo-nautilus-crtn2 " STEP: Replicas for name=update-demo: expected=1 actual=2 Aug 18 11:25:45.711: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-800 get pods -o template --template={{range.items}}{{.metadata.name}} {{end}} -l name=update-demo' Aug 18 11:25:45.898: INFO: stderr: "" Aug 18 11:25:45.898: INFO: stdout: "update-demo-nautilus-9wcjs update-demo-nautilus-crtn2 " STEP: Replicas for name=update-demo: expected=1 actual=2 Aug 18 11:25:50.898: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-800 get pods -o template --template={{range.items}}{{.metadata.name}} {{end}} -l name=update-demo' Aug 18 11:25:51.063: INFO: stderr: "" Aug 18 11:25:51.063: INFO: stdout: "update-demo-nautilus-9wcjs " Aug 18 11:25:51.063: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-800 get pods update-demo-nautilus-9wcjs -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}' Aug 18 11:25:51.233: INFO: stderr: "" Aug 18 11:25:51.233: INFO: stdout: "true" Aug 18 11:25:51.233: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-800 get pods update-demo-nautilus-9wcjs -o template --template={{if (exists . "spec" "containers")}}{{range .spec.containers}}{{if eq .name "update-demo"}}{{.image}}{{end}}{{end}}{{end}}' Aug 18 11:25:51.390: INFO: stderr: "" Aug 18 11:25:51.390: INFO: stdout: "gcr.io/kubernetes-e2e-test-images/nautilus:1.0" Aug 18 11:25:51.390: INFO: validating pod update-demo-nautilus-9wcjs Aug 18 11:25:51.394: INFO: got data: { "image": "nautilus.jpg" } Aug 18 11:25:51.394: INFO: Unmarshalled json jpg/img => {nautilus.jpg} , expecting nautilus.jpg . Aug 18 11:25:51.394: INFO: update-demo-nautilus-9wcjs is verified up and running STEP: scaling up the replication controller Aug 18 11:25:51.402: INFO: scanned /root for discovery docs: Aug 18 11:25:51.402: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-800 scale rc update-demo-nautilus --replicas=2 --timeout=5m' Aug 18 11:25:51.589: INFO: stderr: "" Aug 18 11:25:51.589: INFO: stdout: "replicationcontroller/update-demo-nautilus scaled\n" STEP: waiting for all containers in name=update-demo pods to come up. Aug 18 11:25:51.589: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-800 get pods -o template --template={{range.items}}{{.metadata.name}} {{end}} -l name=update-demo' Aug 18 11:25:51.750: INFO: stderr: "" Aug 18 11:25:51.750: INFO: stdout: "update-demo-nautilus-9wcjs update-demo-nautilus-bqgd5 " Aug 18 11:25:51.750: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-800 get pods update-demo-nautilus-9wcjs -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}' Aug 18 11:25:51.926: INFO: stderr: "" Aug 18 11:25:51.926: INFO: stdout: "true" Aug 18 11:25:51.926: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-800 get pods update-demo-nautilus-9wcjs -o template --template={{if (exists . "spec" "containers")}}{{range .spec.containers}}{{if eq .name "update-demo"}}{{.image}}{{end}}{{end}}{{end}}' Aug 18 11:25:52.077: INFO: stderr: "" Aug 18 11:25:52.077: INFO: stdout: "gcr.io/kubernetes-e2e-test-images/nautilus:1.0" Aug 18 11:25:52.077: INFO: validating pod update-demo-nautilus-9wcjs Aug 18 11:25:52.080: INFO: got data: { "image": "nautilus.jpg" } Aug 18 11:25:52.080: INFO: Unmarshalled json jpg/img => {nautilus.jpg} , expecting nautilus.jpg . Aug 18 11:25:52.080: INFO: update-demo-nautilus-9wcjs is verified up and running Aug 18 11:25:52.080: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-800 get pods update-demo-nautilus-bqgd5 -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}' Aug 18 11:25:52.229: INFO: stderr: "" Aug 18 11:25:52.229: INFO: stdout: "" Aug 18 11:25:52.229: INFO: update-demo-nautilus-bqgd5 is created but not running Aug 18 11:25:57.230: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-800 get pods -o template --template={{range.items}}{{.metadata.name}} {{end}} -l name=update-demo' Aug 18 11:25:57.386: INFO: stderr: "" Aug 18 11:25:57.386: INFO: stdout: "update-demo-nautilus-9wcjs update-demo-nautilus-bqgd5 " Aug 18 11:25:57.386: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-800 get pods update-demo-nautilus-9wcjs -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}' Aug 18 11:25:57.547: INFO: stderr: "" Aug 18 11:25:57.547: INFO: stdout: "true" Aug 18 11:25:57.547: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-800 get pods update-demo-nautilus-9wcjs -o template --template={{if (exists . "spec" "containers")}}{{range .spec.containers}}{{if eq .name "update-demo"}}{{.image}}{{end}}{{end}}{{end}}' Aug 18 11:25:57.710: INFO: stderr: "" Aug 18 11:25:57.710: INFO: stdout: "gcr.io/kubernetes-e2e-test-images/nautilus:1.0" Aug 18 11:25:57.710: INFO: validating pod update-demo-nautilus-9wcjs Aug 18 11:25:57.713: INFO: got data: { "image": "nautilus.jpg" } Aug 18 11:25:57.714: INFO: Unmarshalled json jpg/img => {nautilus.jpg} , expecting nautilus.jpg . Aug 18 11:25:57.714: INFO: update-demo-nautilus-9wcjs is verified up and running Aug 18 11:25:57.714: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-800 get pods update-demo-nautilus-bqgd5 -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}' Aug 18 11:25:57.885: INFO: stderr: "" Aug 18 11:25:57.885: INFO: stdout: "true" Aug 18 11:25:57.885: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-800 get pods update-demo-nautilus-bqgd5 -o template --template={{if (exists . "spec" "containers")}}{{range .spec.containers}}{{if eq .name "update-demo"}}{{.image}}{{end}}{{end}}{{end}}' Aug 18 11:25:58.045: INFO: stderr: "" Aug 18 11:25:58.045: INFO: stdout: "gcr.io/kubernetes-e2e-test-images/nautilus:1.0" Aug 18 11:25:58.045: INFO: validating pod update-demo-nautilus-bqgd5 Aug 18 11:25:58.049: INFO: got data: { "image": "nautilus.jpg" } Aug 18 11:25:58.049: INFO: Unmarshalled json jpg/img => {nautilus.jpg} , expecting nautilus.jpg . Aug 18 11:25:58.049: INFO: update-demo-nautilus-bqgd5 is verified up and running STEP: using delete to clean up resources Aug 18 11:25:58.049: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-800 delete --grace-period=0 --force -f -' Aug 18 11:25:58.184: INFO: stderr: "warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely.\n" Aug 18 11:25:58.184: INFO: stdout: "replicationcontroller \"update-demo-nautilus\" force deleted\n" Aug 18 11:25:58.184: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-800 get rc,svc -l name=update-demo --no-headers' Aug 18 11:25:58.363: INFO: stderr: "No resources found in kubectl-800 namespace.\n" Aug 18 11:25:58.363: INFO: stdout: "" Aug 18 11:25:58.363: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-800 get pods -l name=update-demo -o go-template={{ range .items }}{{ if not .metadata.deletionTimestamp }}{{ .metadata.name }}{{ "\n" }}{{ end }}{{ end }}' Aug 18 11:25:58.537: INFO: stderr: "" Aug 18 11:25:58.537: INFO: stdout: "update-demo-nautilus-9wcjs\nupdate-demo-nautilus-bqgd5\n" Aug 18 11:25:59.038: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-800 get rc,svc -l name=update-demo --no-headers' Aug 18 11:25:59.243: INFO: stderr: "No resources found in kubectl-800 namespace.\n" Aug 18 11:25:59.243: INFO: stdout: "" Aug 18 11:25:59.243: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-800 get pods -l name=update-demo -o go-template={{ range .items }}{{ if not .metadata.deletionTimestamp }}{{ .metadata.name }}{{ "\n" }}{{ end }}{{ end }}' Aug 18 11:25:59.403: INFO: stderr: "" Aug 18 11:25:59.403: INFO: stdout: "" [AfterEach] [sig-cli] Kubectl client /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:25:59.404: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "kubectl-800" for this suite. • [SLOW TEST:31.172 seconds] [sig-cli] Kubectl client /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/framework.go:23 Update Demo /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/kubectl.go:297 should scale a replication controller [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-cli] Kubectl client Update Demo should scale a replication controller [Conformance]","total":-1,"completed":2,"skipped":36,"failed":0} SSSSSSSSS ------------------------------ [BeforeEach] [sig-storage] EmptyDir volumes /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:25:54.886: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename emptydir STEP: Waiting for a default service account to be provisioned in namespace [It] should support (non-root,0777,default) [LinuxOnly] [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating a pod to test emptydir 0777 on node default medium Aug 18 11:25:54.918: INFO: Waiting up to 5m0s for pod "pod-43aee77e-dea3-4719-a300-1c7d0e9101e0" in namespace "emptydir-620" to be "Succeeded or Failed" Aug 18 11:25:54.923: INFO: Pod "pod-43aee77e-dea3-4719-a300-1c7d0e9101e0": Phase="Pending", Reason="", readiness=false. Elapsed: 4.45274ms Aug 18 11:25:56.925: INFO: Pod "pod-43aee77e-dea3-4719-a300-1c7d0e9101e0": Phase="Pending", Reason="", readiness=false. Elapsed: 2.007231541s Aug 18 11:25:58.928: INFO: Pod "pod-43aee77e-dea3-4719-a300-1c7d0e9101e0": Phase="Running", Reason="", readiness=true. Elapsed: 4.010424861s Aug 18 11:26:00.931: INFO: Pod "pod-43aee77e-dea3-4719-a300-1c7d0e9101e0": Phase="Succeeded", Reason="", readiness=false. Elapsed: 6.013245329s STEP: Saw pod success Aug 18 11:26:00.931: INFO: Pod "pod-43aee77e-dea3-4719-a300-1c7d0e9101e0" satisfied condition "Succeeded or Failed" Aug 18 11:26:00.934: INFO: Trying to get logs from node node1 pod pod-43aee77e-dea3-4719-a300-1c7d0e9101e0 container test-container: STEP: delete the pod Aug 18 11:26:00.948: INFO: Waiting for pod pod-43aee77e-dea3-4719-a300-1c7d0e9101e0 to disappear Aug 18 11:26:00.950: INFO: Pod pod-43aee77e-dea3-4719-a300-1c7d0e9101e0 no longer exists [AfterEach] [sig-storage] EmptyDir volumes /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:26:00.950: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "emptydir-620" for this suite. • [SLOW TEST:6.072 seconds] [sig-storage] EmptyDir volumes /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/empty_dir.go:42 should support (non-root,0777,default) [LinuxOnly] [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-storage] EmptyDir volumes should support (non-root,0777,default) [LinuxOnly] [NodeConformance] [Conformance]","total":-1,"completed":5,"skipped":49,"failed":0} SSSSSSSSSSSSSSSSSSSSSSS ------------------------------ {"msg":"PASSED [sig-storage] Subpath Atomic writer volumes should support subpaths with secret pod [LinuxOnly] [Conformance]","total":-1,"completed":2,"skipped":84,"failed":0} [BeforeEach] [k8s.io] Docker Containers /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:25:58.851: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename containers STEP: Waiting for a default service account to be provisioned in namespace [It] should be able to override the image's default command (docker entrypoint) [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating a pod to test override command Aug 18 11:25:58.884: INFO: Waiting up to 5m0s for pod "client-containers-2b5cc999-2c6a-4f90-a201-30d56fbb4f76" in namespace "containers-5031" to be "Succeeded or Failed" Aug 18 11:25:58.886: INFO: Pod "client-containers-2b5cc999-2c6a-4f90-a201-30d56fbb4f76": Phase="Pending", Reason="", readiness=false. Elapsed: 1.93164ms Aug 18 11:26:00.894: INFO: Pod "client-containers-2b5cc999-2c6a-4f90-a201-30d56fbb4f76": Phase="Pending", Reason="", readiness=false. Elapsed: 2.010735235s Aug 18 11:26:02.897: INFO: Pod "client-containers-2b5cc999-2c6a-4f90-a201-30d56fbb4f76": Phase="Pending", Reason="", readiness=false. Elapsed: 4.013622392s Aug 18 11:26:04.900: INFO: Pod "client-containers-2b5cc999-2c6a-4f90-a201-30d56fbb4f76": Phase="Succeeded", Reason="", readiness=false. Elapsed: 6.016544778s STEP: Saw pod success Aug 18 11:26:04.900: INFO: Pod "client-containers-2b5cc999-2c6a-4f90-a201-30d56fbb4f76" satisfied condition "Succeeded or Failed" Aug 18 11:26:04.903: INFO: Trying to get logs from node node1 pod client-containers-2b5cc999-2c6a-4f90-a201-30d56fbb4f76 container test-container: STEP: delete the pod Aug 18 11:26:04.914: INFO: Waiting for pod client-containers-2b5cc999-2c6a-4f90-a201-30d56fbb4f76 to disappear Aug 18 11:26:04.917: INFO: Pod client-containers-2b5cc999-2c6a-4f90-a201-30d56fbb4f76 no longer exists [AfterEach] [k8s.io] Docker Containers /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:26:04.917: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "containers-5031" for this suite. • [SLOW TEST:6.074 seconds] [k8s.io] Docker Containers /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 should be able to override the image's default command (docker entrypoint) [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [k8s.io] Docker Containers should be able to override the image's default command (docker entrypoint) [NodeConformance] [Conformance]","total":-1,"completed":3,"skipped":84,"failed":0} SSSSSSSSSSSSS ------------------------------ [BeforeEach] [k8s.io] Docker Containers /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:26:01.020: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename containers STEP: Waiting for a default service account to be provisioned in namespace [It] should be able to override the image's default command and arguments [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating a pod to test override all Aug 18 11:26:01.050: INFO: Waiting up to 5m0s for pod "client-containers-a513ae86-ac07-4ba6-8c01-eca6afc13459" in namespace "containers-7540" to be "Succeeded or Failed" Aug 18 11:26:01.054: INFO: Pod "client-containers-a513ae86-ac07-4ba6-8c01-eca6afc13459": Phase="Pending", Reason="", readiness=false. Elapsed: 4.023179ms Aug 18 11:26:03.057: INFO: Pod "client-containers-a513ae86-ac07-4ba6-8c01-eca6afc13459": Phase="Pending", Reason="", readiness=false. Elapsed: 2.006854526s Aug 18 11:26:05.059: INFO: Pod "client-containers-a513ae86-ac07-4ba6-8c01-eca6afc13459": Phase="Pending", Reason="", readiness=false. Elapsed: 4.009611642s Aug 18 11:26:07.062: INFO: Pod "client-containers-a513ae86-ac07-4ba6-8c01-eca6afc13459": Phase="Succeeded", Reason="", readiness=false. Elapsed: 6.011973478s STEP: Saw pod success Aug 18 11:26:07.062: INFO: Pod "client-containers-a513ae86-ac07-4ba6-8c01-eca6afc13459" satisfied condition "Succeeded or Failed" Aug 18 11:26:07.064: INFO: Trying to get logs from node node1 pod client-containers-a513ae86-ac07-4ba6-8c01-eca6afc13459 container test-container: STEP: delete the pod Aug 18 11:26:07.077: INFO: Waiting for pod client-containers-a513ae86-ac07-4ba6-8c01-eca6afc13459 to disappear Aug 18 11:26:07.078: INFO: Pod client-containers-a513ae86-ac07-4ba6-8c01-eca6afc13459 no longer exists [AfterEach] [k8s.io] Docker Containers /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:26:07.078: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "containers-7540" for this suite. • [SLOW TEST:6.066 seconds] [k8s.io] Docker Containers /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 should be able to override the image's default command and arguments [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [k8s.io] Docker Containers should be able to override the image's default command and arguments [NodeConformance] [Conformance]","total":-1,"completed":6,"skipped":72,"failed":0} SSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-storage] Secrets /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:26:04.959: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename secrets STEP: Waiting for a default service account to be provisioned in namespace [It] should be consumable from pods in volume as non-root with defaultMode and fsGroup set [LinuxOnly] [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating secret with name secret-test-10f3538b-db5f-44f4-a331-7db4fdf76f9e STEP: Creating a pod to test consume secrets Aug 18 11:26:04.994: INFO: Waiting up to 5m0s for pod "pod-secrets-199fbeeb-164d-4e17-af2f-c199bc9e5013" in namespace "secrets-2226" to be "Succeeded or Failed" Aug 18 11:26:04.996: INFO: Pod "pod-secrets-199fbeeb-164d-4e17-af2f-c199bc9e5013": Phase="Pending", Reason="", readiness=false. Elapsed: 2.73746ms Aug 18 11:26:06.999: INFO: Pod "pod-secrets-199fbeeb-164d-4e17-af2f-c199bc9e5013": Phase="Pending", Reason="", readiness=false. Elapsed: 2.005196942s Aug 18 11:26:09.001: INFO: Pod "pod-secrets-199fbeeb-164d-4e17-af2f-c199bc9e5013": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.007764108s STEP: Saw pod success Aug 18 11:26:09.002: INFO: Pod "pod-secrets-199fbeeb-164d-4e17-af2f-c199bc9e5013" satisfied condition "Succeeded or Failed" Aug 18 11:26:09.004: INFO: Trying to get logs from node node1 pod pod-secrets-199fbeeb-164d-4e17-af2f-c199bc9e5013 container secret-volume-test: STEP: delete the pod Aug 18 11:26:09.017: INFO: Waiting for pod pod-secrets-199fbeeb-164d-4e17-af2f-c199bc9e5013 to disappear Aug 18 11:26:09.019: INFO: Pod pod-secrets-199fbeeb-164d-4e17-af2f-c199bc9e5013 no longer exists [AfterEach] [sig-storage] Secrets /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:26:09.020: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "secrets-2226" for this suite. • ------------------------------ {"msg":"PASSED [sig-storage] Secrets should be consumable from pods in volume as non-root with defaultMode and fsGroup set [LinuxOnly] [NodeConformance] [Conformance]","total":-1,"completed":4,"skipped":97,"failed":0} SSS ------------------------------ [BeforeEach] [sig-storage] Subpath /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:25:44.326: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename subpath STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] Atomic writer volumes /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/subpath.go:38 STEP: Setting up data [It] should support subpaths with projected pod [LinuxOnly] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating pod pod-subpath-test-projected-59xf STEP: Creating a pod to test atomic-volume-subpath Aug 18 11:25:44.361: INFO: Waiting up to 5m0s for pod "pod-subpath-test-projected-59xf" in namespace "subpath-1266" to be "Succeeded or Failed" Aug 18 11:25:44.367: INFO: Pod "pod-subpath-test-projected-59xf": Phase="Pending", Reason="", readiness=false. Elapsed: 5.558897ms Aug 18 11:25:46.371: INFO: Pod "pod-subpath-test-projected-59xf": Phase="Pending", Reason="", readiness=false. Elapsed: 2.009374939s Aug 18 11:25:48.373: INFO: Pod "pod-subpath-test-projected-59xf": Phase="Pending", Reason="", readiness=false. Elapsed: 4.012074947s Aug 18 11:25:50.378: INFO: Pod "pod-subpath-test-projected-59xf": Phase="Running", Reason="", readiness=true. Elapsed: 6.017105503s Aug 18 11:25:52.383: INFO: Pod "pod-subpath-test-projected-59xf": Phase="Running", Reason="", readiness=true. Elapsed: 8.021284792s Aug 18 11:25:54.386: INFO: Pod "pod-subpath-test-projected-59xf": Phase="Running", Reason="", readiness=true. Elapsed: 10.02498251s Aug 18 11:25:56.389: INFO: Pod "pod-subpath-test-projected-59xf": Phase="Running", Reason="", readiness=true. Elapsed: 12.027613267s Aug 18 11:25:58.392: INFO: Pod "pod-subpath-test-projected-59xf": Phase="Running", Reason="", readiness=true. Elapsed: 14.030556537s Aug 18 11:26:00.396: INFO: Pod "pod-subpath-test-projected-59xf": Phase="Running", Reason="", readiness=true. Elapsed: 16.035091895s Aug 18 11:26:02.400: INFO: Pod "pod-subpath-test-projected-59xf": Phase="Running", Reason="", readiness=true. Elapsed: 18.038458742s Aug 18 11:26:04.403: INFO: Pod "pod-subpath-test-projected-59xf": Phase="Running", Reason="", readiness=true. Elapsed: 20.042032313s Aug 18 11:26:06.408: INFO: Pod "pod-subpath-test-projected-59xf": Phase="Running", Reason="", readiness=true. Elapsed: 22.046600913s Aug 18 11:26:08.411: INFO: Pod "pod-subpath-test-projected-59xf": Phase="Running", Reason="", readiness=true. Elapsed: 24.0501383s Aug 18 11:26:10.415: INFO: Pod "pod-subpath-test-projected-59xf": Phase="Succeeded", Reason="", readiness=false. Elapsed: 26.053191502s STEP: Saw pod success Aug 18 11:26:10.415: INFO: Pod "pod-subpath-test-projected-59xf" satisfied condition "Succeeded or Failed" Aug 18 11:26:10.417: INFO: Trying to get logs from node node1 pod pod-subpath-test-projected-59xf container test-container-subpath-projected-59xf: STEP: delete the pod Aug 18 11:26:10.433: INFO: Waiting for pod pod-subpath-test-projected-59xf to disappear Aug 18 11:26:10.435: INFO: Pod pod-subpath-test-projected-59xf no longer exists STEP: Deleting pod pod-subpath-test-projected-59xf Aug 18 11:26:10.435: INFO: Deleting pod "pod-subpath-test-projected-59xf" in namespace "subpath-1266" [AfterEach] [sig-storage] Subpath /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:26:10.437: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "subpath-1266" for this suite. • [SLOW TEST:26.118 seconds] [sig-storage] Subpath /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/framework.go:23 Atomic writer volumes /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/subpath.go:34 should support subpaths with projected pod [LinuxOnly] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-storage] Subpath Atomic writer volumes should support subpaths with projected pod [LinuxOnly] [Conformance]","total":-1,"completed":6,"skipped":167,"failed":0} SSSS ------------------------------ [BeforeEach] [sig-cli] Kubectl client /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:25:54.037: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename kubectl STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-cli] Kubectl client /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/kubectl.go:247 [BeforeEach] Kubectl replace /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/kubectl.go:1546 [It] should update a single-container pod's image [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: running the image docker.io/library/httpd:2.4.38-alpine Aug 18 11:25:54.056: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-8606 run e2e-test-httpd-pod --image=docker.io/library/httpd:2.4.38-alpine --labels=run=e2e-test-httpd-pod' Aug 18 11:25:54.216: INFO: stderr: "" Aug 18 11:25:54.216: INFO: stdout: "pod/e2e-test-httpd-pod created\n" STEP: verifying the pod e2e-test-httpd-pod is running STEP: verifying the pod e2e-test-httpd-pod was created Aug 18 11:25:59.266: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-8606 get pod e2e-test-httpd-pod -o json' Aug 18 11:25:59.422: INFO: stderr: "" Aug 18 11:25:59.422: INFO: stdout: "{\n \"apiVersion\": \"v1\",\n \"kind\": \"Pod\",\n \"metadata\": {\n \"annotations\": {\n \"k8s.v1.cni.cncf.io/network-status\": \"[{\\n \\\"name\\\": \\\"default-cni-network\\\",\\n \\\"interface\\\": \\\"eth0\\\",\\n \\\"ips\\\": [\\n \\\"10.244.4.212\\\"\\n ],\\n \\\"mac\\\": \\\"c6:dc:98:89:ed:b9\\\",\\n \\\"default\\\": true,\\n \\\"dns\\\": {}\\n}]\",\n \"k8s.v1.cni.cncf.io/networks-status\": \"[{\\n \\\"name\\\": \\\"default-cni-network\\\",\\n \\\"interface\\\": \\\"eth0\\\",\\n \\\"ips\\\": [\\n \\\"10.244.4.212\\\"\\n ],\\n \\\"mac\\\": \\\"c6:dc:98:89:ed:b9\\\",\\n \\\"default\\\": true,\\n \\\"dns\\\": {}\\n}]\",\n \"kubernetes.io/psp\": \"collectd\"\n },\n \"creationTimestamp\": \"2021-08-18T11:25:54Z\",\n \"labels\": {\n \"run\": \"e2e-test-httpd-pod\"\n },\n \"managedFields\": [\n {\n \"apiVersion\": \"v1\",\n \"fieldsType\": \"FieldsV1\",\n \"fieldsV1\": {\n \"f:metadata\": {\n \"f:labels\": {\n \".\": {},\n \"f:run\": {}\n }\n },\n \"f:spec\": {\n \"f:containers\": {\n \"k:{\\\"name\\\":\\\"e2e-test-httpd-pod\\\"}\": {\n \".\": {},\n \"f:image\": {},\n \"f:imagePullPolicy\": {},\n \"f:name\": {},\n \"f:resources\": {},\n \"f:terminationMessagePath\": {},\n \"f:terminationMessagePolicy\": {}\n }\n },\n \"f:dnsPolicy\": {},\n \"f:enableServiceLinks\": {},\n \"f:restartPolicy\": {},\n \"f:schedulerName\": {},\n \"f:securityContext\": {},\n \"f:terminationGracePeriodSeconds\": {}\n }\n },\n \"manager\": \"kubectl-run\",\n \"operation\": \"Update\",\n \"time\": \"2021-08-18T11:25:54Z\"\n },\n {\n \"apiVersion\": \"v1\",\n \"fieldsType\": \"FieldsV1\",\n \"fieldsV1\": {\n \"f:metadata\": {\n \"f:annotations\": {\n \"f:k8s.v1.cni.cncf.io/network-status\": {},\n \"f:k8s.v1.cni.cncf.io/networks-status\": {}\n }\n }\n },\n \"manager\": \"multus\",\n \"operation\": \"Update\",\n \"time\": \"2021-08-18T11:25:56Z\"\n },\n {\n \"apiVersion\": \"v1\",\n \"fieldsType\": \"FieldsV1\",\n \"fieldsV1\": {\n \"f:status\": {\n \"f:conditions\": {\n \"k:{\\\"type\\\":\\\"ContainersReady\\\"}\": {\n \".\": {},\n \"f:lastProbeTime\": {},\n \"f:lastTransitionTime\": {},\n \"f:status\": {},\n \"f:type\": {}\n },\n \"k:{\\\"type\\\":\\\"Initialized\\\"}\": {\n \".\": {},\n \"f:lastProbeTime\": {},\n \"f:lastTransitionTime\": {},\n \"f:status\": {},\n \"f:type\": {}\n },\n \"k:{\\\"type\\\":\\\"Ready\\\"}\": {\n \".\": {},\n \"f:lastProbeTime\": {},\n \"f:lastTransitionTime\": {},\n \"f:status\": {},\n \"f:type\": {}\n }\n },\n \"f:containerStatuses\": {},\n \"f:hostIP\": {},\n \"f:phase\": {},\n \"f:podIP\": {},\n \"f:podIPs\": {\n \".\": {},\n \"k:{\\\"ip\\\":\\\"10.244.4.212\\\"}\": {\n \".\": {},\n \"f:ip\": {}\n }\n },\n \"f:startTime\": {}\n }\n },\n \"manager\": \"kubelet\",\n \"operation\": \"Update\",\n \"time\": \"2021-08-18T11:25:58Z\"\n }\n ],\n \"name\": \"e2e-test-httpd-pod\",\n \"namespace\": \"kubectl-8606\",\n \"resourceVersion\": \"54832\",\n \"selfLink\": \"/api/v1/namespaces/kubectl-8606/pods/e2e-test-httpd-pod\",\n \"uid\": \"d82fd78d-898d-4024-8395-c4476f2dec1e\"\n },\n \"spec\": {\n \"containers\": [\n {\n \"image\": \"docker.io/library/httpd:2.4.38-alpine\",\n \"imagePullPolicy\": \"Always\",\n \"name\": \"e2e-test-httpd-pod\",\n \"resources\": {},\n \"terminationMessagePath\": \"/dev/termination-log\",\n \"terminationMessagePolicy\": \"File\",\n \"volumeMounts\": [\n {\n \"mountPath\": \"/var/run/secrets/kubernetes.io/serviceaccount\",\n \"name\": \"default-token-n2bfb\",\n \"readOnly\": true\n }\n ]\n }\n ],\n \"dnsPolicy\": \"ClusterFirst\",\n \"enableServiceLinks\": true,\n \"nodeName\": \"node1\",\n \"preemptionPolicy\": \"PreemptLowerPriority\",\n \"priority\": 0,\n \"restartPolicy\": \"Always\",\n \"schedulerName\": \"default-scheduler\",\n \"securityContext\": {},\n \"serviceAccount\": \"default\",\n \"serviceAccountName\": \"default\",\n \"terminationGracePeriodSeconds\": 30,\n \"tolerations\": [\n {\n \"effect\": \"NoExecute\",\n \"key\": \"node.kubernetes.io/not-ready\",\n \"operator\": \"Exists\",\n \"tolerationSeconds\": 300\n },\n {\n \"effect\": \"NoExecute\",\n \"key\": \"node.kubernetes.io/unreachable\",\n \"operator\": \"Exists\",\n \"tolerationSeconds\": 300\n }\n ],\n \"volumes\": [\n {\n \"name\": \"default-token-n2bfb\",\n \"secret\": {\n \"defaultMode\": 420,\n \"secretName\": \"default-token-n2bfb\"\n }\n }\n ]\n },\n \"status\": {\n \"conditions\": [\n {\n \"lastProbeTime\": null,\n \"lastTransitionTime\": \"2021-08-18T11:25:54Z\",\n \"status\": \"True\",\n \"type\": \"Initialized\"\n },\n {\n \"lastProbeTime\": null,\n \"lastTransitionTime\": \"2021-08-18T11:25:58Z\",\n \"status\": \"True\",\n \"type\": \"Ready\"\n },\n {\n \"lastProbeTime\": null,\n \"lastTransitionTime\": \"2021-08-18T11:25:58Z\",\n \"status\": \"True\",\n \"type\": \"ContainersReady\"\n },\n {\n \"lastProbeTime\": null,\n \"lastTransitionTime\": \"2021-08-18T11:25:54Z\",\n \"status\": \"True\",\n \"type\": \"PodScheduled\"\n }\n ],\n \"containerStatuses\": [\n {\n \"containerID\": \"docker://c8485008beffdc7827660854024862b7cbd2527561975528e1546c6a26209d15\",\n \"image\": \"httpd:2.4.38-alpine\",\n \"imageID\": \"docker-pullable://httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060\",\n \"lastState\": {},\n \"name\": \"e2e-test-httpd-pod\",\n \"ready\": true,\n \"restartCount\": 0,\n \"started\": true,\n \"state\": {\n \"running\": {\n \"startedAt\": \"2021-08-18T11:25:58Z\"\n }\n }\n }\n ],\n \"hostIP\": \"10.10.190.207\",\n \"phase\": \"Running\",\n \"podIP\": \"10.244.4.212\",\n \"podIPs\": [\n {\n \"ip\": \"10.244.4.212\"\n }\n ],\n \"qosClass\": \"BestEffort\",\n \"startTime\": \"2021-08-18T11:25:54Z\"\n }\n}\n" STEP: replace the image in the pod Aug 18 11:25:59.423: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-8606 replace -f -' Aug 18 11:25:59.764: INFO: stderr: "" Aug 18 11:25:59.764: INFO: stdout: "pod/e2e-test-httpd-pod replaced\n" STEP: verifying the pod e2e-test-httpd-pod has the right image docker.io/library/busybox:1.29 [AfterEach] Kubectl replace /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/kubectl.go:1550 Aug 18 11:25:59.767: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-8606 delete pods e2e-test-httpd-pod' Aug 18 11:26:11.166: INFO: stderr: "" Aug 18 11:26:11.166: INFO: stdout: "pod \"e2e-test-httpd-pod\" deleted\n" [AfterEach] [sig-cli] Kubectl client /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:26:11.166: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "kubectl-8606" for this suite. • [SLOW TEST:17.136 seconds] [sig-cli] Kubectl client /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/framework.go:23 Kubectl replace /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/kubectl.go:1543 should update a single-container pod's image [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-cli] Kubectl client Kubectl replace should update a single-container pod's image [Conformance]","total":-1,"completed":5,"skipped":28,"failed":0} SSS ------------------------------ [BeforeEach] [sig-api-machinery] Aggregator /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:25:54.122: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename aggregator STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-api-machinery] Aggregator /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/aggregator.go:76 Aug 18 11:25:54.142: INFO: >>> kubeConfig: /root/.kube/config [It] Should be able to support the 1.17 Sample API Server using the current Aggregator [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Registering the sample API server. Aug 18 11:25:54.752: INFO: deployment "sample-apiserver-deployment" doesn't have the required revision set Aug 18 11:25:56.778: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882754, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882754, loc:(*time.Location)(0x77169a0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882754, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882754, loc:(*time.Location)(0x77169a0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-67dc674868\" is progressing."}}, CollisionCount:(*int32)(nil)} Aug 18 11:25:58.781: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882754, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882754, loc:(*time.Location)(0x77169a0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882754, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882754, loc:(*time.Location)(0x77169a0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-67dc674868\" is progressing."}}, CollisionCount:(*int32)(nil)} Aug 18 11:26:00.782: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882754, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882754, loc:(*time.Location)(0x77169a0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882754, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882754, loc:(*time.Location)(0x77169a0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-67dc674868\" is progressing."}}, CollisionCount:(*int32)(nil)} Aug 18 11:26:02.781: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882754, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882754, loc:(*time.Location)(0x77169a0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882754, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882754, loc:(*time.Location)(0x77169a0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-67dc674868\" is progressing."}}, CollisionCount:(*int32)(nil)} Aug 18 11:26:04.781: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882754, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882754, loc:(*time.Location)(0x77169a0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882754, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882754, loc:(*time.Location)(0x77169a0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-67dc674868\" is progressing."}}, CollisionCount:(*int32)(nil)} Aug 18 11:26:06.782: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882754, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882754, loc:(*time.Location)(0x77169a0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882754, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882754, loc:(*time.Location)(0x77169a0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-67dc674868\" is progressing."}}, CollisionCount:(*int32)(nil)} Aug 18 11:26:08.781: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882754, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882754, loc:(*time.Location)(0x77169a0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882754, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882754, loc:(*time.Location)(0x77169a0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-67dc674868\" is progressing."}}, CollisionCount:(*int32)(nil)} Aug 18 11:26:11.503: INFO: Waited 712.810999ms for the sample-apiserver to be ready to handle requests. [AfterEach] [sig-api-machinery] Aggregator /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/aggregator.go:67 [AfterEach] [sig-api-machinery] Aggregator /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:26:12.346: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "aggregator-1921" for this suite. • [SLOW TEST:18.326 seconds] [sig-api-machinery] Aggregator /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23 Should be able to support the 1.17 Sample API Server using the current Aggregator [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-api-machinery] Aggregator Should be able to support the 1.17 Sample API Server using the current Aggregator [Conformance]","total":-1,"completed":4,"skipped":15,"failed":0} SSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-storage] Downward API volume /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:26:09.037: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename downward-api STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-storage] Downward API volume /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/downwardapi_volume.go:42 [It] should update annotations on modification [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating the pod Aug 18 11:26:13.594: INFO: Successfully updated pod "annotationupdated0bc5b84-5848-481d-a5f9-185e4e8df1d8" [AfterEach] [sig-storage] Downward API volume /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:26:18.121: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "downward-api-9126" for this suite. • [SLOW TEST:9.092 seconds] [sig-storage] Downward API volume /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/downwardapi_volume.go:37 should update annotations on modification [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-storage] Downward API volume should update annotations on modification [NodeConformance] [Conformance]","total":-1,"completed":5,"skipped":100,"failed":0} S ------------------------------ [BeforeEach] [sig-api-machinery] ResourceQuota /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:26:18.135: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename resourcequota STEP: Waiting for a default service account to be provisioned in namespace [It] should be able to update and delete ResourceQuota. [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating a ResourceQuota STEP: Getting a ResourceQuota STEP: Updating a ResourceQuota STEP: Verifying a ResourceQuota was modified STEP: Deleting a ResourceQuota STEP: Verifying the deleted ResourceQuota [AfterEach] [sig-api-machinery] ResourceQuota /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:26:18.180: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "resourcequota-5680" for this suite. • ------------------------------ {"msg":"PASSED [sig-api-machinery] ResourceQuota should be able to update and delete ResourceQuota. [Conformance]","total":-1,"completed":6,"skipped":101,"failed":0} SSSS ------------------------------ [BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:26:07.119: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename webhook STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:87 STEP: Setting up server cert STEP: Create role binding to let webhook read extension-apiserver-authentication STEP: Deploying the webhook pod STEP: Wait for the deployment to be ready Aug 18 11:26:07.352: INFO: deployment "sample-webhook-deployment" doesn't have the required revision set Aug 18 11:26:09.360: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882767, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882767, loc:(*time.Location)(0x77169a0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882767, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882767, loc:(*time.Location)(0x77169a0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-cbccbf6bb\" is progressing."}}, CollisionCount:(*int32)(nil)} Aug 18 11:26:11.363: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882767, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882767, loc:(*time.Location)(0x77169a0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882767, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882767, loc:(*time.Location)(0x77169a0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-cbccbf6bb\" is progressing."}}, CollisionCount:(*int32)(nil)} STEP: Deploying the webhook service STEP: Verifying the service has paired with the endpoint Aug 18 11:26:14.369: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1 [It] should be able to deny custom resource creation, update and deletion [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:26:14.372: INFO: >>> kubeConfig: /root/.kube/config STEP: Registering the custom resource webhook via the AdmissionRegistration API STEP: Creating a custom resource that should be denied by the webhook STEP: Creating a custom resource whose deletion would be denied by the webhook STEP: Updating the custom resource with disallowed data should be denied STEP: Deleting the custom resource should be denied STEP: Remove the offending key and value from the custom resource data STEP: Deleting the updated custom resource should be successful [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:26:20.461: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "webhook-129" for this suite. STEP: Destroying namespace "webhook-129-markers" for this suite. [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:102 • [SLOW TEST:13.388 seconds] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23 should be able to deny custom resource creation, update and deletion [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should be able to deny custom resource creation, update and deletion [Conformance]","total":-1,"completed":7,"skipped":85,"failed":0} SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:25:53.443: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename services STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:782 [It] should be able to switch session affinity for service with type clusterIP [LinuxOnly] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: creating service in namespace services-6150 STEP: creating service affinity-clusterip-transition in namespace services-6150 STEP: creating replication controller affinity-clusterip-transition in namespace services-6150 I0818 11:25:53.470489 26 runners.go:190] Created replication controller with name: affinity-clusterip-transition, namespace: services-6150, replica count: 3 I0818 11:25:56.522664 26 runners.go:190] affinity-clusterip-transition Pods: 3 out of 3 created, 0 running, 3 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0818 11:25:59.523042 26 runners.go:190] affinity-clusterip-transition Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0818 11:26:02.523399 26 runners.go:190] affinity-clusterip-transition Pods: 3 out of 3 created, 3 running, 0 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady Aug 18 11:26:02.528: INFO: Creating new exec pod Aug 18 11:26:07.547: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-6150 exec execpod-affinity9b4vb -- /bin/sh -x -c nc -zv -t -w 2 affinity-clusterip-transition 80' Aug 18 11:26:07.906: INFO: stderr: "+ nc -zv -t -w 2 affinity-clusterip-transition 80\nConnection to affinity-clusterip-transition 80 port [tcp/http] succeeded!\n" Aug 18 11:26:07.906: INFO: stdout: "" Aug 18 11:26:07.907: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-6150 exec execpod-affinity9b4vb -- /bin/sh -x -c nc -zv -t -w 2 10.233.13.195 80' Aug 18 11:26:08.173: INFO: stderr: "+ nc -zv -t -w 2 10.233.13.195 80\nConnection to 10.233.13.195 80 port [tcp/http] succeeded!\n" Aug 18 11:26:08.173: INFO: stdout: "" Aug 18 11:26:08.180: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-6150 exec execpod-affinity9b4vb -- /bin/sh -x -c for i in $(seq 0 15); do echo; curl -q -s --connect-timeout 2 http://10.233.13.195:80/ ; done' Aug 18 11:26:08.733: INFO: stderr: "+ seq 0 15\n+ echo\n+ curl -q -s --connect-timeout 2 http://10.233.13.195:80/\n+ echo\n+ curl -q -s --connect-timeout 2 http://10.233.13.195:80/\n+ echo\n+ curl -q -s --connect-timeout 2 http://10.233.13.195:80/\n+ echo\n+ curl -q -s --connect-timeout 2 http://10.233.13.195:80/\n+ echo\n+ curl -q -s --connect-timeout 2 http://10.233.13.195:80/\n+ echo\n+ curl -q -s --connect-timeout 2 http://10.233.13.195:80/\n+ echo\n+ curl -q -s --connect-timeout 2 http://10.233.13.195:80/\n+ echo\n+ curl -q -s --connect-timeout 2 http://10.233.13.195:80/\n+ echo\n+ curl -q -s --connect-timeout 2 http://10.233.13.195:80/\n+ echo\n+ curl -q -s --connect-timeout 2 http://10.233.13.195:80/\n+ echo\n+ curl -q -s --connect-timeout 2 http://10.233.13.195:80/\n+ echo\n+ curl -q -s --connect-timeout 2 http://10.233.13.195:80/\n+ echo\n+ curl -q -s --connect-timeout 2 http://10.233.13.195:80/\n+ echo\n+ curl -q -s --connect-timeout 2 http://10.233.13.195:80/\n+ echo\n+ curl -q -s --connect-timeout 2 http://10.233.13.195:80/\n+ echo\n+ curl -q -s --connect-timeout 2 http://10.233.13.195:80/\n" Aug 18 11:26:08.734: INFO: stdout: "\naffinity-clusterip-transition-8x987\naffinity-clusterip-transition-8x987\naffinity-clusterip-transition-8x987\naffinity-clusterip-transition-fsplz\naffinity-clusterip-transition-xw6vf\naffinity-clusterip-transition-fsplz\naffinity-clusterip-transition-8x987\naffinity-clusterip-transition-xw6vf\naffinity-clusterip-transition-xw6vf\naffinity-clusterip-transition-xw6vf\naffinity-clusterip-transition-fsplz\naffinity-clusterip-transition-xw6vf\naffinity-clusterip-transition-fsplz\naffinity-clusterip-transition-xw6vf\naffinity-clusterip-transition-fsplz\naffinity-clusterip-transition-xw6vf" Aug 18 11:26:08.734: INFO: Received response from host: affinity-clusterip-transition-8x987 Aug 18 11:26:08.734: INFO: Received response from host: affinity-clusterip-transition-8x987 Aug 18 11:26:08.734: INFO: Received response from host: affinity-clusterip-transition-8x987 Aug 18 11:26:08.734: INFO: Received response from host: affinity-clusterip-transition-fsplz Aug 18 11:26:08.734: INFO: Received response from host: affinity-clusterip-transition-xw6vf Aug 18 11:26:08.734: INFO: Received response from host: affinity-clusterip-transition-fsplz Aug 18 11:26:08.734: INFO: Received response from host: affinity-clusterip-transition-8x987 Aug 18 11:26:08.734: INFO: Received response from host: affinity-clusterip-transition-xw6vf Aug 18 11:26:08.734: INFO: Received response from host: affinity-clusterip-transition-xw6vf Aug 18 11:26:08.734: INFO: Received response from host: affinity-clusterip-transition-xw6vf Aug 18 11:26:08.734: INFO: Received response from host: affinity-clusterip-transition-fsplz Aug 18 11:26:08.734: INFO: Received response from host: affinity-clusterip-transition-xw6vf Aug 18 11:26:08.734: INFO: Received response from host: affinity-clusterip-transition-fsplz Aug 18 11:26:08.734: INFO: Received response from host: affinity-clusterip-transition-xw6vf Aug 18 11:26:08.734: INFO: Received response from host: affinity-clusterip-transition-fsplz Aug 18 11:26:08.734: INFO: Received response from host: affinity-clusterip-transition-xw6vf Aug 18 11:26:08.741: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-6150 exec execpod-affinity9b4vb -- /bin/sh -x -c for i in $(seq 0 15); do echo; curl -q -s --connect-timeout 2 http://10.233.13.195:80/ ; done' Aug 18 11:26:09.069: INFO: stderr: "+ seq 0 15\n+ echo\n+ curl -q -s --connect-timeout 2 http://10.233.13.195:80/\n+ echo\n+ curl -q -s --connect-timeout 2 http://10.233.13.195:80/\n+ echo\n+ curl -q -s --connect-timeout 2 http://10.233.13.195:80/\n+ echo\n+ curl -q -s --connect-timeout 2 http://10.233.13.195:80/\n+ echo\n+ curl -q -s --connect-timeout 2 http://10.233.13.195:80/\n+ echo\n+ curl -q -s --connect-timeout 2 http://10.233.13.195:80/\n+ echo\n+ curl -q -s --connect-timeout 2 http://10.233.13.195:80/\n+ echo\n+ curl -q -s --connect-timeout 2 http://10.233.13.195:80/\n+ echo\n+ curl -q -s --connect-timeout 2 http://10.233.13.195:80/\n+ echo\n+ curl -q -s --connect-timeout 2 http://10.233.13.195:80/\n+ echo\n+ curl -q -s --connect-timeout 2 http://10.233.13.195:80/\n+ echo\n+ curl -q -s --connect-timeout 2 http://10.233.13.195:80/\n+ echo\n+ curl -q -s --connect-timeout 2 http://10.233.13.195:80/\n+ echo\n+ curl -q -s --connect-timeout 2 http://10.233.13.195:80/\n+ echo\n+ curl -q -s --connect-timeout 2 http://10.233.13.195:80/\n+ echo\n+ curl -q -s --connect-timeout 2 http://10.233.13.195:80/\n" Aug 18 11:26:09.069: INFO: stdout: "\naffinity-clusterip-transition-xw6vf\naffinity-clusterip-transition-xw6vf\naffinity-clusterip-transition-xw6vf\naffinity-clusterip-transition-xw6vf\naffinity-clusterip-transition-xw6vf\naffinity-clusterip-transition-xw6vf\naffinity-clusterip-transition-xw6vf\naffinity-clusterip-transition-xw6vf\naffinity-clusterip-transition-xw6vf\naffinity-clusterip-transition-xw6vf\naffinity-clusterip-transition-xw6vf\naffinity-clusterip-transition-xw6vf\naffinity-clusterip-transition-xw6vf\naffinity-clusterip-transition-xw6vf\naffinity-clusterip-transition-xw6vf\naffinity-clusterip-transition-xw6vf" Aug 18 11:26:09.069: INFO: Received response from host: affinity-clusterip-transition-xw6vf Aug 18 11:26:09.069: INFO: Received response from host: affinity-clusterip-transition-xw6vf Aug 18 11:26:09.069: INFO: Received response from host: affinity-clusterip-transition-xw6vf Aug 18 11:26:09.069: INFO: Received response from host: affinity-clusterip-transition-xw6vf Aug 18 11:26:09.069: INFO: Received response from host: affinity-clusterip-transition-xw6vf Aug 18 11:26:09.069: INFO: Received response from host: affinity-clusterip-transition-xw6vf Aug 18 11:26:09.069: INFO: Received response from host: affinity-clusterip-transition-xw6vf Aug 18 11:26:09.069: INFO: Received response from host: affinity-clusterip-transition-xw6vf Aug 18 11:26:09.069: INFO: Received response from host: affinity-clusterip-transition-xw6vf Aug 18 11:26:09.069: INFO: Received response from host: affinity-clusterip-transition-xw6vf Aug 18 11:26:09.069: INFO: Received response from host: affinity-clusterip-transition-xw6vf Aug 18 11:26:09.069: INFO: Received response from host: affinity-clusterip-transition-xw6vf Aug 18 11:26:09.069: INFO: Received response from host: affinity-clusterip-transition-xw6vf Aug 18 11:26:09.069: INFO: Received response from host: affinity-clusterip-transition-xw6vf Aug 18 11:26:09.069: INFO: Received response from host: affinity-clusterip-transition-xw6vf Aug 18 11:26:09.069: INFO: Received response from host: affinity-clusterip-transition-xw6vf Aug 18 11:26:09.069: INFO: Cleaning up the exec pod STEP: deleting ReplicationController affinity-clusterip-transition in namespace services-6150, will wait for the garbage collector to delete the pods Aug 18 11:26:09.133: INFO: Deleting ReplicationController affinity-clusterip-transition took: 5.477688ms Aug 18 11:26:09.234: INFO: Terminating ReplicationController affinity-clusterip-transition pods took: 100.341397ms [AfterEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:26:21.245: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "services-6150" for this suite. [AfterEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:786 • [SLOW TEST:27.809 seconds] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/framework.go:23 should be able to switch session affinity for service with type clusterIP [LinuxOnly] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-network] Services should be able to switch session affinity for service with type clusterIP [LinuxOnly] [Conformance]","total":-1,"completed":6,"skipped":57,"failed":0} SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:26:10.458: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename crd-publish-openapi STEP: Waiting for a default service account to be provisioned in namespace [It] works for CRD preserving unknown fields at the schema root [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:26:10.480: INFO: >>> kubeConfig: /root/.kube/config STEP: client-side validation (kubectl create and apply) allows request with any unknown properties Aug 18 11:26:18.325: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=crd-publish-openapi-3736 --namespace=crd-publish-openapi-3736 create -f -' Aug 18 11:26:18.805: INFO: stderr: "" Aug 18 11:26:18.805: INFO: stdout: "e2e-test-crd-publish-openapi-2892-crd.crd-publish-openapi-test-unknown-at-root.example.com/test-cr created\n" Aug 18 11:26:18.805: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=crd-publish-openapi-3736 --namespace=crd-publish-openapi-3736 delete e2e-test-crd-publish-openapi-2892-crds test-cr' Aug 18 11:26:18.972: INFO: stderr: "" Aug 18 11:26:18.972: INFO: stdout: "e2e-test-crd-publish-openapi-2892-crd.crd-publish-openapi-test-unknown-at-root.example.com \"test-cr\" deleted\n" Aug 18 11:26:18.972: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=crd-publish-openapi-3736 --namespace=crd-publish-openapi-3736 apply -f -' Aug 18 11:26:19.269: INFO: stderr: "" Aug 18 11:26:19.269: INFO: stdout: "e2e-test-crd-publish-openapi-2892-crd.crd-publish-openapi-test-unknown-at-root.example.com/test-cr created\n" Aug 18 11:26:19.269: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=crd-publish-openapi-3736 --namespace=crd-publish-openapi-3736 delete e2e-test-crd-publish-openapi-2892-crds test-cr' Aug 18 11:26:19.416: INFO: stderr: "" Aug 18 11:26:19.416: INFO: stdout: "e2e-test-crd-publish-openapi-2892-crd.crd-publish-openapi-test-unknown-at-root.example.com \"test-cr\" deleted\n" STEP: kubectl explain works to explain CR Aug 18 11:26:19.417: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=crd-publish-openapi-3736 explain e2e-test-crd-publish-openapi-2892-crds' Aug 18 11:26:19.714: INFO: stderr: "" Aug 18 11:26:19.714: INFO: stdout: "KIND: E2e-test-crd-publish-openapi-2892-crd\nVERSION: crd-publish-openapi-test-unknown-at-root.example.com/v1\n\nDESCRIPTION:\n \n" [AfterEach] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:26:22.598: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "crd-publish-openapi-3736" for this suite. • [SLOW TEST:12.147 seconds] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23 works for CRD preserving unknown fields at the schema root [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] works for CRD preserving unknown fields at the schema root [Conformance]","total":-1,"completed":7,"skipped":171,"failed":0} SSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-storage] ConfigMap /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:26:12.486: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename configmap STEP: Waiting for a default service account to be provisioned in namespace [It] updates should be reflected in volume [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating configMap with name configmap-test-upd-3fd6b1d2-693b-43fe-9882-c6212ff2679b STEP: Creating the pod STEP: Updating configmap configmap-test-upd-3fd6b1d2-693b-43fe-9882-c6212ff2679b STEP: waiting to observe update in volume [AfterEach] [sig-storage] ConfigMap /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:26:24.556: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "configmap-5699" for this suite. • [SLOW TEST:12.080 seconds] [sig-storage] ConfigMap /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/configmap_volume.go:36 updates should be reflected in volume [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-storage] ConfigMap updates should be reflected in volume [NodeConformance] [Conformance]","total":-1,"completed":5,"skipped":28,"failed":0} SSSSSSSSSSSS ------------------------------ [BeforeEach] [k8s.io] Kubelet /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:26:18.202: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename kubelet-test STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [k8s.io] Kubelet /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/kubelet.go:38 [It] should not write to root filesystem [LinuxOnly] [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 [AfterEach] [k8s.io] Kubelet /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:26:24.803: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "kubelet-test-7091" for this suite. • [SLOW TEST:6.609 seconds] [k8s.io] Kubelet /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 when scheduling a read only busybox container /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/kubelet.go:188 should not write to root filesystem [LinuxOnly] [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [k8s.io] Kubelet when scheduling a read only busybox container should not write to root filesystem [LinuxOnly] [NodeConformance] [Conformance]","total":-1,"completed":7,"skipped":105,"failed":0} SSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [k8s.io] Docker Containers /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:26:20.677: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename containers STEP: Waiting for a default service account to be provisioned in namespace [It] should use the image defaults if command and args are blank [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 [AfterEach] [k8s.io] Docker Containers /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:26:28.730: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "containers-7294" for this suite. • [SLOW TEST:8.061 seconds] [k8s.io] Docker Containers /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 should use the image defaults if command and args are blank [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [k8s.io] Docker Containers should use the image defaults if command and args are blank [NodeConformance] [Conformance]","total":-1,"completed":8,"skipped":153,"failed":0} SSSSSSSSSSSSS ------------------------------ [BeforeEach] [k8s.io] Security Context /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:26:21.319: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename security-context-test STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [k8s.io] Security Context /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/security_context.go:41 [It] should run the container with uid 65534 [LinuxOnly] [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:26:21.351: INFO: Waiting up to 5m0s for pod "busybox-user-65534-8ebbde51-71a2-48ca-86a7-4b2b3c7c2bc3" in namespace "security-context-test-4214" to be "Succeeded or Failed" Aug 18 11:26:21.353: INFO: Pod "busybox-user-65534-8ebbde51-71a2-48ca-86a7-4b2b3c7c2bc3": Phase="Pending", Reason="", readiness=false. Elapsed: 2.085447ms Aug 18 11:26:23.357: INFO: Pod "busybox-user-65534-8ebbde51-71a2-48ca-86a7-4b2b3c7c2bc3": Phase="Pending", Reason="", readiness=false. Elapsed: 2.005762752s Aug 18 11:26:25.361: INFO: Pod "busybox-user-65534-8ebbde51-71a2-48ca-86a7-4b2b3c7c2bc3": Phase="Pending", Reason="", readiness=false. Elapsed: 4.009992012s Aug 18 11:26:27.367: INFO: Pod "busybox-user-65534-8ebbde51-71a2-48ca-86a7-4b2b3c7c2bc3": Phase="Pending", Reason="", readiness=false. Elapsed: 6.015666858s Aug 18 11:26:29.369: INFO: Pod "busybox-user-65534-8ebbde51-71a2-48ca-86a7-4b2b3c7c2bc3": Phase="Succeeded", Reason="", readiness=false. Elapsed: 8.018407399s Aug 18 11:26:29.369: INFO: Pod "busybox-user-65534-8ebbde51-71a2-48ca-86a7-4b2b3c7c2bc3" satisfied condition "Succeeded or Failed" [AfterEach] [k8s.io] Security Context /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:26:29.369: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "security-context-test-4214" for this suite. • [SLOW TEST:8.057 seconds] [k8s.io] Security Context /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 When creating a container with runAsUser /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/security_context.go:45 should run the container with uid 65534 [LinuxOnly] [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [k8s.io] Security Context When creating a container with runAsUser should run the container with uid 65534 [LinuxOnly] [NodeConformance] [Conformance]","total":-1,"completed":7,"skipped":88,"failed":0} SSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-storage] Projected configMap /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:26:22.638: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename projected STEP: Waiting for a default service account to be provisioned in namespace [It] updates should be reflected in volume [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating projection with configMap that has name projected-configmap-test-upd-51e6651c-a4e4-4b3c-879b-b3b24a0f24a6 STEP: Creating the pod STEP: Updating configmap projected-configmap-test-upd-51e6651c-a4e4-4b3c-879b-b3b24a0f24a6 STEP: waiting to observe update in volume [AfterEach] [sig-storage] Projected configMap /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:26:32.715: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "projected-1851" for this suite. • [SLOW TEST:10.086 seconds] [sig-storage] Projected configMap /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/projected_configmap.go:36 updates should be reflected in volume [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ [BeforeEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:25:31.573: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename services STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:782 [It] should have session affinity timeout work for service with type clusterIP [LinuxOnly] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: creating service in namespace services-746 Aug 18 11:25:37.622: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-746 exec kube-proxy-mode-detector -- /bin/sh -x -c curl -q -s --connect-timeout 1 http://localhost:10249/proxyMode' Aug 18 11:25:37.886: INFO: stderr: "+ curl -q -s --connect-timeout 1 http://localhost:10249/proxyMode\n" Aug 18 11:25:37.886: INFO: stdout: "iptables" Aug 18 11:25:37.886: INFO: proxyMode: iptables Aug 18 11:25:37.890: INFO: Waiting for pod kube-proxy-mode-detector to disappear Aug 18 11:25:37.892: INFO: Pod kube-proxy-mode-detector still exists Aug 18 11:25:39.892: INFO: Waiting for pod kube-proxy-mode-detector to disappear Aug 18 11:25:39.895: INFO: Pod kube-proxy-mode-detector still exists Aug 18 11:25:41.893: INFO: Waiting for pod kube-proxy-mode-detector to disappear Aug 18 11:25:41.895: INFO: Pod kube-proxy-mode-detector still exists Aug 18 11:25:43.892: INFO: Waiting for pod kube-proxy-mode-detector to disappear Aug 18 11:25:43.896: INFO: Pod kube-proxy-mode-detector still exists Aug 18 11:25:45.893: INFO: Waiting for pod kube-proxy-mode-detector to disappear Aug 18 11:25:45.896: INFO: Pod kube-proxy-mode-detector still exists Aug 18 11:25:47.893: INFO: Waiting for pod kube-proxy-mode-detector to disappear Aug 18 11:25:47.896: INFO: Pod kube-proxy-mode-detector still exists Aug 18 11:25:49.893: INFO: Waiting for pod kube-proxy-mode-detector to disappear Aug 18 11:25:49.896: INFO: Pod kube-proxy-mode-detector still exists Aug 18 11:25:51.893: INFO: Waiting for pod kube-proxy-mode-detector to disappear Aug 18 11:25:51.896: INFO: Pod kube-proxy-mode-detector no longer exists STEP: creating service affinity-clusterip-timeout in namespace services-746 STEP: creating replication controller affinity-clusterip-timeout in namespace services-746 I0818 11:25:51.906574 36 runners.go:190] Created replication controller with name: affinity-clusterip-timeout, namespace: services-746, replica count: 3 I0818 11:25:54.957345 36 runners.go:190] affinity-clusterip-timeout Pods: 3 out of 3 created, 0 running, 3 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0818 11:25:57.958361 36 runners.go:190] affinity-clusterip-timeout Pods: 3 out of 3 created, 1 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0818 11:26:00.958780 36 runners.go:190] affinity-clusterip-timeout Pods: 3 out of 3 created, 3 running, 0 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady Aug 18 11:26:00.963: INFO: Creating new exec pod Aug 18 11:26:11.983: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-746 exec execpod-affinitys9qfc -- /bin/sh -x -c nc -zv -t -w 2 affinity-clusterip-timeout 80' Aug 18 11:26:12.601: INFO: stderr: "+ nc -zv -t -w 2 affinity-clusterip-timeout 80\nConnection to affinity-clusterip-timeout 80 port [tcp/http] succeeded!\n" Aug 18 11:26:12.601: INFO: stdout: "" Aug 18 11:26:12.602: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-746 exec execpod-affinitys9qfc -- /bin/sh -x -c nc -zv -t -w 2 10.233.19.229 80' Aug 18 11:26:13.090: INFO: stderr: "+ nc -zv -t -w 2 10.233.19.229 80\nConnection to 10.233.19.229 80 port [tcp/http] succeeded!\n" Aug 18 11:26:13.090: INFO: stdout: "" Aug 18 11:26:13.090: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-746 exec execpod-affinitys9qfc -- /bin/sh -x -c for i in $(seq 0 15); do echo; curl -q -s --connect-timeout 2 http://10.233.19.229:80/ ; done' Aug 18 11:26:14.106: INFO: stderr: "+ seq 0 15\n+ echo\n+ curl -q -s --connect-timeout 2 http://10.233.19.229:80/\n+ echo\n+ curl -q -s --connect-timeout 2 http://10.233.19.229:80/\n+ echo\n+ curl -q -s --connect-timeout 2 http://10.233.19.229:80/\n+ echo\n+ curl -q -s --connect-timeout 2 http://10.233.19.229:80/\n+ echo\n+ curl -q -s --connect-timeout 2 http://10.233.19.229:80/\n+ echo\n+ curl -q -s --connect-timeout 2 http://10.233.19.229:80/\n+ echo\n+ curl -q -s --connect-timeout 2 http://10.233.19.229:80/\n+ echo\n+ curl -q -s --connect-timeout 2 http://10.233.19.229:80/\n+ echo\n+ curl -q -s --connect-timeout 2 http://10.233.19.229:80/\n+ echo\n+ curl -q -s --connect-timeout 2 http://10.233.19.229:80/\n+ echo\n+ curl -q -s --connect-timeout 2 http://10.233.19.229:80/\n+ echo\n+ curl -q -s --connect-timeout 2 http://10.233.19.229:80/\n+ echo\n+ curl -q -s --connect-timeout 2 http://10.233.19.229:80/\n+ echo\n+ curl -q -s --connect-timeout 2 http://10.233.19.229:80/\n+ echo\n+ curl -q -s --connect-timeout 2 http://10.233.19.229:80/\n+ echo\n+ curl -q -s --connect-timeout 2 http://10.233.19.229:80/\n" Aug 18 11:26:14.106: INFO: stdout: "\naffinity-clusterip-timeout-b987l\naffinity-clusterip-timeout-b987l\naffinity-clusterip-timeout-b987l\naffinity-clusterip-timeout-b987l\naffinity-clusterip-timeout-b987l\naffinity-clusterip-timeout-b987l\naffinity-clusterip-timeout-b987l\naffinity-clusterip-timeout-b987l\naffinity-clusterip-timeout-b987l\naffinity-clusterip-timeout-b987l\naffinity-clusterip-timeout-b987l\naffinity-clusterip-timeout-b987l\naffinity-clusterip-timeout-b987l\naffinity-clusterip-timeout-b987l\naffinity-clusterip-timeout-b987l\naffinity-clusterip-timeout-b987l" Aug 18 11:26:14.106: INFO: Received response from host: affinity-clusterip-timeout-b987l Aug 18 11:26:14.106: INFO: Received response from host: affinity-clusterip-timeout-b987l Aug 18 11:26:14.106: INFO: Received response from host: affinity-clusterip-timeout-b987l Aug 18 11:26:14.106: INFO: Received response from host: affinity-clusterip-timeout-b987l Aug 18 11:26:14.106: INFO: Received response from host: affinity-clusterip-timeout-b987l Aug 18 11:26:14.106: INFO: Received response from host: affinity-clusterip-timeout-b987l Aug 18 11:26:14.106: INFO: Received response from host: affinity-clusterip-timeout-b987l Aug 18 11:26:14.106: INFO: Received response from host: affinity-clusterip-timeout-b987l Aug 18 11:26:14.106: INFO: Received response from host: affinity-clusterip-timeout-b987l Aug 18 11:26:14.106: INFO: Received response from host: affinity-clusterip-timeout-b987l Aug 18 11:26:14.106: INFO: Received response from host: affinity-clusterip-timeout-b987l Aug 18 11:26:14.106: INFO: Received response from host: affinity-clusterip-timeout-b987l Aug 18 11:26:14.106: INFO: Received response from host: affinity-clusterip-timeout-b987l Aug 18 11:26:14.106: INFO: Received response from host: affinity-clusterip-timeout-b987l Aug 18 11:26:14.106: INFO: Received response from host: affinity-clusterip-timeout-b987l Aug 18 11:26:14.106: INFO: Received response from host: affinity-clusterip-timeout-b987l Aug 18 11:26:14.106: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-746 exec execpod-affinitys9qfc -- /bin/sh -x -c curl -q -s --connect-timeout 2 http://10.233.19.229:80/' Aug 18 11:26:15.168: INFO: stderr: "+ curl -q -s --connect-timeout 2 http://10.233.19.229:80/\n" Aug 18 11:26:15.168: INFO: stdout: "affinity-clusterip-timeout-b987l" Aug 18 11:26:30.168: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-746 exec execpod-affinitys9qfc -- /bin/sh -x -c curl -q -s --connect-timeout 2 http://10.233.19.229:80/' Aug 18 11:26:30.449: INFO: stderr: "+ curl -q -s --connect-timeout 2 http://10.233.19.229:80/\n" Aug 18 11:26:30.449: INFO: stdout: "affinity-clusterip-timeout-57zr6" Aug 18 11:26:30.449: INFO: Cleaning up the exec pod STEP: deleting ReplicationController affinity-clusterip-timeout in namespace services-746, will wait for the garbage collector to delete the pods Aug 18 11:26:30.513: INFO: Deleting ReplicationController affinity-clusterip-timeout took: 4.358968ms Aug 18 11:26:31.213: INFO: Terminating ReplicationController affinity-clusterip-timeout pods took: 700.323893ms [AfterEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:26:35.324: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "services-746" for this suite. [AfterEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:786 • [SLOW TEST:63.758 seconds] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/framework.go:23 should have session affinity timeout work for service with type clusterIP [LinuxOnly] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-network] Services should have session affinity timeout work for service with type clusterIP [LinuxOnly] [Conformance]","total":-1,"completed":3,"skipped":107,"failed":0} SSSSSS ------------------------------ [BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:26:28.768: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename webhook STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:87 STEP: Setting up server cert STEP: Create role binding to let webhook read extension-apiserver-authentication STEP: Deploying the webhook pod STEP: Wait for the deployment to be ready Aug 18 11:26:29.322: INFO: deployment "sample-webhook-deployment" doesn't have the required revision set Aug 18 11:26:31.332: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882789, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882789, loc:(*time.Location)(0x77169a0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882789, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882789, loc:(*time.Location)(0x77169a0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-cbccbf6bb\" is progressing."}}, CollisionCount:(*int32)(nil)} Aug 18 11:26:33.336: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882789, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882789, loc:(*time.Location)(0x77169a0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882789, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882789, loc:(*time.Location)(0x77169a0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-cbccbf6bb\" is progressing."}}, CollisionCount:(*int32)(nil)} STEP: Deploying the webhook service STEP: Verifying the service has paired with the endpoint Aug 18 11:26:36.341: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1 [It] should deny crd creation [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Registering the crd webhook via the AdmissionRegistration API STEP: Creating a custom resource definition that should be denied by the webhook Aug 18 11:26:36.355: INFO: >>> kubeConfig: /root/.kube/config [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:26:36.368: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "webhook-130" for this suite. STEP: Destroying namespace "webhook-130-markers" for this suite. [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:102 • [SLOW TEST:7.634 seconds] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23 should deny crd creation [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should deny crd creation [Conformance]","total":-1,"completed":9,"skipped":166,"failed":0} SSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-storage] Secrets /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:26:35.348: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename secrets STEP: Waiting for a default service account to be provisioned in namespace [It] should be consumable in multiple volumes in a pod [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating secret with name secret-test-d07243d6-b456-42a4-a09f-6b00269dc6a0 STEP: Creating a pod to test consume secrets Aug 18 11:26:35.382: INFO: Waiting up to 5m0s for pod "pod-secrets-958e7e2b-617d-4188-8b72-3ef90cb472bf" in namespace "secrets-9843" to be "Succeeded or Failed" Aug 18 11:26:35.387: INFO: Pod "pod-secrets-958e7e2b-617d-4188-8b72-3ef90cb472bf": Phase="Pending", Reason="", readiness=false. Elapsed: 5.60473ms Aug 18 11:26:37.390: INFO: Pod "pod-secrets-958e7e2b-617d-4188-8b72-3ef90cb472bf": Phase="Pending", Reason="", readiness=false. Elapsed: 2.00811714s Aug 18 11:26:39.394: INFO: Pod "pod-secrets-958e7e2b-617d-4188-8b72-3ef90cb472bf": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.012020219s STEP: Saw pod success Aug 18 11:26:39.394: INFO: Pod "pod-secrets-958e7e2b-617d-4188-8b72-3ef90cb472bf" satisfied condition "Succeeded or Failed" Aug 18 11:26:39.396: INFO: Trying to get logs from node node2 pod pod-secrets-958e7e2b-617d-4188-8b72-3ef90cb472bf container secret-volume-test: STEP: delete the pod Aug 18 11:26:39.408: INFO: Waiting for pod pod-secrets-958e7e2b-617d-4188-8b72-3ef90cb472bf to disappear Aug 18 11:26:39.410: INFO: Pod pod-secrets-958e7e2b-617d-4188-8b72-3ef90cb472bf no longer exists [AfterEach] [sig-storage] Secrets /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:26:39.410: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "secrets-9843" for this suite. • ------------------------------ {"msg":"PASSED [sig-storage] Secrets should be consumable in multiple volumes in a pod [NodeConformance] [Conformance]","total":-1,"completed":4,"skipped":113,"failed":0} SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-apps] Job /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:26:29.420: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename job STEP: Waiting for a default service account to be provisioned in namespace [It] should adopt matching orphans and release non-matching pods [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating a job STEP: Ensuring active pods == parallelism STEP: Orphaning one of the Job's Pods Aug 18 11:26:35.958: INFO: Successfully updated pod "adopt-release-k9l47" STEP: Checking that the Job readopts the Pod Aug 18 11:26:35.958: INFO: Waiting up to 15m0s for pod "adopt-release-k9l47" in namespace "job-9644" to be "adopted" Aug 18 11:26:35.960: INFO: Pod "adopt-release-k9l47": Phase="Running", Reason="", readiness=true. Elapsed: 1.996983ms Aug 18 11:26:37.963: INFO: Pod "adopt-release-k9l47": Phase="Running", Reason="", readiness=true. Elapsed: 2.004805506s Aug 18 11:26:37.963: INFO: Pod "adopt-release-k9l47" satisfied condition "adopted" STEP: Removing the labels from the Job's Pod Aug 18 11:26:38.473: INFO: Successfully updated pod "adopt-release-k9l47" STEP: Checking that the Job releases the Pod Aug 18 11:26:38.473: INFO: Waiting up to 15m0s for pod "adopt-release-k9l47" in namespace "job-9644" to be "released" Aug 18 11:26:38.475: INFO: Pod "adopt-release-k9l47": Phase="Running", Reason="", readiness=true. Elapsed: 1.872538ms Aug 18 11:26:40.480: INFO: Pod "adopt-release-k9l47": Phase="Running", Reason="", readiness=true. Elapsed: 2.006833811s Aug 18 11:26:40.480: INFO: Pod "adopt-release-k9l47" satisfied condition "released" [AfterEach] [sig-apps] Job /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:26:40.480: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "job-9644" for this suite. • [SLOW TEST:11.067 seconds] [sig-apps] Job /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/framework.go:23 should adopt matching orphans and release non-matching pods [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-apps] Job should adopt matching orphans and release non-matching pods [Conformance]","total":-1,"completed":8,"skipped":109,"failed":0} SS ------------------------------ [BeforeEach] [sig-api-machinery] ResourceQuota /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:26:24.594: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename resourcequota STEP: Waiting for a default service account to be provisioned in namespace [It] should verify ResourceQuota with best effort scope. [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating a ResourceQuota with best effort scope STEP: Ensuring ResourceQuota status is calculated STEP: Creating a ResourceQuota with not best effort scope STEP: Ensuring ResourceQuota status is calculated STEP: Creating a best-effort pod STEP: Ensuring resource quota with best effort scope captures the pod usage STEP: Ensuring resource quota with not best effort ignored the pod usage STEP: Deleting the pod STEP: Ensuring resource quota status released the pod usage STEP: Creating a not best-effort pod STEP: Ensuring resource quota with not best effort scope captures the pod usage STEP: Ensuring resource quota with best effort scope ignored the pod usage STEP: Deleting the pod STEP: Ensuring resource quota status released the pod usage [AfterEach] [sig-api-machinery] ResourceQuota /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:26:40.689: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "resourcequota-2127" for this suite. • [SLOW TEST:16.102 seconds] [sig-api-machinery] ResourceQuota /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23 should verify ResourceQuota with best effort scope. [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-api-machinery] ResourceQuota should verify ResourceQuota with best effort scope. [Conformance]","total":-1,"completed":6,"skipped":40,"failed":0} SSSSSSSSSS ------------------------------ [BeforeEach] [sig-api-machinery] ResourceQuota /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:26:24.860: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename resourcequota STEP: Waiting for a default service account to be provisioned in namespace [It] should verify ResourceQuota with terminating scopes. [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating a ResourceQuota with terminating scope STEP: Ensuring ResourceQuota status is calculated STEP: Creating a ResourceQuota with not terminating scope STEP: Ensuring ResourceQuota status is calculated STEP: Creating a long running pod STEP: Ensuring resource quota with not terminating scope captures the pod usage STEP: Ensuring resource quota with terminating scope ignored the pod usage STEP: Deleting the pod STEP: Ensuring resource quota status released the pod usage STEP: Creating a terminating pod STEP: Ensuring resource quota with terminating scope captures the pod usage STEP: Ensuring resource quota with not terminating scope ignored the pod usage STEP: Deleting the pod STEP: Ensuring resource quota status released the pod usage [AfterEach] [sig-api-machinery] ResourceQuota /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:26:40.952: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "resourcequota-4" for this suite. • [SLOW TEST:16.101 seconds] [sig-api-machinery] ResourceQuota /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23 should verify ResourceQuota with terminating scopes. [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-api-machinery] ResourceQuota should verify ResourceQuota with terminating scopes. [Conformance]","total":-1,"completed":8,"skipped":127,"failed":0} SSSSSS ------------------------------ [BeforeEach] [sig-storage] Downward API volume /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:26:36.451: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename downward-api STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-storage] Downward API volume /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/downwardapi_volume.go:42 [It] should provide container's memory limit [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating a pod to test downward API volume plugin Aug 18 11:26:36.485: INFO: Waiting up to 5m0s for pod "downwardapi-volume-0509d281-8494-45ac-ae18-34f533a7cb98" in namespace "downward-api-5060" to be "Succeeded or Failed" Aug 18 11:26:36.487: INFO: Pod "downwardapi-volume-0509d281-8494-45ac-ae18-34f533a7cb98": Phase="Pending", Reason="", readiness=false. Elapsed: 2.036055ms Aug 18 11:26:38.490: INFO: Pod "downwardapi-volume-0509d281-8494-45ac-ae18-34f533a7cb98": Phase="Pending", Reason="", readiness=false. Elapsed: 2.004683503s Aug 18 11:26:40.493: INFO: Pod "downwardapi-volume-0509d281-8494-45ac-ae18-34f533a7cb98": Phase="Pending", Reason="", readiness=false. Elapsed: 4.008235526s Aug 18 11:26:42.496: INFO: Pod "downwardapi-volume-0509d281-8494-45ac-ae18-34f533a7cb98": Phase="Succeeded", Reason="", readiness=false. Elapsed: 6.011015039s STEP: Saw pod success Aug 18 11:26:42.496: INFO: Pod "downwardapi-volume-0509d281-8494-45ac-ae18-34f533a7cb98" satisfied condition "Succeeded or Failed" Aug 18 11:26:42.498: INFO: Trying to get logs from node node1 pod downwardapi-volume-0509d281-8494-45ac-ae18-34f533a7cb98 container client-container: STEP: delete the pod Aug 18 11:26:42.512: INFO: Waiting for pod downwardapi-volume-0509d281-8494-45ac-ae18-34f533a7cb98 to disappear Aug 18 11:26:42.515: INFO: Pod downwardapi-volume-0509d281-8494-45ac-ae18-34f533a7cb98 no longer exists [AfterEach] [sig-storage] Downward API volume /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:26:42.515: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "downward-api-5060" for this suite. • [SLOW TEST:6.072 seconds] [sig-storage] Downward API volume /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/downwardapi_volume.go:37 should provide container's memory limit [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-storage] Downward API volume should provide container's memory limit [NodeConformance] [Conformance]","total":-1,"completed":10,"skipped":188,"failed":0} SSSSSSS ------------------------------ [BeforeEach] [sig-scheduling] LimitRange /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:26:39.487: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename limitrange STEP: Waiting for a default service account to be provisioned in namespace [It] should create a LimitRange with defaults and ensure pod has those defaults applied. [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating a LimitRange STEP: Setting up watch STEP: Submitting a LimitRange Aug 18 11:26:39.512: INFO: observed the limitRanges list STEP: Verifying LimitRange creation was observed STEP: Fetching the LimitRange to ensure it has proper values Aug 18 11:26:39.517: INFO: Verifying requests: expected map[cpu:{{100 -3} {} 100m DecimalSI} ephemeral-storage:{{214748364800 0} {} BinarySI} memory:{{209715200 0} {} BinarySI}] with actual map[cpu:{{100 -3} {} 100m DecimalSI} ephemeral-storage:{{214748364800 0} {} BinarySI} memory:{{209715200 0} {} BinarySI}] Aug 18 11:26:39.517: INFO: Verifying limits: expected map[cpu:{{500 -3} {} 500m DecimalSI} ephemeral-storage:{{536870912000 0} {} 500Gi BinarySI} memory:{{524288000 0} {} 500Mi BinarySI}] with actual map[cpu:{{500 -3} {} 500m DecimalSI} ephemeral-storage:{{536870912000 0} {} 500Gi BinarySI} memory:{{524288000 0} {} 500Mi BinarySI}] STEP: Creating a Pod with no resource requirements STEP: Ensuring Pod has resource requirements applied from LimitRange Aug 18 11:26:39.530: INFO: Verifying requests: expected map[cpu:{{100 -3} {} 100m DecimalSI} ephemeral-storage:{{214748364800 0} {} BinarySI} memory:{{209715200 0} {} BinarySI}] with actual map[cpu:{{100 -3} {} 100m DecimalSI} ephemeral-storage:{{214748364800 0} {} BinarySI} memory:{{209715200 0} {} BinarySI}] Aug 18 11:26:39.530: INFO: Verifying limits: expected map[cpu:{{500 -3} {} 500m DecimalSI} ephemeral-storage:{{536870912000 0} {} 500Gi BinarySI} memory:{{524288000 0} {} 500Mi BinarySI}] with actual map[cpu:{{500 -3} {} 500m DecimalSI} ephemeral-storage:{{536870912000 0} {} 500Gi BinarySI} memory:{{524288000 0} {} 500Mi BinarySI}] STEP: Creating a Pod with partial resource requirements STEP: Ensuring Pod has merged resource requirements applied from LimitRange Aug 18 11:26:39.541: INFO: Verifying requests: expected map[cpu:{{300 -3} {} 300m DecimalSI} ephemeral-storage:{{161061273600 0} {} 150Gi BinarySI} memory:{{157286400 0} {} 150Mi BinarySI}] with actual map[cpu:{{300 -3} {} 300m DecimalSI} ephemeral-storage:{{161061273600 0} {} 150Gi BinarySI} memory:{{157286400 0} {} 150Mi BinarySI}] Aug 18 11:26:39.542: INFO: Verifying limits: expected map[cpu:{{300 -3} {} 300m DecimalSI} ephemeral-storage:{{536870912000 0} {} 500Gi BinarySI} memory:{{524288000 0} {} 500Mi BinarySI}] with actual map[cpu:{{300 -3} {} 300m DecimalSI} ephemeral-storage:{{536870912000 0} {} 500Gi BinarySI} memory:{{524288000 0} {} 500Mi BinarySI}] STEP: Failing to create a Pod with less than min resources STEP: Failing to create a Pod with more than max resources STEP: Updating a LimitRange STEP: Verifying LimitRange updating is effective STEP: Creating a Pod with less than former min resources STEP: Failing to create a Pod with more than max resources STEP: Deleting a LimitRange STEP: Verifying the LimitRange was deleted Aug 18 11:26:46.585: INFO: limitRange is already deleted STEP: Creating a Pod with more than former max resources [AfterEach] [sig-scheduling] LimitRange /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:26:46.597: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "limitrange-5726" for this suite. • [SLOW TEST:7.118 seconds] [sig-scheduling] LimitRange /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/scheduling/framework.go:40 should create a LimitRange with defaults and ensure pod has those defaults applied. [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-scheduling] LimitRange should create a LimitRange with defaults and ensure pod has those defaults applied. [Conformance]","total":-1,"completed":5,"skipped":144,"failed":0} SSSSSSS ------------------------------ [BeforeEach] [k8s.io] Security Context /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:26:40.976: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename security-context-test STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [k8s.io] Security Context /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/security_context.go:41 [It] should run the container with writable rootfs when readOnlyRootFilesystem=false [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:26:41.006: INFO: Waiting up to 5m0s for pod "busybox-readonly-false-5a638936-e0f6-4275-bff0-b7edf9548f73" in namespace "security-context-test-4482" to be "Succeeded or Failed" Aug 18 11:26:41.008: INFO: Pod "busybox-readonly-false-5a638936-e0f6-4275-bff0-b7edf9548f73": Phase="Pending", Reason="", readiness=false. Elapsed: 2.146944ms Aug 18 11:26:43.012: INFO: Pod "busybox-readonly-false-5a638936-e0f6-4275-bff0-b7edf9548f73": Phase="Pending", Reason="", readiness=false. Elapsed: 2.005585092s Aug 18 11:26:45.015: INFO: Pod "busybox-readonly-false-5a638936-e0f6-4275-bff0-b7edf9548f73": Phase="Pending", Reason="", readiness=false. Elapsed: 4.008206446s Aug 18 11:26:47.018: INFO: Pod "busybox-readonly-false-5a638936-e0f6-4275-bff0-b7edf9548f73": Phase="Succeeded", Reason="", readiness=false. Elapsed: 6.011276983s Aug 18 11:26:47.018: INFO: Pod "busybox-readonly-false-5a638936-e0f6-4275-bff0-b7edf9548f73" satisfied condition "Succeeded or Failed" [AfterEach] [k8s.io] Security Context /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:26:47.018: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "security-context-test-4482" for this suite. • [SLOW TEST:6.050 seconds] [k8s.io] Security Context /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 When creating a pod with readOnlyRootFilesystem /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/security_context.go:166 should run the container with writable rootfs when readOnlyRootFilesystem=false [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [k8s.io] Security Context When creating a pod with readOnlyRootFilesystem should run the container with writable rootfs when readOnlyRootFilesystem=false [NodeConformance] [Conformance]","total":-1,"completed":9,"skipped":133,"failed":0} SSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ {"msg":"PASSED [sig-storage] Projected configMap updates should be reflected in volume [NodeConformance] [Conformance]","total":-1,"completed":8,"skipped":186,"failed":0} [BeforeEach] [sig-api-machinery] ResourceQuota /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:26:32.727: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename resourcequota STEP: Waiting for a default service account to be provisioned in namespace [It] should create a ResourceQuota and capture the life of a secret. [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Discovering how many secrets are in namespace by default STEP: Counting existing ResourceQuota STEP: Creating a ResourceQuota STEP: Ensuring resource quota status is calculated STEP: Creating a Secret STEP: Ensuring resource quota status captures secret creation STEP: Deleting a secret STEP: Ensuring resource quota status released usage [AfterEach] [sig-api-machinery] ResourceQuota /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:26:49.779: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "resourcequota-6492" for this suite. • [SLOW TEST:17.062 seconds] [sig-api-machinery] ResourceQuota /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23 should create a ResourceQuota and capture the life of a secret. [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-api-machinery] ResourceQuota should create a ResourceQuota and capture the life of a secret. [Conformance]","total":-1,"completed":9,"skipped":186,"failed":0} SSSSSS ------------------------------ [BeforeEach] [sig-storage] Projected combined /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:26:42.541: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename projected STEP: Waiting for a default service account to be provisioned in namespace [It] should project all components that make up the projection API [Projection][NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating configMap with name configmap-projected-all-test-volume-4646dffa-8061-40b0-891a-896bdbad6b0a STEP: Creating secret with name secret-projected-all-test-volume-6903cc47-f3e0-447d-aaec-ad1081a5fc11 STEP: Creating a pod to test Check all projections for projected volume plugin Aug 18 11:26:42.580: INFO: Waiting up to 5m0s for pod "projected-volume-3db90558-cc13-423b-93f7-f0bd3d36099b" in namespace "projected-1109" to be "Succeeded or Failed" Aug 18 11:26:42.585: INFO: Pod "projected-volume-3db90558-cc13-423b-93f7-f0bd3d36099b": Phase="Pending", Reason="", readiness=false. Elapsed: 5.146709ms Aug 18 11:26:44.588: INFO: Pod "projected-volume-3db90558-cc13-423b-93f7-f0bd3d36099b": Phase="Pending", Reason="", readiness=false. Elapsed: 2.007830171s Aug 18 11:26:46.594: INFO: Pod "projected-volume-3db90558-cc13-423b-93f7-f0bd3d36099b": Phase="Pending", Reason="", readiness=false. Elapsed: 4.013707456s Aug 18 11:26:48.598: INFO: Pod "projected-volume-3db90558-cc13-423b-93f7-f0bd3d36099b": Phase="Pending", Reason="", readiness=false. Elapsed: 6.017681878s Aug 18 11:26:50.601: INFO: Pod "projected-volume-3db90558-cc13-423b-93f7-f0bd3d36099b": Phase="Succeeded", Reason="", readiness=false. Elapsed: 8.020964292s STEP: Saw pod success Aug 18 11:26:50.601: INFO: Pod "projected-volume-3db90558-cc13-423b-93f7-f0bd3d36099b" satisfied condition "Succeeded or Failed" Aug 18 11:26:50.604: INFO: Trying to get logs from node node1 pod projected-volume-3db90558-cc13-423b-93f7-f0bd3d36099b container projected-all-volume-test: STEP: delete the pod Aug 18 11:26:50.619: INFO: Waiting for pod projected-volume-3db90558-cc13-423b-93f7-f0bd3d36099b to disappear Aug 18 11:26:50.621: INFO: Pod projected-volume-3db90558-cc13-423b-93f7-f0bd3d36099b no longer exists [AfterEach] [sig-storage] Projected combined /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:26:50.621: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "projected-1109" for this suite. • [SLOW TEST:8.087 seconds] [sig-storage] Projected combined /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/projected_combined.go:32 should project all components that make up the projection API [Projection][NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-storage] Projected combined should project all components that make up the projection API [Projection][NodeConformance] [Conformance]","total":-1,"completed":11,"skipped":195,"failed":0} SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-storage] ConfigMap /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:26:46.623: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename configmap STEP: Waiting for a default service account to be provisioned in namespace [It] should be consumable from pods in volume as non-root [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating configMap with name configmap-test-volume-a54ad30c-7f6b-4074-899f-f4e7b2c219ae STEP: Creating a pod to test consume configMaps Aug 18 11:26:46.663: INFO: Waiting up to 5m0s for pod "pod-configmaps-f3f56dae-b4a8-419a-9ed9-fbc4869e81e7" in namespace "configmap-665" to be "Succeeded or Failed" Aug 18 11:26:46.669: INFO: Pod "pod-configmaps-f3f56dae-b4a8-419a-9ed9-fbc4869e81e7": Phase="Pending", Reason="", readiness=false. Elapsed: 5.414871ms Aug 18 11:26:48.671: INFO: Pod "pod-configmaps-f3f56dae-b4a8-419a-9ed9-fbc4869e81e7": Phase="Pending", Reason="", readiness=false. Elapsed: 2.00795772s Aug 18 11:26:50.675: INFO: Pod "pod-configmaps-f3f56dae-b4a8-419a-9ed9-fbc4869e81e7": Phase="Pending", Reason="", readiness=false. Elapsed: 4.011246597s Aug 18 11:26:52.677: INFO: Pod "pod-configmaps-f3f56dae-b4a8-419a-9ed9-fbc4869e81e7": Phase="Succeeded", Reason="", readiness=false. Elapsed: 6.014242251s STEP: Saw pod success Aug 18 11:26:52.678: INFO: Pod "pod-configmaps-f3f56dae-b4a8-419a-9ed9-fbc4869e81e7" satisfied condition "Succeeded or Failed" Aug 18 11:26:52.681: INFO: Trying to get logs from node node1 pod pod-configmaps-f3f56dae-b4a8-419a-9ed9-fbc4869e81e7 container configmap-volume-test: STEP: delete the pod Aug 18 11:26:52.751: INFO: Waiting for pod pod-configmaps-f3f56dae-b4a8-419a-9ed9-fbc4869e81e7 to disappear Aug 18 11:26:52.753: INFO: Pod pod-configmaps-f3f56dae-b4a8-419a-9ed9-fbc4869e81e7 no longer exists [AfterEach] [sig-storage] ConfigMap /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:26:52.753: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "configmap-665" for this suite. • [SLOW TEST:6.138 seconds] [sig-storage] ConfigMap /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/configmap_volume.go:36 should be consumable from pods in volume as non-root [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-storage] ConfigMap should be consumable from pods in volume as non-root [NodeConformance] [Conformance]","total":-1,"completed":6,"skipped":151,"failed":0} SSS ------------------------------ [BeforeEach] [k8s.io] Container Runtime /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:26:47.079: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename container-runtime STEP: Waiting for a default service account to be provisioned in namespace [It] should report termination message [LinuxOnly] as empty when pod succeeds and TerminationMessagePolicy FallbackToLogsOnError is set [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: create the container STEP: wait for the container to reach Succeeded STEP: get the container status STEP: the container should be terminated STEP: the termination message should be set Aug 18 11:26:55.148: INFO: Expected: &{} to match Container's Termination Message: -- STEP: delete the container [AfterEach] [k8s.io] Container Runtime /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:26:55.160: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "container-runtime-3250" for this suite. • [SLOW TEST:8.089 seconds] [k8s.io] Container Runtime /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 blackbox test /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/runtime.go:41 on terminated container /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/runtime.go:134 should report termination message [LinuxOnly] as empty when pod succeeds and TerminationMessagePolicy FallbackToLogsOnError is set [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [k8s.io] Container Runtime blackbox test on terminated container should report termination message [LinuxOnly] as empty when pod succeeds and TerminationMessagePolicy FallbackToLogsOnError is set [NodeConformance] [Conformance]","total":-1,"completed":10,"skipped":157,"failed":0} SSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-cli] Kubectl client /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:26:52.771: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename kubectl STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-cli] Kubectl client /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/kubectl.go:247 [BeforeEach] Kubectl run pod /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/kubectl.go:1512 [It] should create a pod from an image when restart is Never [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: running the image docker.io/library/httpd:2.4.38-alpine Aug 18 11:26:52.791: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-6589 run e2e-test-httpd-pod --restart=Never --image=docker.io/library/httpd:2.4.38-alpine' Aug 18 11:26:52.947: INFO: stderr: "" Aug 18 11:26:52.947: INFO: stdout: "pod/e2e-test-httpd-pod created\n" STEP: verifying the pod e2e-test-httpd-pod was created [AfterEach] Kubectl run pod /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/kubectl.go:1516 Aug 18 11:26:52.950: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-6589 delete pods e2e-test-httpd-pod' Aug 18 11:26:55.784: INFO: stderr: "" Aug 18 11:26:55.784: INFO: stdout: "pod \"e2e-test-httpd-pod\" deleted\n" [AfterEach] [sig-cli] Kubectl client /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:26:55.784: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "kubectl-6589" for this suite. • ------------------------------ {"msg":"PASSED [sig-cli] Kubectl client Kubectl run pod should create a pod from an image when restart is Never [Conformance]","total":-1,"completed":7,"skipped":154,"failed":0} SSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-node] Downward API /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:26:49.805: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename downward-api STEP: Waiting for a default service account to be provisioned in namespace [It] should provide default limits.cpu/memory from node allocatable [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating a pod to test downward api env vars Aug 18 11:26:49.844: INFO: Waiting up to 5m0s for pod "downward-api-ddca2b43-d3ad-462f-a3e2-0e19a4b21dbc" in namespace "downward-api-813" to be "Succeeded or Failed" Aug 18 11:26:49.848: INFO: Pod "downward-api-ddca2b43-d3ad-462f-a3e2-0e19a4b21dbc": Phase="Pending", Reason="", readiness=false. Elapsed: 4.168434ms Aug 18 11:26:51.852: INFO: Pod "downward-api-ddca2b43-d3ad-462f-a3e2-0e19a4b21dbc": Phase="Pending", Reason="", readiness=false. Elapsed: 2.008033707s Aug 18 11:26:53.854: INFO: Pod "downward-api-ddca2b43-d3ad-462f-a3e2-0e19a4b21dbc": Phase="Pending", Reason="", readiness=false. Elapsed: 4.01079765s Aug 18 11:26:55.857: INFO: Pod "downward-api-ddca2b43-d3ad-462f-a3e2-0e19a4b21dbc": Phase="Succeeded", Reason="", readiness=false. Elapsed: 6.013146474s STEP: Saw pod success Aug 18 11:26:55.857: INFO: Pod "downward-api-ddca2b43-d3ad-462f-a3e2-0e19a4b21dbc" satisfied condition "Succeeded or Failed" Aug 18 11:26:55.859: INFO: Trying to get logs from node node1 pod downward-api-ddca2b43-d3ad-462f-a3e2-0e19a4b21dbc container dapi-container: STEP: delete the pod Aug 18 11:26:55.879: INFO: Waiting for pod downward-api-ddca2b43-d3ad-462f-a3e2-0e19a4b21dbc to disappear Aug 18 11:26:55.881: INFO: Pod downward-api-ddca2b43-d3ad-462f-a3e2-0e19a4b21dbc no longer exists [AfterEach] [sig-node] Downward API /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:26:55.881: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "downward-api-813" for this suite. • [SLOW TEST:6.084 seconds] [sig-node] Downward API /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/downward_api.go:34 should provide default limits.cpu/memory from node allocatable [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-node] Downward API should provide default limits.cpu/memory from node allocatable [NodeConformance] [Conformance]","total":-1,"completed":10,"skipped":192,"failed":0} SSSSSSS ------------------------------ [BeforeEach] [sig-storage] Downward API volume /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:26:50.782: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename downward-api STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-storage] Downward API volume /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/downwardapi_volume.go:42 [It] should provide container's cpu request [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating a pod to test downward API volume plugin Aug 18 11:26:50.812: INFO: Waiting up to 5m0s for pod "downwardapi-volume-f9ef7eb6-4653-4ebc-ba56-7be78b338627" in namespace "downward-api-9711" to be "Succeeded or Failed" Aug 18 11:26:50.815: INFO: Pod "downwardapi-volume-f9ef7eb6-4653-4ebc-ba56-7be78b338627": Phase="Pending", Reason="", readiness=false. Elapsed: 2.548256ms Aug 18 11:26:52.818: INFO: Pod "downwardapi-volume-f9ef7eb6-4653-4ebc-ba56-7be78b338627": Phase="Pending", Reason="", readiness=false. Elapsed: 2.005224342s Aug 18 11:26:54.821: INFO: Pod "downwardapi-volume-f9ef7eb6-4653-4ebc-ba56-7be78b338627": Phase="Pending", Reason="", readiness=false. Elapsed: 4.008162015s Aug 18 11:26:56.824: INFO: Pod "downwardapi-volume-f9ef7eb6-4653-4ebc-ba56-7be78b338627": Phase="Running", Reason="", readiness=true. Elapsed: 6.011598036s Aug 18 11:26:58.828: INFO: Pod "downwardapi-volume-f9ef7eb6-4653-4ebc-ba56-7be78b338627": Phase="Succeeded", Reason="", readiness=false. Elapsed: 8.016018481s STEP: Saw pod success Aug 18 11:26:58.828: INFO: Pod "downwardapi-volume-f9ef7eb6-4653-4ebc-ba56-7be78b338627" satisfied condition "Succeeded or Failed" Aug 18 11:26:58.831: INFO: Trying to get logs from node node1 pod downwardapi-volume-f9ef7eb6-4653-4ebc-ba56-7be78b338627 container client-container: STEP: delete the pod Aug 18 11:26:58.845: INFO: Waiting for pod downwardapi-volume-f9ef7eb6-4653-4ebc-ba56-7be78b338627 to disappear Aug 18 11:26:58.847: INFO: Pod downwardapi-volume-f9ef7eb6-4653-4ebc-ba56-7be78b338627 no longer exists [AfterEach] [sig-storage] Downward API volume /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:26:58.847: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "downward-api-9711" for this suite. • [SLOW TEST:8.074 seconds] [sig-storage] Downward API volume /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/downwardapi_volume.go:37 should provide container's cpu request [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-storage] Downward API volume should provide container's cpu request [NodeConformance] [Conformance]","total":-1,"completed":12,"skipped":271,"failed":0} SSSSSSSSSSS ------------------------------ [BeforeEach] [sig-network] DNS /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:26:40.495: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename dns STEP: Waiting for a default service account to be provisioned in namespace [It] should provide DNS for pods for Subdomain [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating a test headless service STEP: Running these commands on wheezy: for i in `seq 1 600`; do check="$$(dig +notcp +noall +answer +search dns-querier-2.dns-test-service-2.dns-6727.svc.cluster.local A)" && test -n "$$check" && echo OK > /results/wheezy_udp@dns-querier-2.dns-test-service-2.dns-6727.svc.cluster.local;check="$$(dig +tcp +noall +answer +search dns-querier-2.dns-test-service-2.dns-6727.svc.cluster.local A)" && test -n "$$check" && echo OK > /results/wheezy_tcp@dns-querier-2.dns-test-service-2.dns-6727.svc.cluster.local;check="$$(dig +notcp +noall +answer +search dns-test-service-2.dns-6727.svc.cluster.local A)" && test -n "$$check" && echo OK > /results/wheezy_udp@dns-test-service-2.dns-6727.svc.cluster.local;check="$$(dig +tcp +noall +answer +search dns-test-service-2.dns-6727.svc.cluster.local A)" && test -n "$$check" && echo OK > /results/wheezy_tcp@dns-test-service-2.dns-6727.svc.cluster.local;podARec=$$(hostname -i| awk -F. '{print $$1"-"$$2"-"$$3"-"$$4".dns-6727.pod.cluster.local"}');check="$$(dig +notcp +noall +answer +search $${podARec} A)" && test -n "$$check" && echo OK > /results/wheezy_udp@PodARecord;check="$$(dig +tcp +noall +answer +search $${podARec} A)" && test -n "$$check" && echo OK > /results/wheezy_tcp@PodARecord;sleep 1; done STEP: Running these commands on jessie: for i in `seq 1 600`; do check="$$(dig +notcp +noall +answer +search dns-querier-2.dns-test-service-2.dns-6727.svc.cluster.local A)" && test -n "$$check" && echo OK > /results/jessie_udp@dns-querier-2.dns-test-service-2.dns-6727.svc.cluster.local;check="$$(dig +tcp +noall +answer +search dns-querier-2.dns-test-service-2.dns-6727.svc.cluster.local A)" && test -n "$$check" && echo OK > /results/jessie_tcp@dns-querier-2.dns-test-service-2.dns-6727.svc.cluster.local;check="$$(dig +notcp +noall +answer +search dns-test-service-2.dns-6727.svc.cluster.local A)" && test -n "$$check" && echo OK > /results/jessie_udp@dns-test-service-2.dns-6727.svc.cluster.local;check="$$(dig +tcp +noall +answer +search dns-test-service-2.dns-6727.svc.cluster.local A)" && test -n "$$check" && echo OK > /results/jessie_tcp@dns-test-service-2.dns-6727.svc.cluster.local;podARec=$$(hostname -i| awk -F. '{print $$1"-"$$2"-"$$3"-"$$4".dns-6727.pod.cluster.local"}');check="$$(dig +notcp +noall +answer +search $${podARec} A)" && test -n "$$check" && echo OK > /results/jessie_udp@PodARecord;check="$$(dig +tcp +noall +answer +search $${podARec} A)" && test -n "$$check" && echo OK > /results/jessie_tcp@PodARecord;sleep 1; done STEP: creating a pod to probe DNS STEP: submitting the pod to kubernetes STEP: retrieving the pod STEP: looking for the results for each expected name from probers Aug 18 11:26:54.540: INFO: Unable to read wheezy_udp@dns-querier-2.dns-test-service-2.dns-6727.svc.cluster.local from pod dns-6727/dns-test-a63cc02d-30c3-4209-91fb-5977bfb6dd56: the server could not find the requested resource (get pods dns-test-a63cc02d-30c3-4209-91fb-5977bfb6dd56) Aug 18 11:26:54.542: INFO: Unable to read wheezy_tcp@dns-querier-2.dns-test-service-2.dns-6727.svc.cluster.local from pod dns-6727/dns-test-a63cc02d-30c3-4209-91fb-5977bfb6dd56: the server could not find the requested resource (get pods dns-test-a63cc02d-30c3-4209-91fb-5977bfb6dd56) Aug 18 11:26:54.544: INFO: Unable to read wheezy_udp@dns-test-service-2.dns-6727.svc.cluster.local from pod dns-6727/dns-test-a63cc02d-30c3-4209-91fb-5977bfb6dd56: the server could not find the requested resource (get pods dns-test-a63cc02d-30c3-4209-91fb-5977bfb6dd56) Aug 18 11:26:54.548: INFO: Unable to read wheezy_tcp@dns-test-service-2.dns-6727.svc.cluster.local from pod dns-6727/dns-test-a63cc02d-30c3-4209-91fb-5977bfb6dd56: the server could not find the requested resource (get pods dns-test-a63cc02d-30c3-4209-91fb-5977bfb6dd56) Aug 18 11:26:54.557: INFO: Unable to read jessie_udp@dns-querier-2.dns-test-service-2.dns-6727.svc.cluster.local from pod dns-6727/dns-test-a63cc02d-30c3-4209-91fb-5977bfb6dd56: the server could not find the requested resource (get pods dns-test-a63cc02d-30c3-4209-91fb-5977bfb6dd56) Aug 18 11:26:54.559: INFO: Unable to read jessie_tcp@dns-querier-2.dns-test-service-2.dns-6727.svc.cluster.local from pod dns-6727/dns-test-a63cc02d-30c3-4209-91fb-5977bfb6dd56: the server could not find the requested resource (get pods dns-test-a63cc02d-30c3-4209-91fb-5977bfb6dd56) Aug 18 11:26:54.562: INFO: Unable to read jessie_udp@dns-test-service-2.dns-6727.svc.cluster.local from pod dns-6727/dns-test-a63cc02d-30c3-4209-91fb-5977bfb6dd56: the server could not find the requested resource (get pods dns-test-a63cc02d-30c3-4209-91fb-5977bfb6dd56) Aug 18 11:26:54.565: INFO: Unable to read jessie_tcp@dns-test-service-2.dns-6727.svc.cluster.local from pod dns-6727/dns-test-a63cc02d-30c3-4209-91fb-5977bfb6dd56: the server could not find the requested resource (get pods dns-test-a63cc02d-30c3-4209-91fb-5977bfb6dd56) Aug 18 11:26:54.570: INFO: Lookups using dns-6727/dns-test-a63cc02d-30c3-4209-91fb-5977bfb6dd56 failed for: [wheezy_udp@dns-querier-2.dns-test-service-2.dns-6727.svc.cluster.local wheezy_tcp@dns-querier-2.dns-test-service-2.dns-6727.svc.cluster.local wheezy_udp@dns-test-service-2.dns-6727.svc.cluster.local wheezy_tcp@dns-test-service-2.dns-6727.svc.cluster.local jessie_udp@dns-querier-2.dns-test-service-2.dns-6727.svc.cluster.local jessie_tcp@dns-querier-2.dns-test-service-2.dns-6727.svc.cluster.local jessie_udp@dns-test-service-2.dns-6727.svc.cluster.local jessie_tcp@dns-test-service-2.dns-6727.svc.cluster.local] Aug 18 11:26:59.605: INFO: DNS probes using dns-6727/dns-test-a63cc02d-30c3-4209-91fb-5977bfb6dd56 succeeded STEP: deleting the pod STEP: deleting the test headless service [AfterEach] [sig-network] DNS /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:26:59.622: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "dns-6727" for this suite. • [SLOW TEST:19.135 seconds] [sig-network] DNS /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/framework.go:23 should provide DNS for pods for Subdomain [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-network] DNS should provide DNS for pods for Subdomain [Conformance]","total":-1,"completed":9,"skipped":111,"failed":0} SSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:26:55.846: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename services STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:782 [It] should serve a basic endpoint from pods [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: creating service endpoint-test2 in namespace services-1898 STEP: waiting up to 3m0s for service endpoint-test2 in namespace services-1898 to expose endpoints map[] Aug 18 11:26:55.886: INFO: successfully validated that service endpoint-test2 in namespace services-1898 exposes endpoints map[] STEP: Creating pod pod1 in namespace services-1898 STEP: waiting up to 3m0s for service endpoint-test2 in namespace services-1898 to expose endpoints map[pod1:[80]] Aug 18 11:26:59.908: INFO: successfully validated that service endpoint-test2 in namespace services-1898 exposes endpoints map[pod1:[80]] STEP: Creating pod pod2 in namespace services-1898 STEP: waiting up to 3m0s for service endpoint-test2 in namespace services-1898 to expose endpoints map[pod1:[80] pod2:[80]] Aug 18 11:27:02.932: INFO: successfully validated that service endpoint-test2 in namespace services-1898 exposes endpoints map[pod1:[80] pod2:[80]] STEP: Deleting pod pod1 in namespace services-1898 STEP: waiting up to 3m0s for service endpoint-test2 in namespace services-1898 to expose endpoints map[pod2:[80]] Aug 18 11:27:02.947: INFO: successfully validated that service endpoint-test2 in namespace services-1898 exposes endpoints map[pod2:[80]] STEP: Deleting pod pod2 in namespace services-1898 STEP: waiting up to 3m0s for service endpoint-test2 in namespace services-1898 to expose endpoints map[] Aug 18 11:27:02.958: INFO: successfully validated that service endpoint-test2 in namespace services-1898 exposes endpoints map[] [AfterEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:27:02.968: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "services-1898" for this suite. [AfterEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:786 • [SLOW TEST:7.130 seconds] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/framework.go:23 should serve a basic endpoint from pods [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-network] Services should serve a basic endpoint from pods [Conformance]","total":-1,"completed":8,"skipped":175,"failed":0} SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-storage] ConfigMap /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:26:58.882: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename configmap STEP: Waiting for a default service account to be provisioned in namespace [It] should be consumable from pods in volume [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating configMap with name configmap-test-volume-068f5513-af4d-4605-93f8-c834ea4e7546 STEP: Creating a pod to test consume configMaps Aug 18 11:26:58.924: INFO: Waiting up to 5m0s for pod "pod-configmaps-183ebfed-7c8f-415d-aa10-6f6255d15f6a" in namespace "configmap-4555" to be "Succeeded or Failed" Aug 18 11:26:58.929: INFO: Pod "pod-configmaps-183ebfed-7c8f-415d-aa10-6f6255d15f6a": Phase="Pending", Reason="", readiness=false. Elapsed: 4.128622ms Aug 18 11:27:00.932: INFO: Pod "pod-configmaps-183ebfed-7c8f-415d-aa10-6f6255d15f6a": Phase="Pending", Reason="", readiness=false. Elapsed: 2.00702787s Aug 18 11:27:02.934: INFO: Pod "pod-configmaps-183ebfed-7c8f-415d-aa10-6f6255d15f6a": Phase="Pending", Reason="", readiness=false. Elapsed: 4.009497578s Aug 18 11:27:04.937: INFO: Pod "pod-configmaps-183ebfed-7c8f-415d-aa10-6f6255d15f6a": Phase="Succeeded", Reason="", readiness=false. Elapsed: 6.012303142s STEP: Saw pod success Aug 18 11:27:04.937: INFO: Pod "pod-configmaps-183ebfed-7c8f-415d-aa10-6f6255d15f6a" satisfied condition "Succeeded or Failed" Aug 18 11:27:04.939: INFO: Trying to get logs from node node2 pod pod-configmaps-183ebfed-7c8f-415d-aa10-6f6255d15f6a container configmap-volume-test: STEP: delete the pod Aug 18 11:27:04.951: INFO: Waiting for pod pod-configmaps-183ebfed-7c8f-415d-aa10-6f6255d15f6a to disappear Aug 18 11:27:04.953: INFO: Pod pod-configmaps-183ebfed-7c8f-415d-aa10-6f6255d15f6a no longer exists [AfterEach] [sig-storage] ConfigMap /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:27:04.953: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "configmap-4555" for this suite. • [SLOW TEST:6.079 seconds] [sig-storage] ConfigMap /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/configmap_volume.go:36 should be consumable from pods in volume [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-storage] ConfigMap should be consumable from pods in volume [NodeConformance] [Conformance]","total":-1,"completed":13,"skipped":282,"failed":0} SSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-storage] Projected downwardAPI /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:27:05.021: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename projected STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-storage] Projected downwardAPI /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/projected_downwardapi.go:42 [It] should provide node allocatable (cpu) as default cpu limit if the limit is not set [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating a pod to test downward API volume plugin Aug 18 11:27:05.056: INFO: Waiting up to 5m0s for pod "downwardapi-volume-4590081b-5304-4521-98e0-de0e9bf3940f" in namespace "projected-1726" to be "Succeeded or Failed" Aug 18 11:27:05.058: INFO: Pod "downwardapi-volume-4590081b-5304-4521-98e0-de0e9bf3940f": Phase="Pending", Reason="", readiness=false. Elapsed: 1.971907ms Aug 18 11:27:07.061: INFO: Pod "downwardapi-volume-4590081b-5304-4521-98e0-de0e9bf3940f": Phase="Pending", Reason="", readiness=false. Elapsed: 2.005315898s Aug 18 11:27:09.064: INFO: Pod "downwardapi-volume-4590081b-5304-4521-98e0-de0e9bf3940f": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.008202874s STEP: Saw pod success Aug 18 11:27:09.064: INFO: Pod "downwardapi-volume-4590081b-5304-4521-98e0-de0e9bf3940f" satisfied condition "Succeeded or Failed" Aug 18 11:27:09.067: INFO: Trying to get logs from node node2 pod downwardapi-volume-4590081b-5304-4521-98e0-de0e9bf3940f container client-container: STEP: delete the pod Aug 18 11:27:09.079: INFO: Waiting for pod downwardapi-volume-4590081b-5304-4521-98e0-de0e9bf3940f to disappear Aug 18 11:27:09.081: INFO: Pod downwardapi-volume-4590081b-5304-4521-98e0-de0e9bf3940f no longer exists [AfterEach] [sig-storage] Projected downwardAPI /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:27:09.081: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "projected-1726" for this suite. • ------------------------------ {"msg":"PASSED [sig-storage] Projected downwardAPI should provide node allocatable (cpu) as default cpu limit if the limit is not set [NodeConformance] [Conformance]","total":-1,"completed":14,"skipped":308,"failed":0} SSSSSSSSSS ------------------------------ [BeforeEach] [k8s.io] KubeletManagedEtcHosts /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:26:55.908: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename e2e-kubelet-etc-hosts STEP: Waiting for a default service account to be provisioned in namespace [It] should test kubelet managed /etc/hosts file [LinuxOnly] [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Setting up the test STEP: Creating hostNetwork=false pod STEP: Creating hostNetwork=true pod STEP: Running the test STEP: Verifying /etc/hosts of container is kubelet-managed for pod with hostNetwork=false Aug 18 11:27:07.967: INFO: ExecWithOptions {Command:[cat /etc/hosts] Namespace:e2e-kubelet-etc-hosts-302 PodName:test-pod ContainerName:busybox-1 Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:false} Aug 18 11:27:07.967: INFO: >>> kubeConfig: /root/.kube/config Aug 18 11:27:08.075: INFO: Exec stderr: "" Aug 18 11:27:08.075: INFO: ExecWithOptions {Command:[cat /etc/hosts-original] Namespace:e2e-kubelet-etc-hosts-302 PodName:test-pod ContainerName:busybox-1 Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:false} Aug 18 11:27:08.075: INFO: >>> kubeConfig: /root/.kube/config Aug 18 11:27:08.185: INFO: Exec stderr: "" Aug 18 11:27:08.185: INFO: ExecWithOptions {Command:[cat /etc/hosts] Namespace:e2e-kubelet-etc-hosts-302 PodName:test-pod ContainerName:busybox-2 Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:false} Aug 18 11:27:08.185: INFO: >>> kubeConfig: /root/.kube/config Aug 18 11:27:08.292: INFO: Exec stderr: "" Aug 18 11:27:08.292: INFO: ExecWithOptions {Command:[cat /etc/hosts-original] Namespace:e2e-kubelet-etc-hosts-302 PodName:test-pod ContainerName:busybox-2 Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:false} Aug 18 11:27:08.292: INFO: >>> kubeConfig: /root/.kube/config Aug 18 11:27:08.400: INFO: Exec stderr: "" STEP: Verifying /etc/hosts of container is not kubelet-managed since container specifies /etc/hosts mount Aug 18 11:27:08.400: INFO: ExecWithOptions {Command:[cat /etc/hosts] Namespace:e2e-kubelet-etc-hosts-302 PodName:test-pod ContainerName:busybox-3 Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:false} Aug 18 11:27:08.400: INFO: >>> kubeConfig: /root/.kube/config Aug 18 11:27:08.506: INFO: Exec stderr: "" Aug 18 11:27:08.506: INFO: ExecWithOptions {Command:[cat /etc/hosts-original] Namespace:e2e-kubelet-etc-hosts-302 PodName:test-pod ContainerName:busybox-3 Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:false} Aug 18 11:27:08.506: INFO: >>> kubeConfig: /root/.kube/config Aug 18 11:27:08.630: INFO: Exec stderr: "" STEP: Verifying /etc/hosts content of container is not kubelet-managed for pod with hostNetwork=true Aug 18 11:27:08.630: INFO: ExecWithOptions {Command:[cat /etc/hosts] Namespace:e2e-kubelet-etc-hosts-302 PodName:test-host-network-pod ContainerName:busybox-1 Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:false} Aug 18 11:27:08.630: INFO: >>> kubeConfig: /root/.kube/config Aug 18 11:27:08.793: INFO: Exec stderr: "" Aug 18 11:27:08.793: INFO: ExecWithOptions {Command:[cat /etc/hosts-original] Namespace:e2e-kubelet-etc-hosts-302 PodName:test-host-network-pod ContainerName:busybox-1 Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:false} Aug 18 11:27:08.793: INFO: >>> kubeConfig: /root/.kube/config Aug 18 11:27:08.902: INFO: Exec stderr: "" Aug 18 11:27:08.902: INFO: ExecWithOptions {Command:[cat /etc/hosts] Namespace:e2e-kubelet-etc-hosts-302 PodName:test-host-network-pod ContainerName:busybox-2 Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:false} Aug 18 11:27:08.902: INFO: >>> kubeConfig: /root/.kube/config Aug 18 11:27:09.006: INFO: Exec stderr: "" Aug 18 11:27:09.006: INFO: ExecWithOptions {Command:[cat /etc/hosts-original] Namespace:e2e-kubelet-etc-hosts-302 PodName:test-host-network-pod ContainerName:busybox-2 Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:false} Aug 18 11:27:09.006: INFO: >>> kubeConfig: /root/.kube/config Aug 18 11:27:09.113: INFO: Exec stderr: "" [AfterEach] [k8s.io] KubeletManagedEtcHosts /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:27:09.113: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "e2e-kubelet-etc-hosts-302" for this suite. • [SLOW TEST:13.213 seconds] [k8s.io] KubeletManagedEtcHosts /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 should test kubelet managed /etc/hosts file [LinuxOnly] [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [k8s.io] KubeletManagedEtcHosts should test kubelet managed /etc/hosts file [LinuxOnly] [NodeConformance] [Conformance]","total":-1,"completed":11,"skipped":199,"failed":0} SSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-api-machinery] Watchers /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:26:11.185: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename watch STEP: Waiting for a default service account to be provisioned in namespace [It] should observe add, update, and delete watch notifications on configmaps [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: creating a watch on configmaps with label A STEP: creating a watch on configmaps with label B STEP: creating a watch on configmaps with label A or B STEP: creating a configmap with label A and ensuring the correct watchers observe the notification Aug 18 11:26:11.213: INFO: Got : ADDED &ConfigMap{ObjectMeta:{e2e-watch-test-configmap-a watch-9597 /api/v1/namespaces/watch-9597/configmaps/e2e-watch-test-configmap-a b4fbab64-705e-4cfd-b094-6811aab46b33 55246 0 2021-08-18 11:26:11 +0000 UTC map[watch-this-configmap:multiple-watchers-A] map[] [] [] [{e2e.test Update v1 2021-08-18 11:26:11 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{".":{},"f:watch-this-configmap":{}}}}}]},Data:map[string]string{},BinaryData:map[string][]byte{},Immutable:nil,} Aug 18 11:26:11.214: INFO: Got : ADDED &ConfigMap{ObjectMeta:{e2e-watch-test-configmap-a watch-9597 /api/v1/namespaces/watch-9597/configmaps/e2e-watch-test-configmap-a b4fbab64-705e-4cfd-b094-6811aab46b33 55246 0 2021-08-18 11:26:11 +0000 UTC map[watch-this-configmap:multiple-watchers-A] map[] [] [] [{e2e.test Update v1 2021-08-18 11:26:11 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{".":{},"f:watch-this-configmap":{}}}}}]},Data:map[string]string{},BinaryData:map[string][]byte{},Immutable:nil,} STEP: modifying configmap A and ensuring the correct watchers observe the notification Aug 18 11:26:21.220: INFO: Got : MODIFIED &ConfigMap{ObjectMeta:{e2e-watch-test-configmap-a watch-9597 /api/v1/namespaces/watch-9597/configmaps/e2e-watch-test-configmap-a b4fbab64-705e-4cfd-b094-6811aab46b33 55506 0 2021-08-18 11:26:11 +0000 UTC map[watch-this-configmap:multiple-watchers-A] map[] [] [] [{e2e.test Update v1 2021-08-18 11:26:21 +0000 UTC FieldsV1 {"f:data":{".":{},"f:mutation":{}},"f:metadata":{"f:labels":{".":{},"f:watch-this-configmap":{}}}}}]},Data:map[string]string{mutation: 1,},BinaryData:map[string][]byte{},Immutable:nil,} Aug 18 11:26:21.220: INFO: Got : MODIFIED &ConfigMap{ObjectMeta:{e2e-watch-test-configmap-a watch-9597 /api/v1/namespaces/watch-9597/configmaps/e2e-watch-test-configmap-a b4fbab64-705e-4cfd-b094-6811aab46b33 55506 0 2021-08-18 11:26:11 +0000 UTC map[watch-this-configmap:multiple-watchers-A] map[] [] [] [{e2e.test Update v1 2021-08-18 11:26:21 +0000 UTC FieldsV1 {"f:data":{".":{},"f:mutation":{}},"f:metadata":{"f:labels":{".":{},"f:watch-this-configmap":{}}}}}]},Data:map[string]string{mutation: 1,},BinaryData:map[string][]byte{},Immutable:nil,} STEP: modifying configmap A again and ensuring the correct watchers observe the notification Aug 18 11:26:31.229: INFO: Got : MODIFIED &ConfigMap{ObjectMeta:{e2e-watch-test-configmap-a watch-9597 /api/v1/namespaces/watch-9597/configmaps/e2e-watch-test-configmap-a b4fbab64-705e-4cfd-b094-6811aab46b33 55816 0 2021-08-18 11:26:11 +0000 UTC map[watch-this-configmap:multiple-watchers-A] map[] [] [] [{e2e.test Update v1 2021-08-18 11:26:21 +0000 UTC FieldsV1 {"f:data":{".":{},"f:mutation":{}},"f:metadata":{"f:labels":{".":{},"f:watch-this-configmap":{}}}}}]},Data:map[string]string{mutation: 2,},BinaryData:map[string][]byte{},Immutable:nil,} Aug 18 11:26:31.229: INFO: Got : MODIFIED &ConfigMap{ObjectMeta:{e2e-watch-test-configmap-a watch-9597 /api/v1/namespaces/watch-9597/configmaps/e2e-watch-test-configmap-a b4fbab64-705e-4cfd-b094-6811aab46b33 55816 0 2021-08-18 11:26:11 +0000 UTC map[watch-this-configmap:multiple-watchers-A] map[] [] [] [{e2e.test Update v1 2021-08-18 11:26:21 +0000 UTC FieldsV1 {"f:data":{".":{},"f:mutation":{}},"f:metadata":{"f:labels":{".":{},"f:watch-this-configmap":{}}}}}]},Data:map[string]string{mutation: 2,},BinaryData:map[string][]byte{},Immutable:nil,} STEP: deleting configmap A and ensuring the correct watchers observe the notification Aug 18 11:26:41.235: INFO: Got : DELETED &ConfigMap{ObjectMeta:{e2e-watch-test-configmap-a watch-9597 /api/v1/namespaces/watch-9597/configmaps/e2e-watch-test-configmap-a b4fbab64-705e-4cfd-b094-6811aab46b33 56180 0 2021-08-18 11:26:11 +0000 UTC map[watch-this-configmap:multiple-watchers-A] map[] [] [] [{e2e.test Update v1 2021-08-18 11:26:21 +0000 UTC FieldsV1 {"f:data":{".":{},"f:mutation":{}},"f:metadata":{"f:labels":{".":{},"f:watch-this-configmap":{}}}}}]},Data:map[string]string{mutation: 2,},BinaryData:map[string][]byte{},Immutable:nil,} Aug 18 11:26:41.235: INFO: Got : DELETED &ConfigMap{ObjectMeta:{e2e-watch-test-configmap-a watch-9597 /api/v1/namespaces/watch-9597/configmaps/e2e-watch-test-configmap-a b4fbab64-705e-4cfd-b094-6811aab46b33 56180 0 2021-08-18 11:26:11 +0000 UTC map[watch-this-configmap:multiple-watchers-A] map[] [] [] [{e2e.test Update v1 2021-08-18 11:26:21 +0000 UTC FieldsV1 {"f:data":{".":{},"f:mutation":{}},"f:metadata":{"f:labels":{".":{},"f:watch-this-configmap":{}}}}}]},Data:map[string]string{mutation: 2,},BinaryData:map[string][]byte{},Immutable:nil,} STEP: creating a configmap with label B and ensuring the correct watchers observe the notification Aug 18 11:26:51.240: INFO: Got : ADDED &ConfigMap{ObjectMeta:{e2e-watch-test-configmap-b watch-9597 /api/v1/namespaces/watch-9597/configmaps/e2e-watch-test-configmap-b 5b89ac30-71d5-4f7c-8322-1bc0ce9498fc 56492 0 2021-08-18 11:26:51 +0000 UTC map[watch-this-configmap:multiple-watchers-B] map[] [] [] [{e2e.test Update v1 2021-08-18 11:26:51 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{".":{},"f:watch-this-configmap":{}}}}}]},Data:map[string]string{},BinaryData:map[string][]byte{},Immutable:nil,} Aug 18 11:26:51.240: INFO: Got : ADDED &ConfigMap{ObjectMeta:{e2e-watch-test-configmap-b watch-9597 /api/v1/namespaces/watch-9597/configmaps/e2e-watch-test-configmap-b 5b89ac30-71d5-4f7c-8322-1bc0ce9498fc 56492 0 2021-08-18 11:26:51 +0000 UTC map[watch-this-configmap:multiple-watchers-B] map[] [] [] [{e2e.test Update v1 2021-08-18 11:26:51 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{".":{},"f:watch-this-configmap":{}}}}}]},Data:map[string]string{},BinaryData:map[string][]byte{},Immutable:nil,} STEP: deleting configmap B and ensuring the correct watchers observe the notification Aug 18 11:27:01.248: INFO: Got : DELETED &ConfigMap{ObjectMeta:{e2e-watch-test-configmap-b watch-9597 /api/v1/namespaces/watch-9597/configmaps/e2e-watch-test-configmap-b 5b89ac30-71d5-4f7c-8322-1bc0ce9498fc 56829 0 2021-08-18 11:26:51 +0000 UTC map[watch-this-configmap:multiple-watchers-B] map[] [] [] [{e2e.test Update v1 2021-08-18 11:26:51 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{".":{},"f:watch-this-configmap":{}}}}}]},Data:map[string]string{},BinaryData:map[string][]byte{},Immutable:nil,} Aug 18 11:27:01.248: INFO: Got : DELETED &ConfigMap{ObjectMeta:{e2e-watch-test-configmap-b watch-9597 /api/v1/namespaces/watch-9597/configmaps/e2e-watch-test-configmap-b 5b89ac30-71d5-4f7c-8322-1bc0ce9498fc 56829 0 2021-08-18 11:26:51 +0000 UTC map[watch-this-configmap:multiple-watchers-B] map[] [] [] [{e2e.test Update v1 2021-08-18 11:26:51 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{".":{},"f:watch-this-configmap":{}}}}}]},Data:map[string]string{},BinaryData:map[string][]byte{},Immutable:nil,} [AfterEach] [sig-api-machinery] Watchers /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:27:11.248: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "watch-9597" for this suite. • [SLOW TEST:60.071 seconds] [sig-api-machinery] Watchers /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23 should observe add, update, and delete watch notifications on configmaps [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-api-machinery] Watchers should observe add, update, and delete watch notifications on configmaps [Conformance]","total":-1,"completed":6,"skipped":31,"failed":0} SSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:27:09.151: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename webhook STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:87 STEP: Setting up server cert STEP: Create role binding to let webhook read extension-apiserver-authentication STEP: Deploying the webhook pod STEP: Wait for the deployment to be ready Aug 18 11:27:09.722: INFO: deployment "sample-webhook-deployment" doesn't have the required revision set Aug 18 11:27:11.731: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882829, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882829, loc:(*time.Location)(0x77169a0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882829, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882829, loc:(*time.Location)(0x77169a0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-cbccbf6bb\" is progressing."}}, CollisionCount:(*int32)(nil)} STEP: Deploying the webhook service STEP: Verifying the service has paired with the endpoint Aug 18 11:27:14.741: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1 [It] should not be able to mutate or prevent deletion of webhook configuration objects [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Registering a validating webhook on ValidatingWebhookConfiguration and MutatingWebhookConfiguration objects, via the AdmissionRegistration API STEP: Registering a mutating webhook on ValidatingWebhookConfiguration and MutatingWebhookConfiguration objects, via the AdmissionRegistration API STEP: Creating a dummy validating-webhook-configuration object STEP: Deleting the validating-webhook-configuration, which should be possible to remove STEP: Creating a dummy mutating-webhook-configuration object STEP: Deleting the mutating-webhook-configuration, which should be possible to remove [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:27:14.792: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "webhook-4944" for this suite. STEP: Destroying namespace "webhook-4944-markers" for this suite. [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:102 • [SLOW TEST:5.675 seconds] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23 should not be able to mutate or prevent deletion of webhook configuration objects [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should not be able to mutate or prevent deletion of webhook configuration objects [Conformance]","total":-1,"completed":12,"skipped":213,"failed":0} SSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:27:03.066: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename services STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:782 [It] should be able to change the type from ExternalName to ClusterIP [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: creating a service externalname-service with the type=ExternalName in namespace services-4034 STEP: changing the ExternalName service to type=ClusterIP STEP: creating replication controller externalname-service in namespace services-4034 I0818 11:27:03.100851 36 runners.go:190] Created replication controller with name: externalname-service, namespace: services-4034, replica count: 2 I0818 11:27:06.151463 36 runners.go:190] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0818 11:27:09.151690 36 runners.go:190] externalname-service Pods: 2 out of 2 created, 2 running, 0 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady Aug 18 11:27:09.151: INFO: Creating new exec pod Aug 18 11:27:14.172: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4034 exec execpod54n4d -- /bin/sh -x -c nc -zv -t -w 2 externalname-service 80' Aug 18 11:27:14.589: INFO: stderr: "+ nc -zv -t -w 2 externalname-service 80\nConnection to externalname-service 80 port [tcp/http] succeeded!\n" Aug 18 11:27:14.589: INFO: stdout: "" Aug 18 11:27:14.590: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4034 exec execpod54n4d -- /bin/sh -x -c nc -zv -t -w 2 10.233.9.108 80' Aug 18 11:27:14.841: INFO: stderr: "+ nc -zv -t -w 2 10.233.9.108 80\nConnection to 10.233.9.108 80 port [tcp/http] succeeded!\n" Aug 18 11:27:14.841: INFO: stdout: "" Aug 18 11:27:14.841: INFO: Cleaning up the ExternalName to ClusterIP test service [AfterEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:27:14.866: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "services-4034" for this suite. [AfterEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:786 • [SLOW TEST:11.808 seconds] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/framework.go:23 should be able to change the type from ExternalName to ClusterIP [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ S ------------------------------ {"msg":"PASSED [sig-network] Services should be able to change the type from ExternalName to ClusterIP [Conformance]","total":-1,"completed":9,"skipped":217,"failed":0} SSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-api-machinery] server version /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:27:14.906: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename server-version STEP: Waiting for a default service account to be provisioned in namespace [It] should find the server version [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Request ServerVersion STEP: Confirm major version Aug 18 11:27:14.927: INFO: Major version: 1 STEP: Confirm minor version Aug 18 11:27:14.927: INFO: cleanMinorVersion: 19 Aug 18 11:27:14.927: INFO: Minor version: 19 [AfterEach] [sig-api-machinery] server version /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:27:14.927: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "server-version-790" for this suite. • ------------------------------ {"msg":"PASSED [sig-api-machinery] server version should find the server version [Conformance]","total":-1,"completed":13,"skipped":248,"failed":0} SSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-api-machinery] CustomResourceConversionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:27:09.115: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename crd-webhook STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-api-machinery] CustomResourceConversionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/crd_conversion_webhook.go:126 STEP: Setting up server cert STEP: Create role binding to let cr conversion webhook read extension-apiserver-authentication STEP: Deploying the custom resource conversion webhook pod STEP: Wait for the deployment to be ready Aug 18 11:27:09.646: INFO: deployment "sample-crd-conversion-webhook-deployment" doesn't have the required revision set Aug 18 11:27:11.655: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882829, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882829, loc:(*time.Location)(0x77169a0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882829, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882829, loc:(*time.Location)(0x77169a0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-85d57b96d6\" is progressing."}}, CollisionCount:(*int32)(nil)} STEP: Deploying the webhook service STEP: Verifying the service has paired with the endpoint Aug 18 11:27:14.666: INFO: Waiting for amount of service:e2e-test-crd-conversion-webhook endpoints to be 1 [It] should be able to convert from CR v1 to CR v2 [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:27:14.669: INFO: >>> kubeConfig: /root/.kube/config STEP: Creating a v1 custom resource STEP: v2 custom resource should be converted [AfterEach] [sig-api-machinery] CustomResourceConversionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:27:20.764: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "crd-webhook-6717" for this suite. [AfterEach] [sig-api-machinery] CustomResourceConversionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/crd_conversion_webhook.go:137 • [SLOW TEST:11.683 seconds] [sig-api-machinery] CustomResourceConversionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23 should be able to convert from CR v1 to CR v2 [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-api-machinery] CustomResourceConversionWebhook [Privileged:ClusterAdmin] should be able to convert from CR v1 to CR v2 [Conformance]","total":-1,"completed":15,"skipped":318,"failed":0} SSSS ------------------------------ [BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:27:14.980: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename webhook STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:87 STEP: Setting up server cert STEP: Create role binding to let webhook read extension-apiserver-authentication STEP: Deploying the webhook pod STEP: Wait for the deployment to be ready Aug 18 11:27:15.474: INFO: deployment "sample-webhook-deployment" doesn't have the required revision set Aug 18 11:27:17.484: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882835, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882835, loc:(*time.Location)(0x77169a0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882835, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882835, loc:(*time.Location)(0x77169a0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-cbccbf6bb\" is progressing."}}, CollisionCount:(*int32)(nil)} Aug 18 11:27:19.486: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882835, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882835, loc:(*time.Location)(0x77169a0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882835, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882835, loc:(*time.Location)(0x77169a0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-cbccbf6bb\" is progressing."}}, CollisionCount:(*int32)(nil)} Aug 18 11:27:21.487: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882835, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882835, loc:(*time.Location)(0x77169a0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882835, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764882835, loc:(*time.Location)(0x77169a0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-cbccbf6bb\" is progressing."}}, CollisionCount:(*int32)(nil)} STEP: Deploying the webhook service STEP: Verifying the service has paired with the endpoint Aug 18 11:27:24.493: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1 [It] listing validating webhooks should work [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Listing all of the created validation webhooks STEP: Creating a configMap that does not comply to the validation webhook rules STEP: Deleting the collection of validation webhooks STEP: Creating a configMap that does not comply to the validation webhook rules [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:27:24.625: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "webhook-7175" for this suite. STEP: Destroying namespace "webhook-7175-markers" for this suite. [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:102 • [SLOW TEST:9.680 seconds] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23 listing validating webhooks should work [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] listing validating webhooks should work [Conformance]","total":-1,"completed":14,"skipped":269,"failed":0} SSSSSSSSSS ------------------------------ [BeforeEach] [sig-storage] Projected downwardAPI /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:27:20.812: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename projected STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-storage] Projected downwardAPI /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/projected_downwardapi.go:42 [It] should provide container's cpu limit [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating a pod to test downward API volume plugin Aug 18 11:27:20.849: INFO: Waiting up to 5m0s for pod "downwardapi-volume-08b4b179-5b69-495c-88ef-77b1bfdea38c" in namespace "projected-7934" to be "Succeeded or Failed" Aug 18 11:27:20.851: INFO: Pod "downwardapi-volume-08b4b179-5b69-495c-88ef-77b1bfdea38c": Phase="Pending", Reason="", readiness=false. Elapsed: 1.851677ms Aug 18 11:27:22.854: INFO: Pod "downwardapi-volume-08b4b179-5b69-495c-88ef-77b1bfdea38c": Phase="Pending", Reason="", readiness=false. Elapsed: 2.004747713s Aug 18 11:27:24.857: INFO: Pod "downwardapi-volume-08b4b179-5b69-495c-88ef-77b1bfdea38c": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.007530055s STEP: Saw pod success Aug 18 11:27:24.857: INFO: Pod "downwardapi-volume-08b4b179-5b69-495c-88ef-77b1bfdea38c" satisfied condition "Succeeded or Failed" Aug 18 11:27:24.859: INFO: Trying to get logs from node node2 pod downwardapi-volume-08b4b179-5b69-495c-88ef-77b1bfdea38c container client-container: STEP: delete the pod Aug 18 11:27:24.879: INFO: Waiting for pod downwardapi-volume-08b4b179-5b69-495c-88ef-77b1bfdea38c to disappear Aug 18 11:27:24.881: INFO: Pod downwardapi-volume-08b4b179-5b69-495c-88ef-77b1bfdea38c no longer exists [AfterEach] [sig-storage] Projected downwardAPI /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:27:24.881: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "projected-7934" for this suite. • ------------------------------ {"msg":"PASSED [sig-storage] Projected downwardAPI should provide container's cpu limit [NodeConformance] [Conformance]","total":-1,"completed":16,"skipped":322,"failed":0} S ------------------------------ [BeforeEach] [sig-apps] StatefulSet /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:25:59.437: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename statefulset STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-apps] StatefulSet /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/statefulset.go:88 [BeforeEach] [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/statefulset.go:103 STEP: Creating service test in namespace statefulset-4843 [It] Scaling should happen in predictable order and halt if any stateful pod is unhealthy [Slow] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Initializing watcher for selector baz=blah,foo=bar STEP: Creating stateful set ss in namespace statefulset-4843 STEP: Waiting until all stateful set ss replicas will be running in namespace statefulset-4843 Aug 18 11:25:59.480: INFO: Found 0 stateful pods, waiting for 1 Aug 18 11:26:09.483: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Running - Ready=true STEP: Confirming that stateful set scale up will halt with unhealthy stateful pod Aug 18 11:26:09.485: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=statefulset-4843 exec ss-0 -- /bin/sh -x -c mv -v /usr/local/apache2/htdocs/index.html /tmp/ || true' Aug 18 11:26:09.980: INFO: stderr: "+ mv -v /usr/local/apache2/htdocs/index.html /tmp/\n" Aug 18 11:26:09.980: INFO: stdout: "'/usr/local/apache2/htdocs/index.html' -> '/tmp/index.html'\n" Aug 18 11:26:09.980: INFO: stdout of mv -v /usr/local/apache2/htdocs/index.html /tmp/ || true on ss-0: '/usr/local/apache2/htdocs/index.html' -> '/tmp/index.html' Aug 18 11:26:09.983: INFO: Waiting for pod ss-0 to enter Running - Ready=false, currently Running - Ready=true Aug 18 11:26:19.986: INFO: Waiting for pod ss-0 to enter Running - Ready=false, currently Running - Ready=false Aug 18 11:26:19.986: INFO: Waiting for statefulset status.replicas updated to 0 Aug 18 11:26:19.996: INFO: Verifying statefulset ss doesn't scale past 1 for another 9.99999952s Aug 18 11:26:20.999: INFO: Verifying statefulset ss doesn't scale past 1 for another 8.997771289s Aug 18 11:26:22.002: INFO: Verifying statefulset ss doesn't scale past 1 for another 7.994822549s Aug 18 11:26:23.006: INFO: Verifying statefulset ss doesn't scale past 1 for another 6.990792848s Aug 18 11:26:24.009: INFO: Verifying statefulset ss doesn't scale past 1 for another 5.98707054s Aug 18 11:26:25.013: INFO: Verifying statefulset ss doesn't scale past 1 for another 4.983861317s Aug 18 11:26:26.018: INFO: Verifying statefulset ss doesn't scale past 1 for another 3.979374425s Aug 18 11:26:27.023: INFO: Verifying statefulset ss doesn't scale past 1 for another 2.973821581s Aug 18 11:26:28.027: INFO: Verifying statefulset ss doesn't scale past 1 for another 1.970130222s Aug 18 11:26:29.030: INFO: Verifying statefulset ss doesn't scale past 1 for another 966.44855ms STEP: Scaling up stateful set ss to 3 replicas and waiting until all of them will be running in namespace statefulset-4843 Aug 18 11:26:30.034: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=statefulset-4843 exec ss-0 -- /bin/sh -x -c mv -v /tmp/index.html /usr/local/apache2/htdocs/ || true' Aug 18 11:26:30.539: INFO: stderr: "+ mv -v /tmp/index.html /usr/local/apache2/htdocs/\n" Aug 18 11:26:30.539: INFO: stdout: "'/tmp/index.html' -> '/usr/local/apache2/htdocs/index.html'\n" Aug 18 11:26:30.539: INFO: stdout of mv -v /tmp/index.html /usr/local/apache2/htdocs/ || true on ss-0: '/tmp/index.html' -> '/usr/local/apache2/htdocs/index.html' Aug 18 11:26:30.541: INFO: Found 1 stateful pods, waiting for 3 Aug 18 11:26:40.544: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Running - Ready=true Aug 18 11:26:40.544: INFO: Waiting for pod ss-1 to enter Running - Ready=true, currently Running - Ready=true Aug 18 11:26:40.544: INFO: Waiting for pod ss-2 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:26:50.545: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Running - Ready=true Aug 18 11:26:50.545: INFO: Waiting for pod ss-1 to enter Running - Ready=true, currently Running - Ready=true Aug 18 11:26:50.545: INFO: Waiting for pod ss-2 to enter Running - Ready=true, currently Running - Ready=true STEP: Verifying that stateful set ss was scaled up in order STEP: Scale down will halt with unhealthy stateful pod Aug 18 11:26:50.551: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=statefulset-4843 exec ss-0 -- /bin/sh -x -c mv -v /usr/local/apache2/htdocs/index.html /tmp/ || true' Aug 18 11:26:50.857: INFO: stderr: "+ mv -v /usr/local/apache2/htdocs/index.html /tmp/\n" Aug 18 11:26:50.857: INFO: stdout: "'/usr/local/apache2/htdocs/index.html' -> '/tmp/index.html'\n" Aug 18 11:26:50.857: INFO: stdout of mv -v /usr/local/apache2/htdocs/index.html /tmp/ || true on ss-0: '/usr/local/apache2/htdocs/index.html' -> '/tmp/index.html' Aug 18 11:26:50.857: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=statefulset-4843 exec ss-1 -- /bin/sh -x -c mv -v /usr/local/apache2/htdocs/index.html /tmp/ || true' Aug 18 11:26:51.160: INFO: stderr: "+ mv -v /usr/local/apache2/htdocs/index.html /tmp/\n" Aug 18 11:26:51.160: INFO: stdout: "'/usr/local/apache2/htdocs/index.html' -> '/tmp/index.html'\n" Aug 18 11:26:51.160: INFO: stdout of mv -v /usr/local/apache2/htdocs/index.html /tmp/ || true on ss-1: '/usr/local/apache2/htdocs/index.html' -> '/tmp/index.html' Aug 18 11:26:51.160: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=statefulset-4843 exec ss-2 -- /bin/sh -x -c mv -v /usr/local/apache2/htdocs/index.html /tmp/ || true' Aug 18 11:26:51.420: INFO: stderr: "+ mv -v /usr/local/apache2/htdocs/index.html /tmp/\n" Aug 18 11:26:51.420: INFO: stdout: "'/usr/local/apache2/htdocs/index.html' -> '/tmp/index.html'\n" Aug 18 11:26:51.420: INFO: stdout of mv -v /usr/local/apache2/htdocs/index.html /tmp/ || true on ss-2: '/usr/local/apache2/htdocs/index.html' -> '/tmp/index.html' Aug 18 11:26:51.420: INFO: Waiting for statefulset status.replicas updated to 0 Aug 18 11:26:51.423: INFO: Waiting for stateful set status.readyReplicas to become 0, currently 2 Aug 18 11:27:01.429: INFO: Waiting for pod ss-0 to enter Running - Ready=false, currently Running - Ready=false Aug 18 11:27:01.429: INFO: Waiting for pod ss-1 to enter Running - Ready=false, currently Running - Ready=false Aug 18 11:27:01.429: INFO: Waiting for pod ss-2 to enter Running - Ready=false, currently Running - Ready=false Aug 18 11:27:01.439: INFO: Verifying statefulset ss doesn't scale past 3 for another 9.999999478s Aug 18 11:27:02.442: INFO: Verifying statefulset ss doesn't scale past 3 for another 8.996298752s Aug 18 11:27:03.447: INFO: Verifying statefulset ss doesn't scale past 3 for another 7.993131261s Aug 18 11:27:04.451: INFO: Verifying statefulset ss doesn't scale past 3 for another 6.987836021s Aug 18 11:27:05.454: INFO: Verifying statefulset ss doesn't scale past 3 for another 5.984349631s Aug 18 11:27:06.457: INFO: Verifying statefulset ss doesn't scale past 3 for another 4.980740247s Aug 18 11:27:07.461: INFO: Verifying statefulset ss doesn't scale past 3 for another 3.977467151s Aug 18 11:27:08.464: INFO: Verifying statefulset ss doesn't scale past 3 for another 2.973911522s Aug 18 11:27:09.467: INFO: Verifying statefulset ss doesn't scale past 3 for another 1.970459343s Aug 18 11:27:10.471: INFO: Verifying statefulset ss doesn't scale past 3 for another 967.807004ms STEP: Scaling down stateful set ss to 0 replicas and waiting until none of pods will run in namespacestatefulset-4843 Aug 18 11:27:11.474: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=statefulset-4843 exec ss-0 -- /bin/sh -x -c mv -v /tmp/index.html /usr/local/apache2/htdocs/ || true' Aug 18 11:27:11.788: INFO: stderr: "+ mv -v /tmp/index.html /usr/local/apache2/htdocs/\n" Aug 18 11:27:11.788: INFO: stdout: "'/tmp/index.html' -> '/usr/local/apache2/htdocs/index.html'\n" Aug 18 11:27:11.788: INFO: stdout of mv -v /tmp/index.html /usr/local/apache2/htdocs/ || true on ss-0: '/tmp/index.html' -> '/usr/local/apache2/htdocs/index.html' Aug 18 11:27:11.788: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=statefulset-4843 exec ss-1 -- /bin/sh -x -c mv -v /tmp/index.html /usr/local/apache2/htdocs/ || true' Aug 18 11:27:12.051: INFO: stderr: "+ mv -v /tmp/index.html /usr/local/apache2/htdocs/\n" Aug 18 11:27:12.051: INFO: stdout: "'/tmp/index.html' -> '/usr/local/apache2/htdocs/index.html'\n" Aug 18 11:27:12.051: INFO: stdout of mv -v /tmp/index.html /usr/local/apache2/htdocs/ || true on ss-1: '/tmp/index.html' -> '/usr/local/apache2/htdocs/index.html' Aug 18 11:27:12.051: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=statefulset-4843 exec ss-2 -- /bin/sh -x -c mv -v /tmp/index.html /usr/local/apache2/htdocs/ || true' Aug 18 11:27:12.305: INFO: stderr: "+ mv -v /tmp/index.html /usr/local/apache2/htdocs/\n" Aug 18 11:27:12.305: INFO: stdout: "'/tmp/index.html' -> '/usr/local/apache2/htdocs/index.html'\n" Aug 18 11:27:12.305: INFO: stdout of mv -v /tmp/index.html /usr/local/apache2/htdocs/ || true on ss-2: '/tmp/index.html' -> '/usr/local/apache2/htdocs/index.html' Aug 18 11:27:12.305: INFO: Scaling statefulset ss to 0 STEP: Verifying that stateful set ss was scaled down in reverse order [AfterEach] [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/statefulset.go:114 Aug 18 11:27:32.319: INFO: Deleting all statefulset in ns statefulset-4843 Aug 18 11:27:32.322: INFO: Scaling statefulset ss to 0 Aug 18 11:27:32.331: INFO: Waiting for statefulset status.replicas updated to 0 Aug 18 11:27:32.333: INFO: Deleting statefulset ss [AfterEach] [sig-apps] StatefulSet /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:27:32.343: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "statefulset-4843" for this suite. • [SLOW TEST:92.913 seconds] [sig-apps] StatefulSet /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/framework.go:23 [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 Scaling should happen in predictable order and halt if any stateful pod is unhealthy [Slow] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-apps] StatefulSet [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] Scaling should happen in predictable order and halt if any stateful pod is unhealthy [Slow] [Conformance]","total":-1,"completed":3,"skipped":45,"failed":0} SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-api-machinery] ResourceQuota /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:27:24.688: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename resourcequota STEP: Waiting for a default service account to be provisioned in namespace [It] should create a ResourceQuota and capture the life of a pod. [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Counting existing ResourceQuota STEP: Creating a ResourceQuota STEP: Ensuring resource quota status is calculated STEP: Creating a Pod that fits quota STEP: Ensuring ResourceQuota status captures the pod usage STEP: Not allowing a pod to be created that exceeds remaining quota STEP: Not allowing a pod to be created that exceeds remaining quota(validation on extended resources) STEP: Ensuring a pod cannot update its resource requirements STEP: Ensuring attempts to update pod resource requirements did not change quota usage STEP: Deleting the pod STEP: Ensuring resource quota status released the pod usage [AfterEach] [sig-api-machinery] ResourceQuota /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:27:37.895: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "resourcequota-9736" for this suite. • [SLOW TEST:13.217 seconds] [sig-api-machinery] ResourceQuota /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23 should create a ResourceQuota and capture the life of a pod. [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-api-machinery] ResourceQuota should create a ResourceQuota and capture the life of a pod. [Conformance]","total":-1,"completed":15,"skipped":279,"failed":0} S ------------------------------ [BeforeEach] [sig-api-machinery] CustomResourceDefinition Watch [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:26:40.720: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename crd-watch STEP: Waiting for a default service account to be provisioned in namespace [It] watch on custom resource definition objects [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:26:40.740: INFO: >>> kubeConfig: /root/.kube/config STEP: Creating first CR Aug 18 11:26:45.793: INFO: Got : ADDED &{map[apiVersion:mygroup.example.com/v1beta1 content:map[key:value] kind:WishIHadChosenNoxu metadata:map[creationTimestamp:2021-08-18T11:26:45Z generation:1 managedFields:[map[apiVersion:mygroup.example.com/v1beta1 fieldsType:FieldsV1 fieldsV1:map[f:content:map[.:map[] f:key:map[]] f:num:map[.:map[] f:num1:map[] f:num2:map[]]] manager:e2e.test operation:Update time:2021-08-18T11:26:45Z]] name:name1 resourceVersion:56325 selfLink:/apis/mygroup.example.com/v1beta1/noxus/name1 uid:d276ac1e-1496-4b2c-bec6-c77e86c3e634] num:map[num1:9223372036854775807 num2:1000000]]} STEP: Creating second CR Aug 18 11:26:55.797: INFO: Got : ADDED &{map[apiVersion:mygroup.example.com/v1beta1 content:map[key:value] kind:WishIHadChosenNoxu metadata:map[creationTimestamp:2021-08-18T11:26:55Z generation:1 managedFields:[map[apiVersion:mygroup.example.com/v1beta1 fieldsType:FieldsV1 fieldsV1:map[f:content:map[.:map[] f:key:map[]] f:num:map[.:map[] f:num1:map[] f:num2:map[]]] manager:e2e.test operation:Update time:2021-08-18T11:26:55Z]] name:name2 resourceVersion:56645 selfLink:/apis/mygroup.example.com/v1beta1/noxus/name2 uid:0142e1d0-ed27-4031-84a1-95e794c13d81] num:map[num1:9223372036854775807 num2:1000000]]} STEP: Modifying first CR Aug 18 11:27:05.806: INFO: Got : MODIFIED &{map[apiVersion:mygroup.example.com/v1beta1 content:map[key:value] dummy:test kind:WishIHadChosenNoxu metadata:map[creationTimestamp:2021-08-18T11:26:45Z generation:2 managedFields:[map[apiVersion:mygroup.example.com/v1beta1 fieldsType:FieldsV1 fieldsV1:map[f:content:map[.:map[] f:key:map[]] f:dummy:map[] f:num:map[.:map[] f:num1:map[] f:num2:map[]]] manager:e2e.test operation:Update time:2021-08-18T11:27:05Z]] name:name1 resourceVersion:56987 selfLink:/apis/mygroup.example.com/v1beta1/noxus/name1 uid:d276ac1e-1496-4b2c-bec6-c77e86c3e634] num:map[num1:9223372036854775807 num2:1000000]]} STEP: Modifying second CR Aug 18 11:27:15.812: INFO: Got : MODIFIED &{map[apiVersion:mygroup.example.com/v1beta1 content:map[key:value] dummy:test kind:WishIHadChosenNoxu metadata:map[creationTimestamp:2021-08-18T11:26:55Z generation:2 managedFields:[map[apiVersion:mygroup.example.com/v1beta1 fieldsType:FieldsV1 fieldsV1:map[f:content:map[.:map[] f:key:map[]] f:dummy:map[] f:num:map[.:map[] f:num1:map[] f:num2:map[]]] manager:e2e.test operation:Update time:2021-08-18T11:27:15Z]] name:name2 resourceVersion:57336 selfLink:/apis/mygroup.example.com/v1beta1/noxus/name2 uid:0142e1d0-ed27-4031-84a1-95e794c13d81] num:map[num1:9223372036854775807 num2:1000000]]} STEP: Deleting first CR Aug 18 11:27:25.825: INFO: Got : DELETED &{map[apiVersion:mygroup.example.com/v1beta1 content:map[key:value] dummy:test kind:WishIHadChosenNoxu metadata:map[creationTimestamp:2021-08-18T11:26:45Z generation:2 managedFields:[map[apiVersion:mygroup.example.com/v1beta1 fieldsType:FieldsV1 fieldsV1:map[f:content:map[.:map[] f:key:map[]] f:dummy:map[] f:num:map[.:map[] f:num1:map[] f:num2:map[]]] manager:e2e.test operation:Update time:2021-08-18T11:27:05Z]] name:name1 resourceVersion:57605 selfLink:/apis/mygroup.example.com/v1beta1/noxus/name1 uid:d276ac1e-1496-4b2c-bec6-c77e86c3e634] num:map[num1:9223372036854775807 num2:1000000]]} STEP: Deleting second CR Aug 18 11:27:35.833: INFO: Got : DELETED &{map[apiVersion:mygroup.example.com/v1beta1 content:map[key:value] dummy:test kind:WishIHadChosenNoxu metadata:map[creationTimestamp:2021-08-18T11:26:55Z generation:2 managedFields:[map[apiVersion:mygroup.example.com/v1beta1 fieldsType:FieldsV1 fieldsV1:map[f:content:map[.:map[] f:key:map[]] f:dummy:map[] f:num:map[.:map[] f:num1:map[] f:num2:map[]]] manager:e2e.test operation:Update time:2021-08-18T11:27:15Z]] name:name2 resourceVersion:57744 selfLink:/apis/mygroup.example.com/v1beta1/noxus/name2 uid:0142e1d0-ed27-4031-84a1-95e794c13d81] num:map[num1:9223372036854775807 num2:1000000]]} [AfterEach] [sig-api-machinery] CustomResourceDefinition Watch [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:27:46.344: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "crd-watch-4743" for this suite. • [SLOW TEST:65.634 seconds] [sig-api-machinery] CustomResourceDefinition Watch [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23 CustomResourceDefinition Watch /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/crd_watch.go:42 watch on custom resource definition objects [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-api-machinery] CustomResourceDefinition Watch [Privileged:ClusterAdmin] CustomResourceDefinition Watch watch on custom resource definition objects [Conformance]","total":-1,"completed":7,"skipped":50,"failed":0} [BeforeEach] [sig-api-machinery] Garbage collector /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:27:46.357: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename gc STEP: Waiting for a default service account to be provisioned in namespace [It] should not delete dependents that have both valid owner and owner that's waiting for dependents to be deleted [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: create the rc1 STEP: create the rc2 STEP: set half of pods created by rc simpletest-rc-to-be-deleted to have rc simpletest-rc-to-stay as owner as well STEP: delete the rc simpletest-rc-to-be-deleted STEP: wait for the rc to be deleted STEP: Gathering metrics W0818 11:27:56.456507 34 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:28:58.473: INFO: MetricsGrabber failed grab metrics. Skipping metrics gathering. Aug 18 11:28:58.473: INFO: Deleting pod "simpletest-rc-to-be-deleted-4gdzg" in namespace "gc-3552" Aug 18 11:28:58.481: INFO: Deleting pod "simpletest-rc-to-be-deleted-6ltzc" in namespace "gc-3552" Aug 18 11:28:58.488: INFO: Deleting pod "simpletest-rc-to-be-deleted-fwzt5" in namespace "gc-3552" Aug 18 11:28:58.494: INFO: Deleting pod "simpletest-rc-to-be-deleted-mgg89" in namespace "gc-3552" Aug 18 11:28:58.502: INFO: Deleting pod "simpletest-rc-to-be-deleted-pzgt9" in namespace "gc-3552" [AfterEach] [sig-api-machinery] Garbage collector /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:28:58.508: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "gc-3552" for this suite. • [SLOW TEST:72.158 seconds] [sig-api-machinery] Garbage collector /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23 should not delete dependents that have both valid owner and owner that's waiting for dependents to be deleted [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-api-machinery] Garbage collector should not delete dependents that have both valid owner and owner that's waiting for dependents to be deleted [Conformance]","total":-1,"completed":8,"skipped":50,"failed":0} SS ------------------------------ [BeforeEach] [k8s.io] Variable Expansion /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:26:55.207: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename var-expansion STEP: Waiting for a default service account to be provisioned in namespace [It] should fail substituting values in a volume subpath with absolute path [sig-storage][Slow] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:28:55.249: INFO: Deleting pod "var-expansion-477f87ac-e2c8-40fd-beca-337971156526" in namespace "var-expansion-9959" Aug 18 11:28:55.254: INFO: Wait up to 5m0s for pod "var-expansion-477f87ac-e2c8-40fd-beca-337971156526" to be fully deleted [AfterEach] [k8s.io] Variable Expansion /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:28:59.260: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "var-expansion-9959" for this suite. • [SLOW TEST:124.062 seconds] [k8s.io] Variable Expansion /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 should fail substituting values in a volume subpath with absolute path [sig-storage][Slow] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [k8s.io] Variable Expansion should fail substituting values in a volume subpath with absolute path [sig-storage][Slow] [Conformance]","total":-1,"completed":11,"skipped":175,"failed":0} SSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-storage] Projected secret /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:28:59.311: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename projected STEP: Waiting for a default service account to be provisioned in namespace [It] should be consumable from pods in volume with mappings [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating projection with secret that has name projected-secret-test-map-1eb8f1fd-220a-4817-b8b4-93d6b8ae8dbc STEP: Creating a pod to test consume secrets Aug 18 11:28:59.349: INFO: Waiting up to 5m0s for pod "pod-projected-secrets-6f18f594-298a-421d-8ead-077933fad774" in namespace "projected-8149" to be "Succeeded or Failed" Aug 18 11:28:59.351: INFO: Pod "pod-projected-secrets-6f18f594-298a-421d-8ead-077933fad774": Phase="Pending", Reason="", readiness=false. Elapsed: 2.556821ms Aug 18 11:29:01.355: INFO: Pod "pod-projected-secrets-6f18f594-298a-421d-8ead-077933fad774": Phase="Pending", Reason="", readiness=false. Elapsed: 2.006799735s Aug 18 11:29:03.361: INFO: Pod "pod-projected-secrets-6f18f594-298a-421d-8ead-077933fad774": Phase="Pending", Reason="", readiness=false. Elapsed: 4.012728772s Aug 18 11:29:05.366: INFO: Pod "pod-projected-secrets-6f18f594-298a-421d-8ead-077933fad774": Phase="Succeeded", Reason="", readiness=false. Elapsed: 6.017861813s STEP: Saw pod success Aug 18 11:29:05.367: INFO: Pod "pod-projected-secrets-6f18f594-298a-421d-8ead-077933fad774" satisfied condition "Succeeded or Failed" Aug 18 11:29:05.369: INFO: Trying to get logs from node node2 pod pod-projected-secrets-6f18f594-298a-421d-8ead-077933fad774 container projected-secret-volume-test: STEP: delete the pod Aug 18 11:29:05.387: INFO: Waiting for pod pod-projected-secrets-6f18f594-298a-421d-8ead-077933fad774 to disappear Aug 18 11:29:05.389: INFO: Pod pod-projected-secrets-6f18f594-298a-421d-8ead-077933fad774 no longer exists [AfterEach] [sig-storage] Projected secret /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:29:05.389: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "projected-8149" for this suite. • [SLOW TEST:6.085 seconds] [sig-storage] Projected secret /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/projected_secret.go:35 should be consumable from pods in volume with mappings [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-storage] Projected secret should be consumable from pods in volume with mappings [NodeConformance] [Conformance]","total":-1,"completed":12,"skipped":194,"failed":0} SSSSSSSSSSS ------------------------------ [BeforeEach] [k8s.io] Variable Expansion /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:27:14.888: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename var-expansion STEP: Waiting for a default service account to be provisioned in namespace [It] should fail substituting values in a volume subpath with backticks [sig-storage][Slow] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:29:14.925: INFO: Deleting pod "var-expansion-f3100b05-6794-43d5-ba4a-b3705569173f" in namespace "var-expansion-5392" Aug 18 11:29:14.931: INFO: Wait up to 5m0s for pod "var-expansion-f3100b05-6794-43d5-ba4a-b3705569173f" to be fully deleted [AfterEach] [k8s.io] Variable Expansion /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:29:18.936: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "var-expansion-5392" for this suite. • [SLOW TEST:124.059 seconds] [k8s.io] Variable Expansion /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 should fail substituting values in a volume subpath with backticks [sig-storage][Slow] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [k8s.io] Variable Expansion should fail substituting values in a volume subpath with backticks [sig-storage][Slow] [Conformance]","total":-1,"completed":10,"skipped":222,"failed":0} SSSSSSSSSSS ------------------------------ [BeforeEach] [sig-auth] Certificates API [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:29:18.975: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename certificates STEP: Waiting for a default service account to be provisioned in namespace [It] should support CSR API operations [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: getting /apis STEP: getting /apis/certificates.k8s.io STEP: getting /apis/certificates.k8s.io/v1 STEP: creating STEP: getting STEP: listing STEP: watching Aug 18 11:29:19.585: INFO: starting watch STEP: patching STEP: updating Aug 18 11:29:19.592: INFO: waiting for watch events with expected annotations Aug 18 11:29:19.592: INFO: saw patched and updated annotations STEP: getting /approval STEP: patching /approval STEP: updating /approval STEP: getting /status STEP: patching /status STEP: updating /status STEP: deleting STEP: deleting a collection [AfterEach] [sig-auth] Certificates API [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:29:19.633: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "certificates-7540" for this suite. • ------------------------------ {"msg":"PASSED [sig-auth] Certificates API [Privileged:ClusterAdmin] should support CSR API operations [Conformance]","total":-1,"completed":11,"skipped":233,"failed":0} SSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [k8s.io] Container Lifecycle Hook /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:29:05.422: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename container-lifecycle-hook STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] when create a pod with lifecycle hook /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/lifecycle_hook.go:64 STEP: create the container to handle the HTTPGet hook request. [It] should execute poststart http hook properly [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: create the pod with lifecycle hook STEP: check poststart hook STEP: delete the pod with lifecycle hook Aug 18 11:29:14.467: INFO: Waiting for pod pod-with-poststart-http-hook to disappear Aug 18 11:29:14.470: INFO: Pod pod-with-poststart-http-hook still exists Aug 18 11:29:16.472: INFO: Waiting for pod pod-with-poststart-http-hook to disappear Aug 18 11:29:16.478: INFO: Pod pod-with-poststart-http-hook still exists Aug 18 11:29:18.471: INFO: Waiting for pod pod-with-poststart-http-hook to disappear Aug 18 11:29:18.474: INFO: Pod pod-with-poststart-http-hook still exists Aug 18 11:29:20.471: INFO: Waiting for pod pod-with-poststart-http-hook to disappear Aug 18 11:29:20.474: INFO: Pod pod-with-poststart-http-hook still exists Aug 18 11:29:22.471: INFO: Waiting for pod pod-with-poststart-http-hook to disappear Aug 18 11:29:22.475: INFO: Pod pod-with-poststart-http-hook no longer exists [AfterEach] [k8s.io] Container Lifecycle Hook /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:29:22.475: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "container-lifecycle-hook-1871" for this suite. • [SLOW TEST:17.063 seconds] [k8s.io] Container Lifecycle Hook /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 when create a pod with lifecycle hook /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/lifecycle_hook.go:42 should execute poststart http hook properly [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [k8s.io] Container Lifecycle Hook when create a pod with lifecycle hook should execute poststart http hook properly [NodeConformance] [Conformance]","total":-1,"completed":13,"skipped":205,"failed":0} SSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-storage] EmptyDir wrapper volumes /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:29:19.690: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename emptydir-wrapper STEP: Waiting for a default service account to be provisioned in namespace [It] should not conflict [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Cleaning up the secret STEP: Cleaning up the configmap STEP: Cleaning up the pod [AfterEach] [sig-storage] EmptyDir wrapper volumes /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:29:23.760: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "emptydir-wrapper-5794" for this suite. • ------------------------------ {"msg":"PASSED [sig-storage] EmptyDir wrapper volumes should not conflict [Conformance]","total":-1,"completed":12,"skipped":257,"failed":0} SSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:29:22.542: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename crd-publish-openapi STEP: Waiting for a default service account to be provisioned in namespace [It] works for multiple CRDs of different groups [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: CRs in different groups (two CRDs) show up in OpenAPI documentation Aug 18 11:29:22.566: INFO: >>> kubeConfig: /root/.kube/config Aug 18 11:29:30.437: INFO: >>> kubeConfig: /root/.kube/config [AfterEach] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:29:47.077: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "crd-publish-openapi-9754" for this suite. • [SLOW TEST:24.543 seconds] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23 works for multiple CRDs of different groups [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] works for multiple CRDs of different groups [Conformance]","total":-1,"completed":14,"skipped":228,"failed":0} SSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-apps] StatefulSet /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:25:14.075: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename statefulset Aug 18 11:25:14.092: INFO: Found PodSecurityPolicies; testing pod creation to see if PodSecurityPolicy is enabled Aug 18 11:25:14.093: INFO: Error creating dryrun pod; assuming PodSecurityPolicy is disabled: admission webhook "cmk.intel.com" does not support dry run STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-apps] StatefulSet /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/statefulset.go:88 [BeforeEach] [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/statefulset.go:103 STEP: Creating service test in namespace statefulset-4763 [It] Should recreate evicted statefulset [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Looking for a node to schedule stateful set and pod STEP: Creating pod with conflicting port in namespace statefulset-4763 STEP: Creating statefulset with conflicting port in namespace statefulset-4763 STEP: Waiting until pod test-pod will start running in namespace statefulset-4763 STEP: Waiting until stateful pod ss-0 will be recreated and deleted at least once in namespace statefulset-4763 Aug 18 11:30:26.135: FAIL: Pod ss-0 expected to be re-created at least once Full Stack Trace k8s.io/kubernetes/test/e2e/apps.glob..func10.2.12() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/statefulset.go:809 +0x1258 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc00359cc00) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc00359cc00) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc00359cc00, 0x4deb2c0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/statefulset.go:114 Aug 18 11:30:26.140: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=statefulset-4763 describe po test-pod' Aug 18 11:30:26.311: INFO: stderr: "" Aug 18 11:30:26.311: INFO: stdout: "Name: test-pod\nNamespace: statefulset-4763\nPriority: 0\nNode: node2/10.10.190.208\nStart Time: Wed, 18 Aug 2021 11:25:14 +0000\nLabels: \nAnnotations: k8s.v1.cni.cncf.io/network-status:\n [{\n \"name\": \"default-cni-network\",\n \"interface\": \"eth0\",\n \"ips\": [\n \"10.244.3.192\"\n ],\n \"mac\": \"86:71:87:34:67:4d\",\n \"default\": true,\n \"dns\": {}\n }]\n k8s.v1.cni.cncf.io/networks-status:\n [{\n \"name\": \"default-cni-network\",\n \"interface\": \"eth0\",\n \"ips\": [\n \"10.244.3.192\"\n ],\n \"mac\": \"86:71:87:34:67:4d\",\n \"default\": true,\n \"dns\": {}\n }]\n kubernetes.io/psp: privileged\nStatus: Running\nIP: 10.244.3.192\nIPs:\n IP: 10.244.3.192\nContainers:\n webserver:\n Container ID: docker://d8ef71077b758182862cd26fd29851f18e3fcfb5553277a0775ea2750cc42e29\n Image: docker.io/library/httpd:2.4.38-alpine\n Image ID: docker-pullable://httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060\n Port: 21017/TCP\n Host Port: 21017/TCP\n State: Running\n Started: Wed, 18 Aug 2021 11:25:24 +0000\n Ready: True\n Restart Count: 0\n Environment: \n Mounts:\n /var/run/secrets/kubernetes.io/serviceaccount from default-token-5rk2s (ro)\nConditions:\n Type Status\n Initialized True \n Ready True \n ContainersReady True \n PodScheduled True \nVolumes:\n default-token-5rk2s:\n Type: Secret (a volume populated by a Secret)\n SecretName: default-token-5rk2s\n Optional: false\nQoS Class: BestEffort\nNode-Selectors: \nTolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s\n node.kubernetes.io/unreachable:NoExecute op=Exists for 300s\nEvents:\n Type Reason Age From Message\n ---- ------ ---- ---- -------\n Normal AddedInterface 5m7s multus Add eth0 [10.244.3.192/24]\n Normal Pulling 5m7s kubelet Pulling image \"docker.io/library/httpd:2.4.38-alpine\"\n Normal Pulled 5m2s kubelet Successfully pulled image \"docker.io/library/httpd:2.4.38-alpine\" in 5.287333756s\n Normal Created 5m2s kubelet Created container webserver\n Normal Started 5m2s kubelet Started container webserver\n" Aug 18 11:30:26.311: INFO: Output of kubectl describe test-pod: Name: test-pod Namespace: statefulset-4763 Priority: 0 Node: node2/10.10.190.208 Start Time: Wed, 18 Aug 2021 11:25:14 +0000 Labels: Annotations: k8s.v1.cni.cncf.io/network-status: [{ "name": "default-cni-network", "interface": "eth0", "ips": [ "10.244.3.192" ], "mac": "86:71:87:34:67:4d", "default": true, "dns": {} }] k8s.v1.cni.cncf.io/networks-status: [{ "name": "default-cni-network", "interface": "eth0", "ips": [ "10.244.3.192" ], "mac": "86:71:87:34:67:4d", "default": true, "dns": {} }] kubernetes.io/psp: privileged Status: Running IP: 10.244.3.192 IPs: IP: 10.244.3.192 Containers: webserver: Container ID: docker://d8ef71077b758182862cd26fd29851f18e3fcfb5553277a0775ea2750cc42e29 Image: docker.io/library/httpd:2.4.38-alpine Image ID: docker-pullable://httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 Port: 21017/TCP Host Port: 21017/TCP State: Running Started: Wed, 18 Aug 2021 11:25:24 +0000 Ready: True Restart Count: 0 Environment: Mounts: /var/run/secrets/kubernetes.io/serviceaccount from default-token-5rk2s (ro) Conditions: Type Status Initialized True Ready True ContainersReady True PodScheduled True Volumes: default-token-5rk2s: Type: Secret (a volume populated by a Secret) SecretName: default-token-5rk2s Optional: false QoS Class: BestEffort Node-Selectors: Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s node.kubernetes.io/unreachable:NoExecute op=Exists for 300s Events: Type Reason Age From Message ---- ------ ---- ---- ------- Normal AddedInterface 5m7s multus Add eth0 [10.244.3.192/24] Normal Pulling 5m7s kubelet Pulling image "docker.io/library/httpd:2.4.38-alpine" Normal Pulled 5m2s kubelet Successfully pulled image "docker.io/library/httpd:2.4.38-alpine" in 5.287333756s Normal Created 5m2s kubelet Created container webserver Normal Started 5m2s kubelet Started container webserver Aug 18 11:30:26.311: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=statefulset-4763 logs test-pod --tail=100' Aug 18 11:30:26.478: INFO: stderr: "" Aug 18 11:30:26.478: INFO: stdout: "AH00558: httpd: Could not reliably determine the server's fully qualified domain name, using 10.244.3.192. Set the 'ServerName' directive globally to suppress this message\nAH00558: httpd: Could not reliably determine the server's fully qualified domain name, using 10.244.3.192. Set the 'ServerName' directive globally to suppress this message\n[Wed Aug 18 11:25:25.010217 2021] [mpm_event:notice] [pid 1:tid 140259911031656] AH00489: Apache/2.4.38 (Unix) configured -- resuming normal operations\n[Wed Aug 18 11:25:25.010256 2021] [core:notice] [pid 1:tid 140259911031656] AH00094: Command line: 'httpd -D FOREGROUND'\n" Aug 18 11:30:26.478: INFO: Last 100 log lines of test-pod: AH00558: httpd: Could not reliably determine the server's fully qualified domain name, using 10.244.3.192. Set the 'ServerName' directive globally to suppress this message AH00558: httpd: Could not reliably determine the server's fully qualified domain name, using 10.244.3.192. Set the 'ServerName' directive globally to suppress this message [Wed Aug 18 11:25:25.010217 2021] [mpm_event:notice] [pid 1:tid 140259911031656] AH00489: Apache/2.4.38 (Unix) configured -- resuming normal operations [Wed Aug 18 11:25:25.010256 2021] [core:notice] [pid 1:tid 140259911031656] AH00094: Command line: 'httpd -D FOREGROUND' Aug 18 11:30:26.478: INFO: Deleting all statefulset in ns statefulset-4763 Aug 18 11:30:26.481: INFO: Scaling statefulset ss to 0 Aug 18 11:30:26.489: INFO: Waiting for statefulset status.replicas updated to 0 Aug 18 11:30:36.496: INFO: Deleting statefulset ss [AfterEach] [sig-apps] StatefulSet /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "statefulset-4763". STEP: Found 8 events. Aug 18 11:30:36.507: INFO: At 2021-08-18 11:25:14 +0000 UTC - event for ss: {statefulset-controller } FailedCreate: create Pod ss-0 in StatefulSet ss failed error: pods "ss-0" is forbidden: PodSecurityPolicy: unable to admit pod: [spec.containers[0].hostPort: Invalid value: 21017: Host port 21017 is not allowed to be used. Allowed ports: [9103-9104] spec.containers[0].hostPort: Invalid value: 21017: Host port 21017 is not allowed to be used. Allowed ports: [9100] spec.containers[0].hostPort: Invalid value: 21017: Host port 21017 is not allowed to be used. Allowed ports: []] Aug 18 11:30:36.508: INFO: At 2021-08-18 11:25:14 +0000 UTC - event for ss: {statefulset-controller } FailedCreate: create Pod ss-0 in StatefulSet ss failed error: pods "ss-0" is forbidden: PodSecurityPolicy: unable to admit pod: [spec.containers[0].hostPort: Invalid value: 21017: Host port 21017 is not allowed to be used. Allowed ports: [9100] spec.containers[0].hostPort: Invalid value: 21017: Host port 21017 is not allowed to be used. Allowed ports: [] spec.containers[0].hostPort: Invalid value: 21017: Host port 21017 is not allowed to be used. Allowed ports: [9103-9104]] Aug 18 11:30:36.508: INFO: At 2021-08-18 11:25:14 +0000 UTC - event for ss: {statefulset-controller } FailedCreate: create Pod ss-0 in StatefulSet ss failed error: pods "ss-0" is forbidden: PodSecurityPolicy: unable to admit pod: [spec.containers[0].hostPort: Invalid value: 21017: Host port 21017 is not allowed to be used. Allowed ports: [] spec.containers[0].hostPort: Invalid value: 21017: Host port 21017 is not allowed to be used. Allowed ports: [9103-9104] spec.containers[0].hostPort: Invalid value: 21017: Host port 21017 is not allowed to be used. Allowed ports: [9100]] Aug 18 11:30:36.508: INFO: At 2021-08-18 11:25:19 +0000 UTC - event for test-pod: {multus } AddedInterface: Add eth0 [10.244.3.192/24] Aug 18 11:30:36.508: INFO: At 2021-08-18 11:25:19 +0000 UTC - event for test-pod: {kubelet node2} Pulling: Pulling image "docker.io/library/httpd:2.4.38-alpine" Aug 18 11:30:36.508: INFO: At 2021-08-18 11:25:24 +0000 UTC - event for test-pod: {kubelet node2} Pulled: Successfully pulled image "docker.io/library/httpd:2.4.38-alpine" in 5.287333756s Aug 18 11:30:36.508: INFO: At 2021-08-18 11:25:24 +0000 UTC - event for test-pod: {kubelet node2} Created: Created container webserver Aug 18 11:30:36.508: INFO: At 2021-08-18 11:25:24 +0000 UTC - event for test-pod: {kubelet node2} Started: Started container webserver Aug 18 11:30:36.510: INFO: POD NODE PHASE GRACE CONDITIONS Aug 18 11:30:36.510: INFO: test-pod node2 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:25:14 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:25:26 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:25:26 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:25:14 +0000 UTC }] Aug 18 11:30:36.510: INFO: Aug 18 11:30:36.513: INFO: Logging node info for node master1 Aug 18 11:30:36.515: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 ebb211fa-503f-4cfe-b1ed-c95d27a70e6e 59339 0 2021-08-18 08:20:52 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"3a:82:be:72:b5:15"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:20:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:20:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:25:59 +0000 UTC,LastTransitionTime:2021-08-18 08:25:59 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:30:33 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:30:33 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:30:33 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:30:33 +0000 UTC,LastTransitionTime:2021-08-18 08:25:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:58c3e57359b641ad92fa1959f2fecf5d,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:012cd796-2076-45d6-8b14-d3e0451b1e64,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[@ :],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:30:36.516: INFO: Logging kubelet events for node master1 Aug 18 11:30:36.518: INFO: Logging pods the kubelet thinks is on node master1 Aug 18 11:30:36.532: INFO: kube-apiserver-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:30:36.532: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:30:36.532: INFO: kube-proxy-vqk4v started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:30:36.532: INFO: Container kube-proxy ready: true, restart count 1 Aug 18 11:30:36.532: INFO: kube-flannel-q64cq started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:30:36.532: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:30:36.532: INFO: Container kube-flannel ready: true, restart count 3 Aug 18 11:30:36.532: INFO: coredns-7677f9bb54-kn2qg started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:30:36.532: INFO: Container coredns ready: true, restart count 2 Aug 18 11:30:36.532: INFO: kube-scheduler-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:30:36.532: INFO: Container kube-scheduler ready: true, restart count 0 Aug 18 11:30:36.532: INFO: kube-controller-manager-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:30:36.532: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:30:36.532: INFO: kube-multus-ds-amd64-kbcp6 started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:30:36.532: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:30:36.532: INFO: docker-registry-docker-registry-56cbc7bc58-49kl2 started at 2021-08-18 08:26:23 +0000 UTC (0+2 container statuses recorded) Aug 18 11:30:36.532: INFO: Container docker-registry ready: true, restart count 0 Aug 18 11:30:36.532: INFO: Container nginx ready: true, restart count 0 Aug 18 11:30:36.532: INFO: node-exporter-5hwz9 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:30:36.532: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:30:36.532: INFO: Container node-exporter ready: true, restart count 0 W0818 11:30:36.545520 23 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:30:36.570: INFO: Latency metrics for node master1 Aug 18 11:30:36.570: INFO: Logging node info for node master2 Aug 18 11:30:36.572: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 78946293-3abe-4442-84d4-8ed6b1d15ce0 59338 0 2021-08-18 08:21:31 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"7e:f5:c2:cc:3a:b4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:21:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:21:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-08-18 08:29:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:30:31 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:30:31 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:30:31 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:30:31 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0c44122c7a7248c18d8571e1cc667258,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:0cd329f2-48e0-4c8f-b8b9-fa3ae0ed8406,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:30:36.573: INFO: Logging kubelet events for node master2 Aug 18 11:30:36.575: INFO: Logging pods the kubelet thinks is on node master2 Aug 18 11:30:36.589: INFO: kube-controller-manager-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:30:36.589: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:30:36.589: INFO: kube-proxy-kh2l9 started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:30:36.589: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:30:36.589: INFO: kube-flannel-pp56h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:30:36.589: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:30:36.589: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:30:36.589: INFO: kube-apiserver-master2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:30:36.590: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:30:36.590: INFO: kube-scheduler-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:30:36.590: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:30:36.590: INFO: kube-multus-ds-amd64-mld8g started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:30:36.590: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:30:36.590: INFO: dns-autoscaler-5b7b5c9b6f-hh47r started at 2021-08-18 08:23:57 +0000 UTC (0+1 container statuses recorded) Aug 18 11:30:36.590: INFO: Container autoscaler ready: true, restart count 2 Aug 18 11:30:36.590: INFO: node-feature-discovery-controller-5bf5c49849-mq57c started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:30:36.590: INFO: Container nfd-controller ready: true, restart count 0 Aug 18 11:30:36.590: INFO: node-exporter-48nfx started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:30:36.590: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:30:36.590: INFO: Container node-exporter ready: true, restart count 0 W0818 11:30:36.603044 23 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:30:36.632: INFO: Latency metrics for node master2 Aug 18 11:30:36.632: INFO: Logging node info for node master3 Aug 18 11:30:36.634: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 44feac2b-9447-4be2-9fcd-62f836d67c72 59314 0 2021-08-18 08:21:41 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"86:e4:31:99:58:40"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {kubelet Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:30:27 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:30:27 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:30:27 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:30:27 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1fae19ae59884c44899bcd08aa243244,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:5db926c5-6530-4635-a0d5-806974a3b732,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:30:36.634: INFO: Logging kubelet events for node master3 Aug 18 11:30:36.636: INFO: Logging pods the kubelet thinks is on node master3 Aug 18 11:30:36.650: INFO: kube-apiserver-master3 started at 2021-08-18 08:29:12 +0000 UTC (0+1 container statuses recorded) Aug 18 11:30:36.650: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:30:36.650: INFO: kube-proxy-sd5lc started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:30:36.650: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:30:36.650: INFO: kube-flannel-x6tlr started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:30:36.650: INFO: Init container install-cni ready: true, restart count 1 Aug 18 11:30:36.650: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:30:36.650: INFO: kube-multus-ds-amd64-bkw6c started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:30:36.650: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:30:36.650: INFO: coredns-7677f9bb54-5hxfh started at 2021-08-18 08:23:54 +0000 UTC (0+1 container statuses recorded) Aug 18 11:30:36.650: INFO: Container coredns ready: true, restart count 1 Aug 18 11:30:36.650: INFO: node-exporter-vq7d8 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:30:36.650: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:30:36.650: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:30:36.650: INFO: kube-controller-manager-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:30:36.650: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:30:36.650: INFO: kube-scheduler-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:30:36.650: INFO: Container kube-scheduler ready: true, restart count 2 W0818 11:30:36.663777 23 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:30:36.689: INFO: Latency metrics for node master3 Aug 18 11:30:36.689: INFO: Logging node info for node node1 Aug 18 11:30:36.692: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 84defabd-6ebf-43ec-a629-44c6713da9c9 59319 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"9a:87:55:36:7b:df"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:13 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:35 +0000 UTC,LastTransitionTime:2021-08-18 08:26:35 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:30:27 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:30:27 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:30:27 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:30:27 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:69946ff2b7bc462fa25eb7adb4703c23,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:736dc52f-f5e3-494e-86ca-01eedbea015c,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:a7cea43d9d2f67c38fbf0407786edbe660ee9072945f7bb272b55fd255e8eaca opnfv/barometer-collectd:stable],SizeBytes:1075746799,},ContainerImage{Names:[@ :],SizeBytes:1003788820,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[aquasec/kube-hunter@sha256:2be6820bc1d7e0f57193a9a27d5a3e16b2fd93c53747b03ce8ca48c6fc323781 aquasec/kube-hunter:0.3.1],SizeBytes:347611549,},ContainerImage{Names:[golang@sha256:db2475a1dbb2149508e5db31d7d77a75e6600d54be645f37681f03f2762169ba golang:alpine3.12],SizeBytes:301186719,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:de25c7fc6c4f3a27c7f0c2dff454e4671823a34d88abd533f210848d527e0fbb alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:30:36.693: INFO: Logging kubelet events for node node1 Aug 18 11:30:36.695: INFO: Logging pods the kubelet thinks is on node node1 Aug 18 11:30:36.716: INFO: cmk-init-discover-node1-bxznx started at 2021-08-18 08:32:10 +0000 UTC (0+3 container statuses recorded) Aug 18 11:30:36.716: INFO: Container discover ready: false, restart count 0 Aug 18 11:30:36.716: INFO: Container init ready: false, restart count 0 Aug 18 11:30:36.716: INFO: Container install ready: false, restart count 0 Aug 18 11:30:36.716: INFO: cmk-d8r27 started at 2021-08-18 08:32:52 +0000 UTC (0+2 container statuses recorded) Aug 18 11:30:36.716: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:30:36.716: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:30:36.716: INFO: collectd-xdprr started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:30:36.716: INFO: Container collectd ready: true, restart count 0 Aug 18 11:30:36.716: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:30:36.716: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:30:36.716: INFO: ss2-0 started at 2021-08-18 11:26:45 +0000 UTC (0+1 container statuses recorded) Aug 18 11:30:36.716: INFO: Container webserver ready: true, restart count 0 Aug 18 11:30:36.716: INFO: downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25 started at 2021-08-18 11:27:11 +0000 UTC (0+1 container statuses recorded) Aug 18 11:30:36.716: INFO: Container dapi-container ready: false, restart count 0 Aug 18 11:30:36.716: INFO: kube-proxy-p6jvp started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:30:36.716: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:30:36.716: INFO: kubernetes-metrics-scraper-678c97765c-9nsv5 started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:30:36.716: INFO: Container kubernetes-metrics-scraper ready: true, restart count 2 Aug 18 11:30:36.716: INFO: pod-submit-remove-74dabc56-7cc6-4841-8b80-3d7505da846f started at 2021-08-18 11:27:24 +0000 UTC (0+1 container statuses recorded) Aug 18 11:30:36.716: INFO: Container nginx ready: false, restart count 0 Aug 18 11:30:36.716: INFO: nginx-proxy-node1 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:30:36.716: INFO: Container nginx-proxy ready: true, restart count 2 Aug 18 11:30:36.716: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-vsxvg started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:30:36.716: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:30:36.716: INFO: nodeport-test-r5jnt started at 2021-08-18 11:29:23 +0000 UTC (0+1 container statuses recorded) Aug 18 11:30:36.716: INFO: Container nodeport-test ready: true, restart count 0 Aug 18 11:30:36.716: INFO: test-rolling-update-controller-wx48f started at 2021-08-18 11:29:47 +0000 UTC (0+1 container statuses recorded) Aug 18 11:30:36.716: INFO: Container httpd ready: false, restart count 0 Aug 18 11:30:36.716: INFO: ss2-1 started at 2021-08-18 11:26:31 +0000 UTC (0+1 container statuses recorded) Aug 18 11:30:36.716: INFO: Container webserver ready: true, restart count 0 Aug 18 11:30:36.716: INFO: kube-flannel-q78nd started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:30:36.716: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:30:36.716: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:30:36.716: INFO: prometheus-k8s-0 started at 2021-08-18 08:34:03 +0000 UTC (0+5 container statuses recorded) Aug 18 11:30:36.716: INFO: Container custom-metrics-apiserver ready: true, restart count 0 Aug 18 11:30:36.716: INFO: Container grafana ready: true, restart count 0 Aug 18 11:30:36.716: INFO: Container prometheus ready: true, restart count 1 Aug 18 11:30:36.716: INFO: Container prometheus-config-reloader ready: true, restart count 0 Aug 18 11:30:36.716: INFO: Container rules-configmap-reloader ready: true, restart count 0 Aug 18 11:30:36.716: INFO: node-exporter-kcwvn started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:30:36.716: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:30:36.716: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:30:36.716: INFO: pod-init-b68a6dc1-5b80-476f-a5fe-c89c90dac8b1 started at 2021-08-18 11:27:37 +0000 UTC (2+1 container statuses recorded) Aug 18 11:30:36.716: INFO: Init container init1 ready: false, restart count 0 Aug 18 11:30:36.716: INFO: Init container init2 ready: false, restart count 0 Aug 18 11:30:36.716: INFO: Container run1 ready: false, restart count 0 Aug 18 11:30:36.716: INFO: kube-multus-ds-amd64-rrvmb started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:30:36.716: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:30:36.716: INFO: node-feature-discovery-worker-pflgw started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:30:36.716: INFO: Container nfd-worker ready: true, restart count 0 W0818 11:30:36.729550 23 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:30:36.776: INFO: Latency metrics for node node1 Aug 18 11:30:36.776: INFO: Logging node info for node node2 Aug 18 11:30:36.779: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 1d01177e-3dbb-48a1-a0bc-d18af27ab7f8 59330 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:d1:47:f8:1d:22"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:36 +0000 UTC,LastTransitionTime:2021-08-18 08:26:36 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:30:30 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:30:30 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:30:30 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:30:30 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:dc1f286135c145349b8a016880b65a2f,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:037e7e2d-94e9-42f4-a719-896e5005ac70,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:30:36.780: INFO: Logging kubelet events for node node2 Aug 18 11:30:36.782: INFO: Logging pods the kubelet thinks is on node node2 Aug 18 11:30:36.798: INFO: cmk-748rz started at 2021-08-18 08:32:53 +0000 UTC (0+2 container statuses recorded) Aug 18 11:30:36.798: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:30:36.798: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:30:36.798: INFO: node-feature-discovery-worker-hzpf5 started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:30:36.798: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:30:36.798: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-c82pt started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:30:36.798: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:30:36.798: INFO: prometheus-operator-5bb8cb9d8f-k97ws started at 2021-08-18 08:33:38 +0000 UTC (0+2 container statuses recorded) Aug 18 11:30:36.798: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:30:36.798: INFO: Container prometheus-operator ready: true, restart count 0 Aug 18 11:30:36.798: INFO: kube-proxy-qkj9c started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:30:36.798: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:30:36.798: INFO: collectd-67ntq started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:30:36.798: INFO: Container collectd ready: true, restart count 0 Aug 18 11:30:36.798: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:30:36.798: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:30:36.798: INFO: test-pod started at 2021-08-18 11:25:14 +0000 UTC (0+1 container statuses recorded) Aug 18 11:30:36.798: INFO: Container webserver ready: true, restart count 0 Aug 18 11:30:36.798: INFO: var-expansion-cf1f3322-29ba-472a-9702-20756a20f986 started at 2021-08-18 11:28:58 +0000 UTC (0+1 container statuses recorded) Aug 18 11:30:36.798: INFO: Container dapi-container ready: false, restart count 0 Aug 18 11:30:36.798: INFO: nodeport-test-tsczd started at 2021-08-18 11:29:23 +0000 UTC (0+1 container statuses recorded) Aug 18 11:30:36.798: INFO: Container nodeport-test ready: true, restart count 0 Aug 18 11:30:36.798: INFO: kube-multus-ds-amd64-rvzsg started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:30:36.798: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:30:36.798: INFO: execpodz5s5r started at 2021-08-18 11:29:26 +0000 UTC (0+1 container statuses recorded) Aug 18 11:30:36.798: INFO: Container agnhost-container ready: true, restart count 0 Aug 18 11:30:36.798: INFO: cmk-webhook-6c9d5f8578-7cxjr started at 2021-08-18 08:32:53 +0000 UTC (0+1 container statuses recorded) Aug 18 11:30:36.798: INFO: Container cmk-webhook ready: true, restart count 0 Aug 18 11:30:36.798: INFO: node-exporter-lrrf2 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:30:36.798: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:30:36.798: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:30:36.798: INFO: var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15 started at 2021-08-18 11:27:32 +0000 UTC (0+1 container statuses recorded) Aug 18 11:30:36.798: INFO: Container dapi-container ready: false, restart count 0 Aug 18 11:30:36.798: INFO: kube-flannel-h7t5h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:30:36.799: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:30:36.799: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:30:36.799: INFO: cmk-init-discover-node2-6b2kz started at 2021-08-18 08:32:30 +0000 UTC (0+3 container statuses recorded) Aug 18 11:30:36.799: INFO: Container discover ready: false, restart count 0 Aug 18 11:30:36.799: INFO: Container init ready: false, restart count 0 Aug 18 11:30:36.799: INFO: Container install ready: false, restart count 0 Aug 18 11:30:36.799: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-7rn45 started at 2021-08-18 08:36:42 +0000 UTC (0+2 container statuses recorded) Aug 18 11:30:36.799: INFO: Container tas-controller ready: true, restart count 0 Aug 18 11:30:36.799: INFO: Container tas-extender ready: true, restart count 0 Aug 18 11:30:36.799: INFO: ss2-2 started at 2021-08-18 11:27:31 +0000 UTC (0+1 container statuses recorded) Aug 18 11:30:36.799: INFO: Container webserver ready: false, restart count 0 Aug 18 11:30:36.799: INFO: nginx-proxy-node2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:30:36.799: INFO: Container nginx-proxy ready: true, restart count 1 Aug 18 11:30:36.799: INFO: test-rollover-controller-n75gh started at 2021-08-18 11:26:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:30:36.799: INFO: Container httpd ready: false, restart count 0 Aug 18 11:30:36.799: INFO: kubernetes-dashboard-86c6f9df5b-qrtdk started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:30:36.799: INFO: Container kubernetes-dashboard ready: true, restart count 2 W0818 11:30:36.814061 23 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:30:36.846: INFO: Latency metrics for node node2 Aug 18 11:30:36.846: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "statefulset-4763" for this suite. • Failure [322.782 seconds] [sig-apps] StatefulSet /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/framework.go:23 [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 Should recreate evicted statefulset [Conformance] [It] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:30:26.135: Pod ss-0 expected to be re-created at least once /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/statefulset.go:809 ------------------------------ {"msg":"FAILED [sig-apps] StatefulSet [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] Should recreate evicted statefulset [Conformance]","total":-1,"completed":0,"skipped":13,"failed":1,"failures":["[sig-apps] StatefulSet [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] Should recreate evicted statefulset [Conformance]"]} SSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-network] Networking /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:30:36.910: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename pod-network-test STEP: Waiting for a default service account to be provisioned in namespace [It] should function for intra-pod communication: udp [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Performing setup for networking test in namespace pod-network-test-7303 STEP: creating a selector STEP: Creating the service pods in kubernetes Aug 18 11:30:36.931: INFO: Waiting up to 10m0s for all (but 0) nodes to be schedulable Aug 18 11:30:36.969: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Aug 18 11:30:38.972: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Aug 18 11:30:40.972: INFO: The status of Pod netserver-0 is Running (Ready = false) Aug 18 11:30:42.972: INFO: The status of Pod netserver-0 is Running (Ready = false) Aug 18 11:30:44.972: INFO: The status of Pod netserver-0 is Running (Ready = false) Aug 18 11:30:46.973: INFO: The status of Pod netserver-0 is Running (Ready = false) Aug 18 11:30:48.973: INFO: The status of Pod netserver-0 is Running (Ready = false) Aug 18 11:30:50.972: INFO: The status of Pod netserver-0 is Running (Ready = false) Aug 18 11:30:52.972: INFO: The status of Pod netserver-0 is Running (Ready = true) Aug 18 11:30:52.976: INFO: The status of Pod netserver-1 is Running (Ready = false) Aug 18 11:30:54.979: INFO: The status of Pod netserver-1 is Running (Ready = false) Aug 18 11:30:56.979: INFO: The status of Pod netserver-1 is Running (Ready = true) STEP: Creating test pods Aug 18 11:31:01.002: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s 'http://10.244.4.8:8080/dial?request=hostname&protocol=udp&host=10.244.4.5&port=8081&tries=1'] Namespace:pod-network-test-7303 PodName:test-container-pod ContainerName:webserver Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:false} Aug 18 11:31:01.002: INFO: >>> kubeConfig: /root/.kube/config Aug 18 11:31:01.119: INFO: Waiting for responses: map[] Aug 18 11:31:01.122: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s 'http://10.244.4.8:8080/dial?request=hostname&protocol=udp&host=10.244.3.252&port=8081&tries=1'] Namespace:pod-network-test-7303 PodName:test-container-pod ContainerName:webserver Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:false} Aug 18 11:31:01.122: INFO: >>> kubeConfig: /root/.kube/config Aug 18 11:31:01.265: INFO: Waiting for responses: map[] [AfterEach] [sig-network] Networking /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:31:01.265: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "pod-network-test-7303" for this suite. • [SLOW TEST:24.363 seconds] [sig-network] Networking /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/networking.go:26 Granular Checks: Pods /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/networking.go:29 should function for intra-pod communication: udp [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-network] Networking Granular Checks: Pods should function for intra-pod communication: udp [NodeConformance] [Conformance]","total":-1,"completed":1,"skipped":35,"failed":1,"failures":["[sig-apps] StatefulSet [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] Should recreate evicted statefulset [Conformance]"]} SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:31:01.403: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename services STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:782 [It] should test the lifecycle of an Endpoint [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: creating an Endpoint STEP: waiting for available Endpoint STEP: listing all Endpoints STEP: updating the Endpoint STEP: fetching the Endpoint STEP: patching the Endpoint STEP: fetching the Endpoint STEP: deleting the Endpoint by Collection STEP: waiting for Endpoint deletion STEP: fetching the Endpoint [AfterEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:31:01.460: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "services-5026" for this suite. [AfterEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:786 • ------------------------------ {"msg":"PASSED [sig-network] Services should test the lifecycle of an Endpoint [Conformance]","total":-1,"completed":2,"skipped":96,"failed":1,"failures":["[sig-apps] StatefulSet [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] Should recreate evicted statefulset [Conformance]"]} SSSSSSSSSSS ------------------------------ [BeforeEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:29:23.831: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename services STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:782 [It] should be able to create a functioning NodePort service [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: creating service nodeport-test with type=NodePort in namespace services-5233 STEP: creating replication controller nodeport-test in namespace services-5233 I0818 11:29:23.871723 36 runners.go:190] Created replication controller with name: nodeport-test, namespace: services-5233, replica count: 2 I0818 11:29:26.922554 36 runners.go:190] nodeport-test Pods: 2 out of 2 created, 2 running, 0 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady Aug 18 11:29:26.922: INFO: Creating new exec pod Aug 18 11:29:31.944: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 nodeport-test 80' Aug 18 11:29:32.211: INFO: stderr: "+ nc -zv -t -w 2 nodeport-test 80\nConnection to nodeport-test 80 port [tcp/http] succeeded!\n" Aug 18 11:29:32.211: INFO: stdout: "" Aug 18 11:29:32.212: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.233.39.37 80' Aug 18 11:29:32.469: INFO: stderr: "+ nc -zv -t -w 2 10.233.39.37 80\nConnection to 10.233.39.37 80 port [tcp/http] succeeded!\n" Aug 18 11:29:32.469: INFO: stdout: "" Aug 18 11:29:32.469: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:29:32.744: INFO: rc: 1 Aug 18 11:29:32.744: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:29:33.744: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:29:33.989: INFO: rc: 1 Aug 18 11:29:33.989: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:29:34.744: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:29:35.038: INFO: rc: 1 Aug 18 11:29:35.038: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:29:35.744: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:29:36.020: INFO: rc: 1 Aug 18 11:29:36.020: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:29:36.744: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:29:36.989: INFO: rc: 1 Aug 18 11:29:36.989: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:29:37.745: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:29:38.005: INFO: rc: 1 Aug 18 11:29:38.005: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:29:38.745: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:29:39.018: INFO: rc: 1 Aug 18 11:29:39.018: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:29:39.744: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:29:39.983: INFO: rc: 1 Aug 18 11:29:39.983: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:29:40.744: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:29:40.998: INFO: rc: 1 Aug 18 11:29:40.998: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:29:41.744: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:29:42.019: INFO: rc: 1 Aug 18 11:29:42.019: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:29:42.744: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:29:43.026: INFO: rc: 1 Aug 18 11:29:43.026: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:29:43.744: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:29:44.465: INFO: rc: 1 Aug 18 11:29:44.465: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:29:44.744: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:29:45.016: INFO: rc: 1 Aug 18 11:29:45.016: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:29:45.744: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:29:46.020: INFO: rc: 1 Aug 18 11:29:46.020: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:29:46.744: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:29:47.001: INFO: rc: 1 Aug 18 11:29:47.001: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:29:47.745: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:29:48.013: INFO: rc: 1 Aug 18 11:29:48.013: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:29:48.745: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:29:48.998: INFO: rc: 1 Aug 18 11:29:48.998: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:29:49.744: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:29:50.013: INFO: rc: 1 Aug 18 11:29:50.013: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:29:50.744: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:29:51.012: INFO: rc: 1 Aug 18 11:29:51.012: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:29:51.746: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:29:52.028: INFO: rc: 1 Aug 18 11:29:52.028: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:29:52.744: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:29:53.013: INFO: rc: 1 Aug 18 11:29:53.013: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:29:53.745: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:29:54.008: INFO: rc: 1 Aug 18 11:29:54.008: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:29:54.746: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:29:55.048: INFO: rc: 1 Aug 18 11:29:55.049: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:29:55.744: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:29:56.014: INFO: rc: 1 Aug 18 11:29:56.014: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:29:56.744: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:29:57.004: INFO: rc: 1 Aug 18 11:29:57.004: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:29:57.744: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:29:58.025: INFO: rc: 1 Aug 18 11:29:58.025: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:29:58.744: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:29:59.000: INFO: rc: 1 Aug 18 11:29:59.000: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:29:59.744: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:30:00.005: INFO: rc: 1 Aug 18 11:30:00.005: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:30:00.744: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:30:01.036: INFO: rc: 1 Aug 18 11:30:01.036: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:30:01.744: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:30:01.991: INFO: rc: 1 Aug 18 11:30:01.991: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:30:02.744: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:30:03.022: INFO: rc: 1 Aug 18 11:30:03.022: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:30:03.744: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:30:04.000: INFO: rc: 1 Aug 18 11:30:04.000: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:30:04.744: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:30:04.998: INFO: rc: 1 Aug 18 11:30:04.998: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:30:05.744: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:30:06.039: INFO: rc: 1 Aug 18 11:30:06.039: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:30:06.744: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:30:07.010: INFO: rc: 1 Aug 18 11:30:07.010: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:30:07.744: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:30:08.018: INFO: rc: 1 Aug 18 11:30:08.018: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:30:08.744: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:30:09.019: INFO: rc: 1 Aug 18 11:30:09.019: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:30:09.745: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:30:10.019: INFO: rc: 1 Aug 18 11:30:10.019: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:30:10.744: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:30:11.010: INFO: rc: 1 Aug 18 11:30:11.010: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:30:11.744: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:30:11.998: INFO: rc: 1 Aug 18 11:30:11.998: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:30:12.744: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:30:13.005: INFO: rc: 1 Aug 18 11:30:13.005: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:30:13.744: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:30:14.014: INFO: rc: 1 Aug 18 11:30:14.014: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:30:14.744: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:30:14.997: INFO: rc: 1 Aug 18 11:30:14.997: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:30:15.745: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:30:16.038: INFO: rc: 1 Aug 18 11:30:16.038: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:30:16.744: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:30:17.008: INFO: rc: 1 Aug 18 11:30:17.008: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:30:17.745: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:30:18.018: INFO: rc: 1 Aug 18 11:30:18.018: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:30:18.746: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:30:19.016: INFO: rc: 1 Aug 18 11:30:19.017: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:30:19.745: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:30:20.010: INFO: rc: 1 Aug 18 11:30:20.010: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:30:20.745: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:30:21.017: INFO: rc: 1 Aug 18 11:30:21.017: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:30:21.744: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:30:22.024: INFO: rc: 1 Aug 18 11:30:22.024: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:30:22.744: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:30:23.011: INFO: rc: 1 Aug 18 11:30:23.011: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:30:23.745: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:30:24.020: INFO: rc: 1 Aug 18 11:30:24.020: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:30:24.744: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:30:25.042: INFO: rc: 1 Aug 18 11:30:25.042: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:30:25.744: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:30:26.009: INFO: rc: 1 Aug 18 11:30:26.009: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:30:26.744: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:30:27.010: INFO: rc: 1 Aug 18 11:30:27.010: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:30:27.744: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:30:28.022: INFO: rc: 1 Aug 18 11:30:28.022: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:30:28.744: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:30:29.032: INFO: rc: 1 Aug 18 11:30:29.032: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:30:29.744: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:30:30.018: INFO: rc: 1 Aug 18 11:30:30.018: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:30:30.744: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:30:30.999: INFO: rc: 1 Aug 18 11:30:30.999: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:30:31.744: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:30:32.002: INFO: rc: 1 Aug 18 11:30:32.002: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:30:32.744: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:30:33.044: INFO: rc: 1 Aug 18 11:30:33.044: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:30:33.745: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:30:34.005: INFO: rc: 1 Aug 18 11:30:34.005: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:30:34.744: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:30:34.989: INFO: rc: 1 Aug 18 11:30:34.989: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:30:35.744: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:30:36.015: INFO: rc: 1 Aug 18 11:30:36.015: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:30:36.744: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:30:37.021: INFO: rc: 1 Aug 18 11:30:37.021: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:30:37.745: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:30:38.507: INFO: rc: 1 Aug 18 11:30:38.507: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:30:38.745: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:30:39.012: INFO: rc: 1 Aug 18 11:30:39.012: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:30:39.746: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:30:39.995: INFO: rc: 1 Aug 18 11:30:39.995: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:30:40.745: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:30:41.005: INFO: rc: 1 Aug 18 11:30:41.005: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:30:41.744: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:30:42.006: INFO: rc: 1 Aug 18 11:30:42.006: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:30:42.744: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:30:43.003: INFO: rc: 1 Aug 18 11:30:43.003: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:30:43.744: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:30:44.289: INFO: rc: 1 Aug 18 11:30:44.289: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:30:44.744: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:30:44.995: INFO: rc: 1 Aug 18 11:30:44.995: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:30:45.745: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:30:46.028: INFO: rc: 1 Aug 18 11:30:46.028: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:30:46.744: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:30:47.006: INFO: rc: 1 Aug 18 11:30:47.006: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:30:47.744: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:30:48.010: INFO: rc: 1 Aug 18 11:30:48.010: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:30:48.744: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:30:49.023: INFO: rc: 1 Aug 18 11:30:49.023: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:30:49.745: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:30:50.009: INFO: rc: 1 Aug 18 11:30:50.009: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:30:50.746: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:30:51.017: INFO: rc: 1 Aug 18 11:30:51.017: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:30:51.745: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:30:52.034: INFO: rc: 1 Aug 18 11:30:52.035: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:30:52.744: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:30:53.016: INFO: rc: 1 Aug 18 11:30:53.017: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:30:53.744: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:30:54.031: INFO: rc: 1 Aug 18 11:30:54.031: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:30:54.745: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:30:55.007: INFO: rc: 1 Aug 18 11:30:55.007: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:30:55.744: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:30:56.031: INFO: rc: 1 Aug 18 11:30:56.031: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:30:56.744: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:30:56.994: INFO: rc: 1 Aug 18 11:30:56.994: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:30:57.745: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:30:57.994: INFO: rc: 1 Aug 18 11:30:57.994: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:30:58.745: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:30:59.015: INFO: rc: 1 Aug 18 11:30:59.015: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:30:59.744: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:31:00.013: INFO: rc: 1 Aug 18 11:31:00.014: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:31:00.745: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:31:01.009: INFO: rc: 1 Aug 18 11:31:01.009: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:31:01.745: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:31:02.038: INFO: rc: 1 Aug 18 11:31:02.038: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:31:02.745: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:31:03.036: INFO: rc: 1 Aug 18 11:31:03.036: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:31:03.745: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:31:04.002: INFO: rc: 1 Aug 18 11:31:04.002: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:31:04.745: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:31:05.018: INFO: rc: 1 Aug 18 11:31:05.018: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:31:05.745: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:31:06.009: INFO: rc: 1 Aug 18 11:31:06.009: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:31:06.746: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:31:07.002: INFO: rc: 1 Aug 18 11:31:07.002: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:31:07.745: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:31:07.997: INFO: rc: 1 Aug 18 11:31:07.997: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:31:08.746: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:31:08.997: INFO: rc: 1 Aug 18 11:31:08.997: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:31:09.745: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:31:10.009: INFO: rc: 1 Aug 18 11:31:10.009: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:31:10.746: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:31:10.999: INFO: rc: 1 Aug 18 11:31:10.999: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:31:11.746: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:31:12.012: INFO: rc: 1 Aug 18 11:31:12.012: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:31:12.745: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:31:13.016: INFO: rc: 1 Aug 18 11:31:13.016: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:31:13.745: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:31:14.700: INFO: rc: 1 Aug 18 11:31:14.700: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:31:14.744: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:31:15.001: INFO: rc: 1 Aug 18 11:31:15.001: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:31:15.746: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:31:16.023: INFO: rc: 1 Aug 18 11:31:16.023: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:31:16.745: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:31:17.034: INFO: rc: 1 Aug 18 11:31:17.034: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:31:17.745: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:31:18.016: INFO: rc: 1 Aug 18 11:31:18.016: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:31:18.746: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:31:19.000: INFO: rc: 1 Aug 18 11:31:19.000: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:31:19.745: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:31:20.016: INFO: rc: 1 Aug 18 11:31:20.016: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:31:20.745: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:31:21.026: INFO: rc: 1 Aug 18 11:31:21.026: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:31:21.744: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:31:22.017: INFO: rc: 1 Aug 18 11:31:22.017: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:31:22.745: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:31:23.024: INFO: rc: 1 Aug 18 11:31:23.024: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:31:23.745: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:31:24.018: INFO: rc: 1 Aug 18 11:31:24.018: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:31:24.745: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:31:25.018: INFO: rc: 1 Aug 18 11:31:25.018: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:31:25.745: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:31:26.017: INFO: rc: 1 Aug 18 11:31:26.017: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:31:26.746: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:31:27.012: INFO: rc: 1 Aug 18 11:31:27.012: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:31:27.745: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:31:28.029: INFO: rc: 1 Aug 18 11:31:28.029: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:31:28.745: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:31:28.995: INFO: rc: 1 Aug 18 11:31:28.995: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:31:29.745: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:31:30.005: INFO: rc: 1 Aug 18 11:31:30.005: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:31:30.745: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:31:30.998: INFO: rc: 1 Aug 18 11:31:30.998: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:31:31.745: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:31:32.026: INFO: rc: 1 Aug 18 11:31:32.026: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:31:32.744: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:31:33.039: INFO: rc: 1 Aug 18 11:31:33.039: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:31:33.039: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777' Aug 18 11:31:33.299: INFO: rc: 1 Aug 18 11:31:33.300: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-5233 exec execpodz5s5r -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31777: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31777 nc: connect to 10.10.190.207 port 31777 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:31:33.300: FAIL: Unexpected error: <*errors.errorString | 0xc0042cee30>: { s: "service is not reachable within 2m0s timeout on endpoint 10.10.190.207:31777 over TCP protocol", } service is not reachable within 2m0s timeout on endpoint 10.10.190.207:31777 over TCP protocol occurred Full Stack Trace k8s.io/kubernetes/test/e2e/network.glob..func24.11() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:1242 +0x265 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc002593080) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc002593080) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc002593080, 0x4deb2c0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "services-5233". STEP: Found 20 events. Aug 18 11:31:33.317: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for execpodz5s5r: { } Scheduled: Successfully assigned services-5233/execpodz5s5r to node2 Aug 18 11:31:33.317: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for nodeport-test-r5jnt: { } Scheduled: Successfully assigned services-5233/nodeport-test-r5jnt to node1 Aug 18 11:31:33.317: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for nodeport-test-tsczd: { } Scheduled: Successfully assigned services-5233/nodeport-test-tsczd to node2 Aug 18 11:31:33.317: INFO: At 2021-08-18 11:29:23 +0000 UTC - event for nodeport-test: {replication-controller } SuccessfulCreate: Created pod: nodeport-test-tsczd Aug 18 11:31:33.317: INFO: At 2021-08-18 11:29:23 +0000 UTC - event for nodeport-test: {replication-controller } SuccessfulCreate: Created pod: nodeport-test-r5jnt Aug 18 11:31:33.317: INFO: At 2021-08-18 11:29:25 +0000 UTC - event for nodeport-test-r5jnt: {multus } AddedInterface: Add eth0 [10.244.4.2/24] Aug 18 11:31:33.317: INFO: At 2021-08-18 11:29:25 +0000 UTC - event for nodeport-test-r5jnt: {kubelet node1} Pulling: Pulling image "k8s.gcr.io/e2e-test-images/agnhost:2.20" Aug 18 11:31:33.318: INFO: At 2021-08-18 11:29:25 +0000 UTC - event for nodeport-test-tsczd: {kubelet node2} Pulled: Successfully pulled image "k8s.gcr.io/e2e-test-images/agnhost:2.20" in 529.594045ms Aug 18 11:31:33.318: INFO: At 2021-08-18 11:29:25 +0000 UTC - event for nodeport-test-tsczd: {kubelet node2} Created: Created container nodeport-test Aug 18 11:31:33.318: INFO: At 2021-08-18 11:29:25 +0000 UTC - event for nodeport-test-tsczd: {multus } AddedInterface: Add eth0 [10.244.3.250/24] Aug 18 11:31:33.318: INFO: At 2021-08-18 11:29:25 +0000 UTC - event for nodeport-test-tsczd: {kubelet node2} Pulling: Pulling image "k8s.gcr.io/e2e-test-images/agnhost:2.20" Aug 18 11:31:33.318: INFO: At 2021-08-18 11:29:26 +0000 UTC - event for nodeport-test-r5jnt: {kubelet node1} Pulled: Successfully pulled image "k8s.gcr.io/e2e-test-images/agnhost:2.20" in 566.273845ms Aug 18 11:31:33.318: INFO: At 2021-08-18 11:29:26 +0000 UTC - event for nodeport-test-r5jnt: {kubelet node1} Started: Started container nodeport-test Aug 18 11:31:33.318: INFO: At 2021-08-18 11:29:26 +0000 UTC - event for nodeport-test-r5jnt: {kubelet node1} Created: Created container nodeport-test Aug 18 11:31:33.318: INFO: At 2021-08-18 11:29:26 +0000 UTC - event for nodeport-test-tsczd: {kubelet node2} Started: Started container nodeport-test Aug 18 11:31:33.318: INFO: At 2021-08-18 11:29:28 +0000 UTC - event for execpodz5s5r: {kubelet node2} Pulling: Pulling image "k8s.gcr.io/e2e-test-images/agnhost:2.20" Aug 18 11:31:33.318: INFO: At 2021-08-18 11:29:28 +0000 UTC - event for execpodz5s5r: {multus } AddedInterface: Add eth0 [10.244.3.251/24] Aug 18 11:31:33.318: INFO: At 2021-08-18 11:29:29 +0000 UTC - event for execpodz5s5r: {kubelet node2} Pulled: Successfully pulled image "k8s.gcr.io/e2e-test-images/agnhost:2.20" in 533.385016ms Aug 18 11:31:33.318: INFO: At 2021-08-18 11:29:29 +0000 UTC - event for execpodz5s5r: {kubelet node2} Created: Created container agnhost-container Aug 18 11:31:33.318: INFO: At 2021-08-18 11:29:29 +0000 UTC - event for execpodz5s5r: {kubelet node2} Started: Started container agnhost-container Aug 18 11:31:33.321: INFO: POD NODE PHASE GRACE CONDITIONS Aug 18 11:31:33.321: INFO: execpodz5s5r node2 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:29:26 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:29:30 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:29:30 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:29:26 +0000 UTC }] Aug 18 11:31:33.321: INFO: nodeport-test-r5jnt node1 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:29:23 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:29:26 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:29:26 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:29:23 +0000 UTC }] Aug 18 11:31:33.321: INFO: nodeport-test-tsczd node2 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:29:23 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:29:26 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:29:26 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:29:23 +0000 UTC }] Aug 18 11:31:33.321: INFO: Aug 18 11:31:33.325: INFO: Logging node info for node master1 Aug 18 11:31:33.328: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 ebb211fa-503f-4cfe-b1ed-c95d27a70e6e 59675 0 2021-08-18 08:20:52 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"3a:82:be:72:b5:15"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:20:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:20:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:25:59 +0000 UTC,LastTransitionTime:2021-08-18 08:25:59 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:31:23 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:31:23 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:31:23 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:31:23 +0000 UTC,LastTransitionTime:2021-08-18 08:25:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:58c3e57359b641ad92fa1959f2fecf5d,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:012cd796-2076-45d6-8b14-d3e0451b1e64,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[@ :],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:31:33.328: INFO: Logging kubelet events for node master1 Aug 18 11:31:33.331: INFO: Logging pods the kubelet thinks is on node master1 Aug 18 11:31:33.351: INFO: docker-registry-docker-registry-56cbc7bc58-49kl2 started at 2021-08-18 08:26:23 +0000 UTC (0+2 container statuses recorded) Aug 18 11:31:33.351: INFO: Container docker-registry ready: true, restart count 0 Aug 18 11:31:33.351: INFO: Container nginx ready: true, restart count 0 Aug 18 11:31:33.351: INFO: node-exporter-5hwz9 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:31:33.352: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:31:33.352: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:31:33.352: INFO: kube-controller-manager-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:31:33.352: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:31:33.352: INFO: kube-multus-ds-amd64-kbcp6 started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:31:33.352: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:31:33.352: INFO: coredns-7677f9bb54-kn2qg started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:31:33.352: INFO: Container coredns ready: true, restart count 2 Aug 18 11:31:33.352: INFO: kube-scheduler-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:31:33.352: INFO: Container kube-scheduler ready: true, restart count 0 Aug 18 11:31:33.352: INFO: kube-apiserver-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:31:33.352: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:31:33.352: INFO: kube-proxy-vqk4v started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:31:33.352: INFO: Container kube-proxy ready: true, restart count 1 Aug 18 11:31:33.352: INFO: kube-flannel-q64cq started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:31:33.352: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:31:33.352: INFO: Container kube-flannel ready: true, restart count 3 W0818 11:31:33.364482 36 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:31:33.388: INFO: Latency metrics for node master1 Aug 18 11:31:33.388: INFO: Logging node info for node master2 Aug 18 11:31:33.391: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 78946293-3abe-4442-84d4-8ed6b1d15ce0 59712 0 2021-08-18 08:21:31 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"7e:f5:c2:cc:3a:b4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:21:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:21:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-08-18 08:29:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:31:32 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:31:32 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:31:32 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:31:32 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0c44122c7a7248c18d8571e1cc667258,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:0cd329f2-48e0-4c8f-b8b9-fa3ae0ed8406,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:31:33.391: INFO: Logging kubelet events for node master2 Aug 18 11:31:33.393: INFO: Logging pods the kubelet thinks is on node master2 Aug 18 11:31:33.401: INFO: kube-controller-manager-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:31:33.401: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:31:33.401: INFO: kube-proxy-kh2l9 started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:31:33.401: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:31:33.401: INFO: kube-flannel-pp56h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:31:33.401: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:31:33.401: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:31:33.401: INFO: node-feature-discovery-controller-5bf5c49849-mq57c started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:31:33.401: INFO: Container nfd-controller ready: true, restart count 0 Aug 18 11:31:33.401: INFO: node-exporter-48nfx started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:31:33.401: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:31:33.401: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:31:33.401: INFO: kube-apiserver-master2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:31:33.401: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:31:33.401: INFO: kube-scheduler-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:31:33.401: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:31:33.401: INFO: kube-multus-ds-amd64-mld8g started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:31:33.401: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:31:33.401: INFO: dns-autoscaler-5b7b5c9b6f-hh47r started at 2021-08-18 08:23:57 +0000 UTC (0+1 container statuses recorded) Aug 18 11:31:33.401: INFO: Container autoscaler ready: true, restart count 2 W0818 11:31:33.415677 36 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:31:33.439: INFO: Latency metrics for node master2 Aug 18 11:31:33.439: INFO: Logging node info for node master3 Aug 18 11:31:33.442: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 44feac2b-9447-4be2-9fcd-62f836d67c72 59692 0 2021-08-18 08:21:41 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"86:e4:31:99:58:40"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {kubelet Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:31:27 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:31:27 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:31:27 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:31:27 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1fae19ae59884c44899bcd08aa243244,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:5db926c5-6530-4635-a0d5-806974a3b732,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:31:33.443: INFO: Logging kubelet events for node master3 Aug 18 11:31:33.445: INFO: Logging pods the kubelet thinks is on node master3 Aug 18 11:31:33.453: INFO: kube-scheduler-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:31:33.453: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:31:33.453: INFO: kube-apiserver-master3 started at 2021-08-18 08:29:12 +0000 UTC (0+1 container statuses recorded) Aug 18 11:31:33.453: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:31:33.453: INFO: kube-proxy-sd5lc started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:31:33.453: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:31:33.453: INFO: kube-flannel-x6tlr started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:31:33.453: INFO: Init container install-cni ready: true, restart count 1 Aug 18 11:31:33.453: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:31:33.453: INFO: kube-multus-ds-amd64-bkw6c started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:31:33.453: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:31:33.453: INFO: coredns-7677f9bb54-5hxfh started at 2021-08-18 08:23:54 +0000 UTC (0+1 container statuses recorded) Aug 18 11:31:33.453: INFO: Container coredns ready: true, restart count 1 Aug 18 11:31:33.453: INFO: node-exporter-vq7d8 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:31:33.453: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:31:33.453: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:31:33.453: INFO: kube-controller-manager-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:31:33.453: INFO: Container kube-controller-manager ready: true, restart count 2 W0818 11:31:33.466657 36 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:31:33.488: INFO: Latency metrics for node master3 Aug 18 11:31:33.488: INFO: Logging node info for node node1 Aug 18 11:31:33.491: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 84defabd-6ebf-43ec-a629-44c6713da9c9 59699 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"9a:87:55:36:7b:df"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:13 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:35 +0000 UTC,LastTransitionTime:2021-08-18 08:26:35 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:31:29 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:31:29 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:31:29 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:31:29 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:69946ff2b7bc462fa25eb7adb4703c23,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:736dc52f-f5e3-494e-86ca-01eedbea015c,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:a7cea43d9d2f67c38fbf0407786edbe660ee9072945f7bb272b55fd255e8eaca opnfv/barometer-collectd:stable],SizeBytes:1075746799,},ContainerImage{Names:[@ :],SizeBytes:1003788820,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[aquasec/kube-hunter@sha256:2be6820bc1d7e0f57193a9a27d5a3e16b2fd93c53747b03ce8ca48c6fc323781 aquasec/kube-hunter:0.3.1],SizeBytes:347611549,},ContainerImage{Names:[golang@sha256:db2475a1dbb2149508e5db31d7d77a75e6600d54be645f37681f03f2762169ba golang:alpine3.12],SizeBytes:301186719,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:de25c7fc6c4f3a27c7f0c2dff454e4671823a34d88abd533f210848d527e0fbb alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:31:33.492: INFO: Logging kubelet events for node node1 Aug 18 11:31:33.494: INFO: Logging pods the kubelet thinks is on node node1 Aug 18 11:31:33.507: INFO: kube-multus-ds-amd64-rrvmb started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:31:33.507: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:31:33.507: INFO: node-feature-discovery-worker-pflgw started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:31:33.507: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:31:33.507: INFO: node-exporter-kcwvn started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:31:33.507: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:31:33.507: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:31:33.508: INFO: pod-init-b68a6dc1-5b80-476f-a5fe-c89c90dac8b1 started at 2021-08-18 11:27:37 +0000 UTC (2+1 container statuses recorded) Aug 18 11:31:33.508: INFO: Init container init1 ready: false, restart count 0 Aug 18 11:31:33.508: INFO: Init container init2 ready: false, restart count 0 Aug 18 11:31:33.508: INFO: Container run1 ready: false, restart count 0 Aug 18 11:31:33.508: INFO: ss2-0 started at 2021-08-18 11:26:45 +0000 UTC (0+1 container statuses recorded) Aug 18 11:31:33.508: INFO: Container webserver ready: true, restart count 0 Aug 18 11:31:33.508: INFO: downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25 started at 2021-08-18 11:27:11 +0000 UTC (0+1 container statuses recorded) Aug 18 11:31:33.508: INFO: Container dapi-container ready: false, restart count 0 Aug 18 11:31:33.508: INFO: kube-proxy-p6jvp started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:31:33.508: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:31:33.508: INFO: kubernetes-metrics-scraper-678c97765c-9nsv5 started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:31:33.508: INFO: Container kubernetes-metrics-scraper ready: true, restart count 2 Aug 18 11:31:33.508: INFO: cmk-init-discover-node1-bxznx started at 2021-08-18 08:32:10 +0000 UTC (0+3 container statuses recorded) Aug 18 11:31:33.508: INFO: Container discover ready: false, restart count 0 Aug 18 11:31:33.508: INFO: Container init ready: false, restart count 0 Aug 18 11:31:33.508: INFO: Container install ready: false, restart count 0 Aug 18 11:31:33.508: INFO: cmk-d8r27 started at 2021-08-18 08:32:52 +0000 UTC (0+2 container statuses recorded) Aug 18 11:31:33.508: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:31:33.508: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:31:33.508: INFO: collectd-xdprr started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:31:33.508: INFO: Container collectd ready: true, restart count 0 Aug 18 11:31:33.508: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:31:33.508: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:31:33.508: INFO: pod-submit-remove-74dabc56-7cc6-4841-8b80-3d7505da846f started at 2021-08-18 11:27:24 +0000 UTC (0+1 container statuses recorded) Aug 18 11:31:33.508: INFO: Container nginx ready: false, restart count 0 Aug 18 11:31:33.508: INFO: nginx-proxy-node1 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:31:33.508: INFO: Container nginx-proxy ready: true, restart count 2 Aug 18 11:31:33.508: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-vsxvg started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:31:33.508: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:31:33.508: INFO: kube-flannel-q78nd started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:31:33.508: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:31:33.508: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:31:33.508: INFO: prometheus-k8s-0 started at 2021-08-18 08:34:03 +0000 UTC (0+5 container statuses recorded) Aug 18 11:31:33.508: INFO: Container custom-metrics-apiserver ready: true, restart count 0 Aug 18 11:31:33.508: INFO: Container grafana ready: true, restart count 0 Aug 18 11:31:33.508: INFO: Container prometheus ready: true, restart count 1 Aug 18 11:31:33.508: INFO: Container prometheus-config-reloader ready: true, restart count 0 Aug 18 11:31:33.508: INFO: Container rules-configmap-reloader ready: true, restart count 0 Aug 18 11:31:33.508: INFO: nodeport-test-r5jnt started at 2021-08-18 11:29:23 +0000 UTC (0+1 container statuses recorded) Aug 18 11:31:33.508: INFO: Container nodeport-test ready: true, restart count 0 Aug 18 11:31:33.508: INFO: test-rolling-update-controller-wx48f started at 2021-08-18 11:29:47 +0000 UTC (0+1 container statuses recorded) Aug 18 11:31:33.508: INFO: Container httpd ready: false, restart count 0 Aug 18 11:31:33.508: INFO: ss2-1 started at 2021-08-18 11:26:31 +0000 UTC (0+1 container statuses recorded) Aug 18 11:31:33.508: INFO: Container webserver ready: true, restart count 0 W0818 11:31:33.519465 36 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:31:33.550: INFO: Latency metrics for node node1 Aug 18 11:31:33.550: INFO: Logging node info for node node2 Aug 18 11:31:33.554: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 1d01177e-3dbb-48a1-a0bc-d18af27ab7f8 59706 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:d1:47:f8:1d:22"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:36 +0000 UTC,LastTransitionTime:2021-08-18 08:26:36 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:31:30 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:31:30 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:31:30 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:31:30 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:dc1f286135c145349b8a016880b65a2f,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:037e7e2d-94e9-42f4-a719-896e5005ac70,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:31:33.555: INFO: Logging kubelet events for node node2 Aug 18 11:31:33.557: INFO: Logging pods the kubelet thinks is on node node2 Aug 18 11:31:33.574: INFO: execpodz5s5r started at 2021-08-18 11:29:26 +0000 UTC (0+1 container statuses recorded) Aug 18 11:31:33.574: INFO: Container agnhost-container ready: true, restart count 0 Aug 18 11:31:33.574: INFO: cmk-webhook-6c9d5f8578-7cxjr started at 2021-08-18 08:32:53 +0000 UTC (0+1 container statuses recorded) Aug 18 11:31:33.574: INFO: Container cmk-webhook ready: true, restart count 0 Aug 18 11:31:33.574: INFO: node-exporter-lrrf2 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:31:33.574: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:31:33.574: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:31:33.574: INFO: var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15 started at 2021-08-18 11:27:32 +0000 UTC (0+1 container statuses recorded) Aug 18 11:31:33.574: INFO: Container dapi-container ready: false, restart count 0 Aug 18 11:31:33.574: INFO: kube-flannel-h7t5h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:31:33.574: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:31:33.574: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:31:33.574: INFO: cmk-init-discover-node2-6b2kz started at 2021-08-18 08:32:30 +0000 UTC (0+3 container statuses recorded) Aug 18 11:31:33.574: INFO: Container discover ready: false, restart count 0 Aug 18 11:31:33.574: INFO: Container init ready: false, restart count 0 Aug 18 11:31:33.574: INFO: Container install ready: false, restart count 0 Aug 18 11:31:33.574: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-7rn45 started at 2021-08-18 08:36:42 +0000 UTC (0+2 container statuses recorded) Aug 18 11:31:33.574: INFO: Container tas-controller ready: true, restart count 0 Aug 18 11:31:33.574: INFO: Container tas-extender ready: true, restart count 0 Aug 18 11:31:33.574: INFO: ss2-2 started at 2021-08-18 11:27:31 +0000 UTC (0+1 container statuses recorded) Aug 18 11:31:33.574: INFO: Container webserver ready: false, restart count 0 Aug 18 11:31:33.574: INFO: nginx-proxy-node2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:31:33.574: INFO: Container nginx-proxy ready: true, restart count 1 Aug 18 11:31:33.574: INFO: test-rollover-controller-n75gh started at 2021-08-18 11:26:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:31:33.574: INFO: Container httpd ready: false, restart count 0 Aug 18 11:31:33.574: INFO: kubernetes-dashboard-86c6f9df5b-qrtdk started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:31:33.574: INFO: Container kubernetes-dashboard ready: true, restart count 2 Aug 18 11:31:33.574: INFO: cmk-748rz started at 2021-08-18 08:32:53 +0000 UTC (0+2 container statuses recorded) Aug 18 11:31:33.574: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:31:33.574: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:31:33.574: INFO: node-feature-discovery-worker-hzpf5 started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:31:33.574: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:31:33.574: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-c82pt started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:31:33.574: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:31:33.574: INFO: prometheus-operator-5bb8cb9d8f-k97ws started at 2021-08-18 08:33:38 +0000 UTC (0+2 container statuses recorded) Aug 18 11:31:33.574: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:31:33.574: INFO: Container prometheus-operator ready: true, restart count 0 Aug 18 11:31:33.574: INFO: kube-proxy-qkj9c started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:31:33.574: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:31:33.574: INFO: collectd-67ntq started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:31:33.574: INFO: Container collectd ready: true, restart count 0 Aug 18 11:31:33.574: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:31:33.574: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:31:33.574: INFO: downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a started at 2021-08-18 11:31:01 +0000 UTC (0+1 container statuses recorded) Aug 18 11:31:33.574: INFO: Container dapi-container ready: false, restart count 0 Aug 18 11:31:33.574: INFO: var-expansion-cf1f3322-29ba-472a-9702-20756a20f986 started at 2021-08-18 11:28:58 +0000 UTC (0+1 container statuses recorded) Aug 18 11:31:33.574: INFO: Container dapi-container ready: false, restart count 0 Aug 18 11:31:33.574: INFO: nodeport-test-tsczd started at 2021-08-18 11:29:23 +0000 UTC (0+1 container statuses recorded) Aug 18 11:31:33.574: INFO: Container nodeport-test ready: true, restart count 0 Aug 18 11:31:33.574: INFO: kube-multus-ds-amd64-rvzsg started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:31:33.574: INFO: Container kube-multus ready: true, restart count 1 W0818 11:31:33.587954 36 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:31:33.617: INFO: Latency metrics for node node2 Aug 18 11:31:33.617: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "services-5233" for this suite. [AfterEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:786 • Failure [129.803 seconds] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/framework.go:23 should be able to create a functioning NodePort service [Conformance] [It] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:31:33.300: Unexpected error: <*errors.errorString | 0xc0042cee30>: { s: "service is not reachable within 2m0s timeout on endpoint 10.10.190.207:31777 over TCP protocol", } service is not reachable within 2m0s timeout on endpoint 10.10.190.207:31777 over TCP protocol occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:1242 ------------------------------ {"msg":"FAILED [sig-network] Services should be able to create a functioning NodePort service [Conformance]","total":-1,"completed":12,"skipped":284,"failed":1,"failures":["[sig-network] Services should be able to create a functioning NodePort service [Conformance]"]} SSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [k8s.io] Security Context /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:31:33.677: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename security-context-test STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [k8s.io] Security Context /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/security_context.go:41 [It] should not allow privilege escalation when false [LinuxOnly] [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:31:33.711: INFO: Waiting up to 5m0s for pod "alpine-nnp-false-6093f47a-889d-473c-abf5-ee9c2246aa7a" in namespace "security-context-test-1066" to be "Succeeded or Failed" Aug 18 11:31:33.713: INFO: Pod "alpine-nnp-false-6093f47a-889d-473c-abf5-ee9c2246aa7a": Phase="Pending", Reason="", readiness=false. Elapsed: 1.915672ms Aug 18 11:31:35.715: INFO: Pod "alpine-nnp-false-6093f47a-889d-473c-abf5-ee9c2246aa7a": Phase="Pending", Reason="", readiness=false. Elapsed: 2.004238326s Aug 18 11:31:37.718: INFO: Pod "alpine-nnp-false-6093f47a-889d-473c-abf5-ee9c2246aa7a": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.007032457s Aug 18 11:31:37.718: INFO: Pod "alpine-nnp-false-6093f47a-889d-473c-abf5-ee9c2246aa7a" satisfied condition "Succeeded or Failed" [AfterEach] [k8s.io] Security Context /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:31:37.726: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "security-context-test-1066" for this suite. • ------------------------------ {"msg":"PASSED [k8s.io] Security Context when creating containers with AllowPrivilegeEscalation should not allow privilege escalation when false [LinuxOnly] [NodeConformance] [Conformance]","total":-1,"completed":13,"skipped":300,"failed":1,"failures":["[sig-network] Services should be able to create a functioning NodePort service [Conformance]"]} SSSSSS ------------------------------ [BeforeEach] [k8s.io] Probing container /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:31:37.751: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename container-probe STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [k8s.io] Probing container /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:54 [It] with readiness probe should not be ready before initial delay and never restart [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:31:37.786: INFO: The status of Pod test-webserver-61a86e95-c56e-477f-8a08-403249c2a07a is Pending, waiting for it to be Running (with Ready = true) Aug 18 11:31:39.789: INFO: The status of Pod test-webserver-61a86e95-c56e-477f-8a08-403249c2a07a is Pending, waiting for it to be Running (with Ready = true) Aug 18 11:31:41.789: INFO: The status of Pod test-webserver-61a86e95-c56e-477f-8a08-403249c2a07a is Running (Ready = false) Aug 18 11:31:43.790: INFO: The status of Pod test-webserver-61a86e95-c56e-477f-8a08-403249c2a07a is Running (Ready = false) Aug 18 11:31:45.789: INFO: The status of Pod test-webserver-61a86e95-c56e-477f-8a08-403249c2a07a is Running (Ready = false) Aug 18 11:31:47.789: INFO: The status of Pod test-webserver-61a86e95-c56e-477f-8a08-403249c2a07a is Running (Ready = false) Aug 18 11:31:49.789: INFO: The status of Pod test-webserver-61a86e95-c56e-477f-8a08-403249c2a07a is Running (Ready = false) Aug 18 11:31:51.789: INFO: The status of Pod test-webserver-61a86e95-c56e-477f-8a08-403249c2a07a is Running (Ready = false) Aug 18 11:31:53.789: INFO: The status of Pod test-webserver-61a86e95-c56e-477f-8a08-403249c2a07a is Running (Ready = false) Aug 18 11:31:55.792: INFO: The status of Pod test-webserver-61a86e95-c56e-477f-8a08-403249c2a07a is Running (Ready = false) Aug 18 11:31:57.789: INFO: The status of Pod test-webserver-61a86e95-c56e-477f-8a08-403249c2a07a is Running (Ready = false) Aug 18 11:31:59.791: INFO: The status of Pod test-webserver-61a86e95-c56e-477f-8a08-403249c2a07a is Running (Ready = true) Aug 18 11:31:59.793: INFO: Container started at 2021-08-18 11:31:40 +0000 UTC, pod became ready at 2021-08-18 11:31:59 +0000 UTC [AfterEach] [k8s.io] Probing container /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:31:59.794: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "container-probe-9747" for this suite. • [SLOW TEST:22.054 seconds] [k8s.io] Probing container /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 with readiness probe should not be ready before initial delay and never restart [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [k8s.io] Probing container with readiness probe should not be ready before initial delay and never restart [NodeConformance] [Conformance]","total":-1,"completed":14,"skipped":306,"failed":1,"failures":["[sig-network] Services should be able to create a functioning NodePort service [Conformance]"]} [BeforeEach] [sig-api-machinery] Discovery /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:31:59.808: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename discovery STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-api-machinery] Discovery /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/discovery.go:39 STEP: Setting up server cert [It] should validate PreferredVersion for each APIGroup [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:32:00.235: INFO: Checking APIGroup: apiregistration.k8s.io Aug 18 11:32:00.236: INFO: PreferredVersion.GroupVersion: apiregistration.k8s.io/v1 Aug 18 11:32:00.236: INFO: Versions found [{apiregistration.k8s.io/v1 v1} {apiregistration.k8s.io/v1beta1 v1beta1}] Aug 18 11:32:00.236: INFO: apiregistration.k8s.io/v1 matches apiregistration.k8s.io/v1 Aug 18 11:32:00.236: INFO: Checking APIGroup: extensions Aug 18 11:32:00.237: INFO: PreferredVersion.GroupVersion: extensions/v1beta1 Aug 18 11:32:00.237: INFO: Versions found [{extensions/v1beta1 v1beta1}] Aug 18 11:32:00.237: INFO: extensions/v1beta1 matches extensions/v1beta1 Aug 18 11:32:00.237: INFO: Checking APIGroup: apps Aug 18 11:32:00.238: INFO: PreferredVersion.GroupVersion: apps/v1 Aug 18 11:32:00.238: INFO: Versions found [{apps/v1 v1}] Aug 18 11:32:00.238: INFO: apps/v1 matches apps/v1 Aug 18 11:32:00.238: INFO: Checking APIGroup: events.k8s.io Aug 18 11:32:00.239: INFO: PreferredVersion.GroupVersion: events.k8s.io/v1 Aug 18 11:32:00.239: INFO: Versions found [{events.k8s.io/v1 v1} {events.k8s.io/v1beta1 v1beta1}] Aug 18 11:32:00.239: INFO: events.k8s.io/v1 matches events.k8s.io/v1 Aug 18 11:32:00.239: INFO: Checking APIGroup: authentication.k8s.io Aug 18 11:32:00.240: INFO: PreferredVersion.GroupVersion: authentication.k8s.io/v1 Aug 18 11:32:00.240: INFO: Versions found [{authentication.k8s.io/v1 v1} {authentication.k8s.io/v1beta1 v1beta1}] Aug 18 11:32:00.240: INFO: authentication.k8s.io/v1 matches authentication.k8s.io/v1 Aug 18 11:32:00.240: INFO: Checking APIGroup: authorization.k8s.io Aug 18 11:32:00.241: INFO: PreferredVersion.GroupVersion: authorization.k8s.io/v1 Aug 18 11:32:00.241: INFO: Versions found [{authorization.k8s.io/v1 v1} {authorization.k8s.io/v1beta1 v1beta1}] Aug 18 11:32:00.241: INFO: authorization.k8s.io/v1 matches authorization.k8s.io/v1 Aug 18 11:32:00.241: INFO: Checking APIGroup: autoscaling Aug 18 11:32:00.241: INFO: PreferredVersion.GroupVersion: autoscaling/v1 Aug 18 11:32:00.241: INFO: Versions found [{autoscaling/v1 v1} {autoscaling/v2beta1 v2beta1} {autoscaling/v2beta2 v2beta2}] Aug 18 11:32:00.241: INFO: autoscaling/v1 matches autoscaling/v1 Aug 18 11:32:00.241: INFO: Checking APIGroup: batch Aug 18 11:32:00.242: INFO: PreferredVersion.GroupVersion: batch/v1 Aug 18 11:32:00.242: INFO: Versions found [{batch/v1 v1} {batch/v1beta1 v1beta1}] Aug 18 11:32:00.242: INFO: batch/v1 matches batch/v1 Aug 18 11:32:00.242: INFO: Checking APIGroup: certificates.k8s.io Aug 18 11:32:00.243: INFO: PreferredVersion.GroupVersion: certificates.k8s.io/v1 Aug 18 11:32:00.243: INFO: Versions found [{certificates.k8s.io/v1 v1} {certificates.k8s.io/v1beta1 v1beta1}] Aug 18 11:32:00.243: INFO: certificates.k8s.io/v1 matches certificates.k8s.io/v1 Aug 18 11:32:00.243: INFO: Checking APIGroup: networking.k8s.io Aug 18 11:32:00.244: INFO: PreferredVersion.GroupVersion: networking.k8s.io/v1 Aug 18 11:32:00.244: INFO: Versions found [{networking.k8s.io/v1 v1} {networking.k8s.io/v1beta1 v1beta1}] Aug 18 11:32:00.244: INFO: networking.k8s.io/v1 matches networking.k8s.io/v1 Aug 18 11:32:00.244: INFO: Checking APIGroup: policy Aug 18 11:32:00.244: INFO: PreferredVersion.GroupVersion: policy/v1beta1 Aug 18 11:32:00.244: INFO: Versions found [{policy/v1beta1 v1beta1}] Aug 18 11:32:00.244: INFO: policy/v1beta1 matches policy/v1beta1 Aug 18 11:32:00.244: INFO: Checking APIGroup: rbac.authorization.k8s.io Aug 18 11:32:00.245: INFO: PreferredVersion.GroupVersion: rbac.authorization.k8s.io/v1 Aug 18 11:32:00.245: INFO: Versions found [{rbac.authorization.k8s.io/v1 v1} {rbac.authorization.k8s.io/v1beta1 v1beta1}] Aug 18 11:32:00.245: INFO: rbac.authorization.k8s.io/v1 matches rbac.authorization.k8s.io/v1 Aug 18 11:32:00.245: INFO: Checking APIGroup: storage.k8s.io Aug 18 11:32:00.246: INFO: PreferredVersion.GroupVersion: storage.k8s.io/v1 Aug 18 11:32:00.246: INFO: Versions found [{storage.k8s.io/v1 v1} {storage.k8s.io/v1beta1 v1beta1}] Aug 18 11:32:00.246: INFO: storage.k8s.io/v1 matches storage.k8s.io/v1 Aug 18 11:32:00.246: INFO: Checking APIGroup: admissionregistration.k8s.io Aug 18 11:32:00.246: INFO: PreferredVersion.GroupVersion: admissionregistration.k8s.io/v1 Aug 18 11:32:00.246: INFO: Versions found [{admissionregistration.k8s.io/v1 v1} {admissionregistration.k8s.io/v1beta1 v1beta1}] Aug 18 11:32:00.247: INFO: admissionregistration.k8s.io/v1 matches admissionregistration.k8s.io/v1 Aug 18 11:32:00.247: INFO: Checking APIGroup: apiextensions.k8s.io Aug 18 11:32:00.247: INFO: PreferredVersion.GroupVersion: apiextensions.k8s.io/v1 Aug 18 11:32:00.247: INFO: Versions found [{apiextensions.k8s.io/v1 v1} {apiextensions.k8s.io/v1beta1 v1beta1}] Aug 18 11:32:00.247: INFO: apiextensions.k8s.io/v1 matches apiextensions.k8s.io/v1 Aug 18 11:32:00.247: INFO: Checking APIGroup: scheduling.k8s.io Aug 18 11:32:00.248: INFO: PreferredVersion.GroupVersion: scheduling.k8s.io/v1 Aug 18 11:32:00.248: INFO: Versions found [{scheduling.k8s.io/v1 v1} {scheduling.k8s.io/v1beta1 v1beta1}] Aug 18 11:32:00.248: INFO: scheduling.k8s.io/v1 matches scheduling.k8s.io/v1 Aug 18 11:32:00.248: INFO: Checking APIGroup: coordination.k8s.io Aug 18 11:32:00.249: INFO: PreferredVersion.GroupVersion: coordination.k8s.io/v1 Aug 18 11:32:00.249: INFO: Versions found [{coordination.k8s.io/v1 v1} {coordination.k8s.io/v1beta1 v1beta1}] Aug 18 11:32:00.249: INFO: coordination.k8s.io/v1 matches coordination.k8s.io/v1 Aug 18 11:32:00.249: INFO: Checking APIGroup: node.k8s.io Aug 18 11:32:00.249: INFO: PreferredVersion.GroupVersion: node.k8s.io/v1beta1 Aug 18 11:32:00.249: INFO: Versions found [{node.k8s.io/v1beta1 v1beta1}] Aug 18 11:32:00.249: INFO: node.k8s.io/v1beta1 matches node.k8s.io/v1beta1 Aug 18 11:32:00.249: INFO: Checking APIGroup: discovery.k8s.io Aug 18 11:32:00.250: INFO: PreferredVersion.GroupVersion: discovery.k8s.io/v1beta1 Aug 18 11:32:00.250: INFO: Versions found [{discovery.k8s.io/v1beta1 v1beta1}] Aug 18 11:32:00.250: INFO: discovery.k8s.io/v1beta1 matches discovery.k8s.io/v1beta1 Aug 18 11:32:00.250: INFO: Checking APIGroup: intel.com Aug 18 11:32:00.251: INFO: PreferredVersion.GroupVersion: intel.com/v1 Aug 18 11:32:00.251: INFO: Versions found [{intel.com/v1 v1}] Aug 18 11:32:00.251: INFO: intel.com/v1 matches intel.com/v1 Aug 18 11:32:00.251: INFO: Checking APIGroup: k8s.cni.cncf.io Aug 18 11:32:00.251: INFO: PreferredVersion.GroupVersion: k8s.cni.cncf.io/v1 Aug 18 11:32:00.251: INFO: Versions found [{k8s.cni.cncf.io/v1 v1}] Aug 18 11:32:00.251: INFO: k8s.cni.cncf.io/v1 matches k8s.cni.cncf.io/v1 Aug 18 11:32:00.251: INFO: Checking APIGroup: monitoring.coreos.com Aug 18 11:32:00.252: INFO: PreferredVersion.GroupVersion: monitoring.coreos.com/v1 Aug 18 11:32:00.252: INFO: Versions found [{monitoring.coreos.com/v1 v1}] Aug 18 11:32:00.252: INFO: monitoring.coreos.com/v1 matches monitoring.coreos.com/v1 Aug 18 11:32:00.252: INFO: Checking APIGroup: telemetry.intel.com Aug 18 11:32:00.253: INFO: PreferredVersion.GroupVersion: telemetry.intel.com/v1alpha1 Aug 18 11:32:00.253: INFO: Versions found [{telemetry.intel.com/v1alpha1 v1alpha1}] Aug 18 11:32:00.253: INFO: telemetry.intel.com/v1alpha1 matches telemetry.intel.com/v1alpha1 Aug 18 11:32:00.253: INFO: Checking APIGroup: custom.metrics.k8s.io Aug 18 11:32:00.253: INFO: PreferredVersion.GroupVersion: custom.metrics.k8s.io/v1beta1 Aug 18 11:32:00.254: INFO: Versions found [{custom.metrics.k8s.io/v1beta1 v1beta1}] Aug 18 11:32:00.254: INFO: custom.metrics.k8s.io/v1beta1 matches custom.metrics.k8s.io/v1beta1 [AfterEach] [sig-api-machinery] Discovery /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:32:00.254: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "discovery-339" for this suite. • ------------------------------ {"msg":"PASSED [sig-api-machinery] Discovery should validate PreferredVersion for each APIGroup [Conformance]","total":-1,"completed":15,"skipped":306,"failed":1,"failures":["[sig-network] Services should be able to create a functioning NodePort service [Conformance]"]} SSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-storage] ConfigMap /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:32:00.320: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename configmap STEP: Waiting for a default service account to be provisioned in namespace [It] should be consumable from pods in volume with defaultMode set [LinuxOnly] [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating configMap with name configmap-test-volume-d5fcb980-2a0c-44b0-aecc-d9e9eea392f9 STEP: Creating a pod to test consume configMaps Aug 18 11:32:00.357: INFO: Waiting up to 5m0s for pod "pod-configmaps-0e1f8ec5-20a4-4c97-940a-e760d1fd4d58" in namespace "configmap-4995" to be "Succeeded or Failed" Aug 18 11:32:00.359: INFO: Pod "pod-configmaps-0e1f8ec5-20a4-4c97-940a-e760d1fd4d58": Phase="Pending", Reason="", readiness=false. Elapsed: 1.940479ms Aug 18 11:32:02.362: INFO: Pod "pod-configmaps-0e1f8ec5-20a4-4c97-940a-e760d1fd4d58": Phase="Pending", Reason="", readiness=false. Elapsed: 2.005026624s Aug 18 11:32:04.366: INFO: Pod "pod-configmaps-0e1f8ec5-20a4-4c97-940a-e760d1fd4d58": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.009138711s STEP: Saw pod success Aug 18 11:32:04.366: INFO: Pod "pod-configmaps-0e1f8ec5-20a4-4c97-940a-e760d1fd4d58" satisfied condition "Succeeded or Failed" Aug 18 11:32:04.369: INFO: Trying to get logs from node node1 pod pod-configmaps-0e1f8ec5-20a4-4c97-940a-e760d1fd4d58 container configmap-volume-test: STEP: delete the pod Aug 18 11:32:04.382: INFO: Waiting for pod pod-configmaps-0e1f8ec5-20a4-4c97-940a-e760d1fd4d58 to disappear Aug 18 11:32:04.384: INFO: Pod pod-configmaps-0e1f8ec5-20a4-4c97-940a-e760d1fd4d58 no longer exists [AfterEach] [sig-storage] ConfigMap /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:32:04.384: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "configmap-4995" for this suite. • ------------------------------ {"msg":"PASSED [sig-storage] ConfigMap should be consumable from pods in volume with defaultMode set [LinuxOnly] [NodeConformance] [Conformance]","total":-1,"completed":16,"skipped":335,"failed":1,"failures":["[sig-network] Services should be able to create a functioning NodePort service [Conformance]"]} SSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-apps] Deployment /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:26:59.668: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename deployment STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-apps] Deployment /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/deployment.go:78 [It] deployment should support rollover [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:26:59.693: INFO: Pod name rollover-pod: Found 0 pods out of 1 Aug 18 11:27:04.696: INFO: Pod name rollover-pod: Found 1 pods out of 1 STEP: ensuring each pod is running Aug 18 11:32:04.704: FAIL: error in waiting for pods to come up: failed to wait for pods running: [timed out waiting for the condition] Unexpected error: <*errors.errorString | 0xc0021d6850>: { s: "failed to wait for pods running: [timed out waiting for the condition]", } failed to wait for pods running: [timed out waiting for the condition] occurred Full Stack Trace k8s.io/kubernetes/test/e2e/apps.testRolloverDeployment(0xc000878580) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/deployment.go:438 +0x52f k8s.io/kubernetes/test/e2e/apps.glob..func4.7() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/deployment.go:119 +0x2a k8s.io/kubernetes/test/e2e.RunE2ETests(0xc001880c00) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc001880c00) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc001880c00, 0x4deb2c0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [sig-apps] Deployment /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/deployment.go:72 Aug 18 11:32:04.707: INFO: Log out all the ReplicaSets if there is no deployment created Aug 18 11:32:04.710: INFO: ReplicaSet "test-rollover-controller": &ReplicaSet{ObjectMeta:{test-rollover-controller deployment-3014 /apis/apps/v1/namespaces/deployment-3014/replicasets/test-rollover-controller 6ee9199a-c669-4f1e-b74e-e40751260502 56773 1 2021-08-18 11:26:59 +0000 UTC map[name:rollover-pod pod:httpd] map[] [] [] [{e2e.test Update apps/v1 2021-08-18 11:26:59 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{".":{},"f:name":{},"f:pod":{}}},"f:spec":{"f:replicas":{},"f:selector":{"f:matchLabels":{".":{},"f:name":{},"f:pod":{}}},"f:template":{"f:metadata":{"f:labels":{".":{},"f:name":{},"f:pod":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"httpd\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}}}} {kube-controller-manager Update apps/v1 2021-08-18 11:26:59 +0000 UTC FieldsV1 {"f:status":{"f:fullyLabeledReplicas":{},"f:observedGeneration":{},"f:replicas":{}}}}]},Spec:ReplicaSetSpec{Replicas:*1,Selector:&v1.LabelSelector{MatchLabels:map[string]string{name: rollover-pod,pod: httpd,},MatchExpressions:[]LabelSelectorRequirement{},},Template:{{ 0 0001-01-01 00:00:00 +0000 UTC map[name:rollover-pod pod:httpd] map[] [] [] []} {[] [] [{httpd docker.io/library/httpd:2.4.38-alpine [] [] [] [] [] {map[] map[]} [] [] nil nil nil nil /dev/termination-log File IfNotPresent nil false false false}] [] Always 0xc002d93638 ClusterFirst map[] false false false PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,} [] nil default-scheduler [] [] nil [] map[] [] }},MinReadySeconds:0,},Status:ReplicaSetStatus{Replicas:1,FullyLabeledReplicas:1,ObservedGeneration:1,ReadyReplicas:0,AvailableReplicas:0,Conditions:[]ReplicaSetCondition{},},} Aug 18 11:32:04.713: INFO: pod: "test-rollover-controller-n75gh": &Pod{ObjectMeta:{test-rollover-controller-n75gh test-rollover-controller- deployment-3014 /api/v1/namespaces/deployment-3014/pods/test-rollover-controller-n75gh e62aa10c-7652-44e3-99da-fccf12db114f 59310 0 2021-08-18 11:26:59 +0000 UTC map[name:rollover-pod pod:httpd] map[k8s.v1.cni.cncf.io/network-status:[{ "name": "default-cni-network", "interface": "eth0", "ips": [ "10.244.3.227" ], "mac": "be:5b:e6:12:44:f8", "default": true, "dns": {} }] k8s.v1.cni.cncf.io/networks-status:[{ "name": "default-cni-network", "interface": "eth0", "ips": [ "10.244.3.227" ], "mac": "be:5b:e6:12:44:f8", "default": true, "dns": {} }] kubernetes.io/psp:collectd] [{apps/v1 ReplicaSet test-rollover-controller 6ee9199a-c669-4f1e-b74e-e40751260502 0xc002d93967 0xc002d93968}] [] [{kube-controller-manager Update v1 2021-08-18 11:26:59 +0000 UTC FieldsV1 {"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:name":{},"f:pod":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"6ee9199a-c669-4f1e-b74e-e40751260502\"}":{".":{},"f:apiVersion":{},"f:blockOwnerDeletion":{},"f:controller":{},"f:kind":{},"f:name":{},"f:uid":{}}}},"f:spec":{"f:containers":{"k:{\"name\":\"httpd\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}} {multus Update v1 2021-08-18 11:27:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:k8s.v1.cni.cncf.io/network-status":{},"f:k8s.v1.cni.cncf.io/networks-status":{}}}}} {kubelet Update v1 2021-08-18 11:27:04 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:podIP":{},"f:podIPs":{".":{},"k:{\"ip\":\"10.244.3.227\"}":{".":{},"f:ip":{}}},"f:startTime":{}}}}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:default-token-q5lqw,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:&SecretVolumeSource{SecretName:default-token-q5lqw,Items:[]KeyToPath{},DefaultMode:*420,Optional:nil,},NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:httpd,Image:docker.io/library/httpd:2.4.38-alpine,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:default-token-q5lqw,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:Always,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*0,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:node2,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,},Status:PodStatus{Phase:Pending,Conditions:[]PodCondition{PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-08-18 11:26:59 +0000 UTC,Reason:,Message:,},PodCondition{Type:Ready,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-08-18 11:26:59 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:ContainersReady,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-08-18 11:26:59 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-08-18 11:26:59 +0000 UTC,Reason:,Message:,},},Message:,Reason:,HostIP:10.10.190.208,PodIP:10.244.3.227,StartTime:2021-08-18 11:26:59 +0000 UTC,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:httpd,State:ContainerState{Waiting:&ContainerStateWaiting{Reason:ImagePullBackOff,Message:Back-off pulling image "docker.io/library/httpd:2.4.38-alpine",},Running:nil,Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:false,RestartCount:0,Image:docker.io/library/httpd:2.4.38-alpine,ImageID:,ContainerID:,Started:*false,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{PodIP{IP:10.244.3.227,},},EphemeralContainerStatuses:[]ContainerStatus{},},} [AfterEach] [sig-apps] Deployment /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "deployment-3014". STEP: Found 8 events. Aug 18 11:32:04.716: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for test-rollover-controller-n75gh: { } Scheduled: Successfully assigned deployment-3014/test-rollover-controller-n75gh to node2 Aug 18 11:32:04.716: INFO: At 2021-08-18 11:26:59 +0000 UTC - event for test-rollover-controller: {replicaset-controller } SuccessfulCreate: Created pod: test-rollover-controller-n75gh Aug 18 11:32:04.716: INFO: At 2021-08-18 11:27:02 +0000 UTC - event for test-rollover-controller-n75gh: {kubelet node2} Pulling: Pulling image "docker.io/library/httpd:2.4.38-alpine" Aug 18 11:32:04.716: INFO: At 2021-08-18 11:27:02 +0000 UTC - event for test-rollover-controller-n75gh: {multus } AddedInterface: Add eth0 [10.244.3.227/24] Aug 18 11:32:04.716: INFO: At 2021-08-18 11:27:03 +0000 UTC - event for test-rollover-controller-n75gh: {kubelet node2} Failed: Failed to pull image "docker.io/library/httpd:2.4.38-alpine": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit Aug 18 11:32:04.716: INFO: At 2021-08-18 11:27:03 +0000 UTC - event for test-rollover-controller-n75gh: {kubelet node2} Failed: Error: ErrImagePull Aug 18 11:32:04.716: INFO: At 2021-08-18 11:27:04 +0000 UTC - event for test-rollover-controller-n75gh: {kubelet node2} BackOff: Back-off pulling image "docker.io/library/httpd:2.4.38-alpine" Aug 18 11:32:04.716: INFO: At 2021-08-18 11:27:04 +0000 UTC - event for test-rollover-controller-n75gh: {kubelet node2} Failed: Error: ImagePullBackOff Aug 18 11:32:04.719: INFO: POD NODE PHASE GRACE CONDITIONS Aug 18 11:32:04.719: INFO: test-rollover-controller-n75gh node2 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:26:59 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:26:59 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:26:59 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:26:59 +0000 UTC }] Aug 18 11:32:04.719: INFO: Aug 18 11:32:04.724: INFO: Logging node info for node master1 Aug 18 11:32:04.727: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 ebb211fa-503f-4cfe-b1ed-c95d27a70e6e 59940 0 2021-08-18 08:20:52 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"3a:82:be:72:b5:15"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:20:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:20:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:25:59 +0000 UTC,LastTransitionTime:2021-08-18 08:25:59 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:03 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:03 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:03 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:32:03 +0000 UTC,LastTransitionTime:2021-08-18 08:25:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:58c3e57359b641ad92fa1959f2fecf5d,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:012cd796-2076-45d6-8b14-d3e0451b1e64,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[@ :],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:32:04.728: INFO: Logging kubelet events for node master1 Aug 18 11:32:04.730: INFO: Logging pods the kubelet thinks is on node master1 Aug 18 11:32:04.750: INFO: kube-apiserver-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:04.750: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:32:04.750: INFO: kube-proxy-vqk4v started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:04.750: INFO: Container kube-proxy ready: true, restart count 1 Aug 18 11:32:04.750: INFO: kube-flannel-q64cq started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:32:04.750: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:32:04.750: INFO: Container kube-flannel ready: true, restart count 3 Aug 18 11:32:04.750: INFO: coredns-7677f9bb54-kn2qg started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:04.750: INFO: Container coredns ready: true, restart count 2 Aug 18 11:32:04.750: INFO: kube-scheduler-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:04.750: INFO: Container kube-scheduler ready: true, restart count 0 Aug 18 11:32:04.750: INFO: kube-controller-manager-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:04.750: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:32:04.750: INFO: kube-multus-ds-amd64-kbcp6 started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:04.750: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:32:04.750: INFO: docker-registry-docker-registry-56cbc7bc58-49kl2 started at 2021-08-18 08:26:23 +0000 UTC (0+2 container statuses recorded) Aug 18 11:32:04.750: INFO: Container docker-registry ready: true, restart count 0 Aug 18 11:32:04.750: INFO: Container nginx ready: true, restart count 0 Aug 18 11:32:04.750: INFO: node-exporter-5hwz9 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:32:04.750: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:32:04.750: INFO: Container node-exporter ready: true, restart count 0 W0818 11:32:04.763488 26 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:32:04.788: INFO: Latency metrics for node master1 Aug 18 11:32:04.788: INFO: Logging node info for node master2 Aug 18 11:32:04.791: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 78946293-3abe-4442-84d4-8ed6b1d15ce0 59934 0 2021-08-18 08:21:31 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"7e:f5:c2:cc:3a:b4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:21:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:21:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-08-18 08:29:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:02 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:02 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:02 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:32:02 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0c44122c7a7248c18d8571e1cc667258,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:0cd329f2-48e0-4c8f-b8b9-fa3ae0ed8406,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:32:04.791: INFO: Logging kubelet events for node master2 Aug 18 11:32:04.794: INFO: Logging pods the kubelet thinks is on node master2 Aug 18 11:32:04.803: INFO: kube-controller-manager-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:04.803: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:32:04.804: INFO: kube-proxy-kh2l9 started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:04.804: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:32:04.804: INFO: kube-flannel-pp56h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:32:04.804: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:32:04.804: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:32:04.804: INFO: dns-autoscaler-5b7b5c9b6f-hh47r started at 2021-08-18 08:23:57 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:04.804: INFO: Container autoscaler ready: true, restart count 2 Aug 18 11:32:04.804: INFO: node-feature-discovery-controller-5bf5c49849-mq57c started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:04.804: INFO: Container nfd-controller ready: true, restart count 0 Aug 18 11:32:04.804: INFO: node-exporter-48nfx started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:32:04.804: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:32:04.804: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:32:04.804: INFO: kube-apiserver-master2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:04.804: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:32:04.804: INFO: kube-scheduler-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:04.804: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:32:04.804: INFO: kube-multus-ds-amd64-mld8g started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:04.804: INFO: Container kube-multus ready: true, restart count 1 W0818 11:32:04.816109 26 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:32:04.839: INFO: Latency metrics for node master2 Aug 18 11:32:04.839: INFO: Logging node info for node master3 Aug 18 11:32:04.842: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 44feac2b-9447-4be2-9fcd-62f836d67c72 59894 0 2021-08-18 08:21:41 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"86:e4:31:99:58:40"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {kubelet Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:31:57 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:31:57 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:31:57 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:31:57 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1fae19ae59884c44899bcd08aa243244,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:5db926c5-6530-4635-a0d5-806974a3b732,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:32:04.843: INFO: Logging kubelet events for node master3 Aug 18 11:32:04.845: INFO: Logging pods the kubelet thinks is on node master3 Aug 18 11:32:04.852: INFO: node-exporter-vq7d8 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:32:04.852: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:32:04.852: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:32:04.852: INFO: kube-controller-manager-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:04.852: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:32:04.852: INFO: kube-scheduler-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:04.852: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:32:04.852: INFO: kube-apiserver-master3 started at 2021-08-18 08:29:12 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:04.852: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:32:04.852: INFO: kube-proxy-sd5lc started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:04.852: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:32:04.852: INFO: kube-flannel-x6tlr started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:32:04.852: INFO: Init container install-cni ready: true, restart count 1 Aug 18 11:32:04.852: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:32:04.852: INFO: kube-multus-ds-amd64-bkw6c started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:04.852: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:32:04.852: INFO: coredns-7677f9bb54-5hxfh started at 2021-08-18 08:23:54 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:04.852: INFO: Container coredns ready: true, restart count 1 W0818 11:32:04.865981 26 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:32:04.889: INFO: Latency metrics for node master3 Aug 18 11:32:04.889: INFO: Logging node info for node node1 Aug 18 11:32:04.891: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 84defabd-6ebf-43ec-a629-44c6713da9c9 59905 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"9a:87:55:36:7b:df"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:13 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:35 +0000 UTC,LastTransitionTime:2021-08-18 08:26:35 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:31:59 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:31:59 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:31:59 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:31:59 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:69946ff2b7bc462fa25eb7adb4703c23,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:736dc52f-f5e3-494e-86ca-01eedbea015c,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:a7cea43d9d2f67c38fbf0407786edbe660ee9072945f7bb272b55fd255e8eaca opnfv/barometer-collectd:stable],SizeBytes:1075746799,},ContainerImage{Names:[@ :],SizeBytes:1003788820,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[aquasec/kube-hunter@sha256:2be6820bc1d7e0f57193a9a27d5a3e16b2fd93c53747b03ce8ca48c6fc323781 aquasec/kube-hunter:0.3.1],SizeBytes:347611549,},ContainerImage{Names:[golang@sha256:db2475a1dbb2149508e5db31d7d77a75e6600d54be645f37681f03f2762169ba golang:alpine3.12],SizeBytes:301186719,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:de25c7fc6c4f3a27c7f0c2dff454e4671823a34d88abd533f210848d527e0fbb alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:32:04.892: INFO: Logging kubelet events for node node1 Aug 18 11:32:04.894: INFO: Logging pods the kubelet thinks is on node node1 Aug 18 11:32:04.917: INFO: kube-flannel-q78nd started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:32:04.917: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:32:04.917: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:32:04.917: INFO: prometheus-k8s-0 started at 2021-08-18 08:34:03 +0000 UTC (0+5 container statuses recorded) Aug 18 11:32:04.917: INFO: Container custom-metrics-apiserver ready: true, restart count 0 Aug 18 11:32:04.917: INFO: Container grafana ready: true, restart count 0 Aug 18 11:32:04.917: INFO: Container prometheus ready: true, restart count 1 Aug 18 11:32:04.917: INFO: Container prometheus-config-reloader ready: true, restart count 0 Aug 18 11:32:04.917: INFO: Container rules-configmap-reloader ready: true, restart count 0 Aug 18 11:32:04.917: INFO: test-rolling-update-controller-wx48f started at 2021-08-18 11:29:47 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:04.917: INFO: Container httpd ready: false, restart count 0 Aug 18 11:32:04.917: INFO: test-webserver-61a86e95-c56e-477f-8a08-403249c2a07a started at 2021-08-18 11:31:37 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:04.917: INFO: Container test-webserver ready: true, restart count 0 Aug 18 11:32:04.917: INFO: ss2-1 started at 2021-08-18 11:26:31 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:04.917: INFO: Container webserver ready: true, restart count 0 Aug 18 11:32:04.917: INFO: kube-multus-ds-amd64-rrvmb started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:04.917: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:32:04.917: INFO: node-feature-discovery-worker-pflgw started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:04.917: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:32:04.917: INFO: node-exporter-kcwvn started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:32:04.917: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:32:04.917: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:32:04.917: INFO: pod-init-b68a6dc1-5b80-476f-a5fe-c89c90dac8b1 started at 2021-08-18 11:27:37 +0000 UTC (2+1 container statuses recorded) Aug 18 11:32:04.917: INFO: Init container init1 ready: false, restart count 0 Aug 18 11:32:04.917: INFO: Init container init2 ready: false, restart count 0 Aug 18 11:32:04.917: INFO: Container run1 ready: false, restart count 0 Aug 18 11:32:04.917: INFO: labelsupdate6d13f820-2ca1-40a0-8b73-fdd72ab45b4e started at 2021-08-18 11:32:04 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:04.917: INFO: Container client-container ready: false, restart count 0 Aug 18 11:32:04.917: INFO: ss2-0 started at 2021-08-18 11:26:45 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:04.917: INFO: Container webserver ready: true, restart count 0 Aug 18 11:32:04.917: INFO: downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25 started at 2021-08-18 11:27:11 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:04.917: INFO: Container dapi-container ready: false, restart count 0 Aug 18 11:32:04.917: INFO: kube-proxy-p6jvp started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:04.917: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:32:04.917: INFO: kubernetes-metrics-scraper-678c97765c-9nsv5 started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:04.917: INFO: Container kubernetes-metrics-scraper ready: true, restart count 2 Aug 18 11:32:04.917: INFO: cmk-init-discover-node1-bxznx started at 2021-08-18 08:32:10 +0000 UTC (0+3 container statuses recorded) Aug 18 11:32:04.917: INFO: Container discover ready: false, restart count 0 Aug 18 11:32:04.917: INFO: Container init ready: false, restart count 0 Aug 18 11:32:04.917: INFO: Container install ready: false, restart count 0 Aug 18 11:32:04.917: INFO: cmk-d8r27 started at 2021-08-18 08:32:52 +0000 UTC (0+2 container statuses recorded) Aug 18 11:32:04.917: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:32:04.917: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:32:04.917: INFO: collectd-xdprr started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:32:04.917: INFO: Container collectd ready: true, restart count 0 Aug 18 11:32:04.917: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:32:04.917: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:32:04.917: INFO: pod-submit-remove-74dabc56-7cc6-4841-8b80-3d7505da846f started at 2021-08-18 11:27:24 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:04.917: INFO: Container nginx ready: false, restart count 0 Aug 18 11:32:04.917: INFO: nginx-proxy-node1 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:04.917: INFO: Container nginx-proxy ready: true, restart count 2 Aug 18 11:32:04.917: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-vsxvg started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:04.917: INFO: Container kube-sriovdp ready: true, restart count 0 W0818 11:32:04.928996 26 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:32:04.983: INFO: Latency metrics for node node1 Aug 18 11:32:04.983: INFO: Logging node info for node node2 Aug 18 11:32:04.985: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 1d01177e-3dbb-48a1-a0bc-d18af27ab7f8 59925 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:d1:47:f8:1d:22"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:36 +0000 UTC,LastTransitionTime:2021-08-18 08:26:36 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:00 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:00 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:00 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:32:00 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:dc1f286135c145349b8a016880b65a2f,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:037e7e2d-94e9-42f4-a719-896e5005ac70,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:32:04.986: INFO: Logging kubelet events for node node2 Aug 18 11:32:04.988: INFO: Logging pods the kubelet thinks is on node node2 Aug 18 11:32:05.002: INFO: prometheus-operator-5bb8cb9d8f-k97ws started at 2021-08-18 08:33:38 +0000 UTC (0+2 container statuses recorded) Aug 18 11:32:05.002: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:32:05.002: INFO: Container prometheus-operator ready: true, restart count 0 Aug 18 11:32:05.002: INFO: kube-proxy-qkj9c started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:05.002: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:32:05.002: INFO: node-feature-discovery-worker-hzpf5 started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:05.002: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:32:05.002: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-c82pt started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:05.002: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:32:05.002: INFO: var-expansion-cf1f3322-29ba-472a-9702-20756a20f986 started at 2021-08-18 11:28:58 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:05.002: INFO: Container dapi-container ready: false, restart count 0 Aug 18 11:32:05.002: INFO: kube-multus-ds-amd64-rvzsg started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:05.002: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:32:05.002: INFO: collectd-67ntq started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:32:05.002: INFO: Container collectd ready: true, restart count 0 Aug 18 11:32:05.002: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:32:05.002: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:32:05.002: INFO: downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a started at 2021-08-18 11:31:01 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:05.002: INFO: Container dapi-container ready: false, restart count 0 Aug 18 11:32:05.002: INFO: cmk-webhook-6c9d5f8578-7cxjr started at 2021-08-18 08:32:53 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:05.002: INFO: Container cmk-webhook ready: true, restart count 0 Aug 18 11:32:05.002: INFO: kube-flannel-h7t5h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:32:05.002: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:32:05.002: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:32:05.002: INFO: node-exporter-lrrf2 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:32:05.002: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:32:05.002: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:32:05.002: INFO: var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15 started at 2021-08-18 11:27:32 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:05.002: INFO: Container dapi-container ready: false, restart count 0 Aug 18 11:32:05.002: INFO: ss2-2 started at 2021-08-18 11:27:31 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:05.002: INFO: Container webserver ready: false, restart count 0 Aug 18 11:32:05.002: INFO: nginx-proxy-node2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:05.002: INFO: Container nginx-proxy ready: true, restart count 1 Aug 18 11:32:05.002: INFO: cmk-init-discover-node2-6b2kz started at 2021-08-18 08:32:30 +0000 UTC (0+3 container statuses recorded) Aug 18 11:32:05.002: INFO: Container discover ready: false, restart count 0 Aug 18 11:32:05.002: INFO: Container init ready: false, restart count 0 Aug 18 11:32:05.002: INFO: Container install ready: false, restart count 0 Aug 18 11:32:05.002: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-7rn45 started at 2021-08-18 08:36:42 +0000 UTC (0+2 container statuses recorded) Aug 18 11:32:05.002: INFO: Container tas-controller ready: true, restart count 0 Aug 18 11:32:05.002: INFO: Container tas-extender ready: true, restart count 0 Aug 18 11:32:05.002: INFO: kubernetes-dashboard-86c6f9df5b-qrtdk started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:05.002: INFO: Container kubernetes-dashboard ready: true, restart count 2 Aug 18 11:32:05.002: INFO: test-rollover-controller-n75gh started at 2021-08-18 11:26:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:05.002: INFO: Container httpd ready: false, restart count 0 Aug 18 11:32:05.002: INFO: cmk-748rz started at 2021-08-18 08:32:53 +0000 UTC (0+2 container statuses recorded) Aug 18 11:32:05.002: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:32:05.002: INFO: Container reconcile ready: true, restart count 0 W0818 11:32:05.014862 26 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:32:05.061: INFO: Latency metrics for node node2 Aug 18 11:32:05.061: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "deployment-3014" for this suite. • Failure [305.401 seconds] [sig-apps] Deployment /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/framework.go:23 deployment should support rollover [Conformance] [It] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:32:04.704: error in waiting for pods to come up: failed to wait for pods running: [timed out waiting for the condition] Unexpected error: <*errors.errorString | 0xc0021d6850>: { s: "failed to wait for pods running: [timed out waiting for the condition]", } failed to wait for pods running: [timed out waiting for the condition] occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/deployment.go:438 ------------------------------ {"msg":"FAILED [sig-apps] Deployment deployment should support rollover [Conformance]","total":-1,"completed":9,"skipped":127,"failed":1,"failures":["[sig-apps] Deployment deployment should support rollover [Conformance]"]} SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-network] DNS /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:32:05.183: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename dns STEP: Waiting for a default service account to be provisioned in namespace [It] should provide DNS for pods for Hostname [LinuxOnly] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating a test headless service STEP: Running these commands on wheezy: for i in `seq 1 600`; do test -n "$$(getent hosts dns-querier-2.dns-test-service-2.dns-7689.svc.cluster.local)" && echo OK > /results/wheezy_hosts@dns-querier-2.dns-test-service-2.dns-7689.svc.cluster.local;test -n "$$(getent hosts dns-querier-2)" && echo OK > /results/wheezy_hosts@dns-querier-2;podARec=$$(hostname -i| awk -F. '{print $$1"-"$$2"-"$$3"-"$$4".dns-7689.pod.cluster.local"}');check="$$(dig +notcp +noall +answer +search $${podARec} A)" && test -n "$$check" && echo OK > /results/wheezy_udp@PodARecord;check="$$(dig +tcp +noall +answer +search $${podARec} A)" && test -n "$$check" && echo OK > /results/wheezy_tcp@PodARecord;sleep 1; done STEP: Running these commands on jessie: for i in `seq 1 600`; do test -n "$$(getent hosts dns-querier-2.dns-test-service-2.dns-7689.svc.cluster.local)" && echo OK > /results/jessie_hosts@dns-querier-2.dns-test-service-2.dns-7689.svc.cluster.local;test -n "$$(getent hosts dns-querier-2)" && echo OK > /results/jessie_hosts@dns-querier-2;podARec=$$(hostname -i| awk -F. '{print $$1"-"$$2"-"$$3"-"$$4".dns-7689.pod.cluster.local"}');check="$$(dig +notcp +noall +answer +search $${podARec} A)" && test -n "$$check" && echo OK > /results/jessie_udp@PodARecord;check="$$(dig +tcp +noall +answer +search $${podARec} A)" && test -n "$$check" && echo OK > /results/jessie_tcp@PodARecord;sleep 1; done STEP: creating a pod to probe DNS STEP: submitting the pod to kubernetes STEP: retrieving the pod STEP: looking for the results for each expected name from probers Aug 18 11:32:09.257: INFO: DNS probes using dns-7689/dns-test-a3eeb3b7-e9b5-476e-b29a-175991a26cc3 succeeded STEP: deleting the pod STEP: deleting the test headless service [AfterEach] [sig-network] DNS /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:32:09.272: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "dns-7689" for this suite. • ------------------------------ {"msg":"PASSED [sig-network] DNS should provide DNS for pods for Hostname [LinuxOnly] [Conformance]","total":-1,"completed":10,"skipped":175,"failed":1,"failures":["[sig-apps] Deployment deployment should support rollover [Conformance]"]} SSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-storage] Projected downwardAPI /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:32:04.442: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename projected STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-storage] Projected downwardAPI /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/projected_downwardapi.go:42 [It] should update labels on modification [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating the pod Aug 18 11:32:08.999: INFO: Successfully updated pod "labelsupdate6d13f820-2ca1-40a0-8b73-fdd72ab45b4e" [AfterEach] [sig-storage] Projected downwardAPI /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:32:11.013: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "projected-4450" for this suite. • [SLOW TEST:6.579 seconds] [sig-storage] Projected downwardAPI /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/projected_downwardapi.go:36 should update labels on modification [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-storage] Projected downwardAPI should update labels on modification [NodeConformance] [Conformance]","total":-1,"completed":17,"skipped":358,"failed":1,"failures":["[sig-network] Services should be able to create a functioning NodePort service [Conformance]"]} SSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-node] Downward API /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:27:11.301: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename downward-api STEP: Waiting for a default service account to be provisioned in namespace [It] should provide host IP as an env var [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating a pod to test downward api env vars Aug 18 11:27:11.337: INFO: Waiting up to 5m0s for pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25" in namespace "downward-api-3052" to be "Succeeded or Failed" Aug 18 11:27:11.341: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 4.104474ms Aug 18 11:27:13.345: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 2.007546217s Aug 18 11:27:15.349: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 4.011791846s Aug 18 11:27:17.353: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 6.015235491s Aug 18 11:27:19.356: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 8.019106336s Aug 18 11:27:21.360: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 10.022207191s Aug 18 11:27:23.362: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 12.024929203s Aug 18 11:27:25.365: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 14.028132054s Aug 18 11:27:27.369: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 16.031542148s Aug 18 11:27:29.372: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 18.035144707s Aug 18 11:27:31.376: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 20.038447575s Aug 18 11:27:33.379: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 22.042115158s Aug 18 11:27:35.383: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 24.045929764s Aug 18 11:27:37.386: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 26.04896117s Aug 18 11:27:39.390: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 28.052905355s Aug 18 11:27:41.393: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 30.055803948s Aug 18 11:27:43.396: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 32.058645255s Aug 18 11:27:45.399: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 34.061680793s Aug 18 11:27:47.402: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 36.064257236s Aug 18 11:27:49.405: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 38.06727513s Aug 18 11:27:51.412: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 40.074207723s Aug 18 11:27:53.417: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 42.079299439s Aug 18 11:27:55.424: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 44.086355696s Aug 18 11:27:57.427: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 46.08947663s Aug 18 11:27:59.430: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 48.092445991s Aug 18 11:28:01.433: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 50.095551334s Aug 18 11:28:03.437: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 52.100112177s Aug 18 11:28:05.440: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 54.103054185s Aug 18 11:28:07.443: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 56.106020608s Aug 18 11:28:09.447: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 58.109402678s Aug 18 11:28:11.449: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.11206942s Aug 18 11:28:13.452: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.11500939s Aug 18 11:28:15.456: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.118698804s Aug 18 11:28:17.459: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.121955355s Aug 18 11:28:19.463: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.125230689s Aug 18 11:28:21.466: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.129011068s Aug 18 11:28:23.470: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.132710645s Aug 18 11:28:25.473: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.135287311s Aug 18 11:28:27.476: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.138549981s Aug 18 11:28:29.479: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.141281574s Aug 18 11:28:31.483: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.145268374s Aug 18 11:28:33.486: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.148487737s Aug 18 11:28:35.489: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.152057435s Aug 18 11:28:37.493: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.155419763s Aug 18 11:28:39.496: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.158329077s Aug 18 11:28:41.498: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.161052893s Aug 18 11:28:43.502: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.164443925s Aug 18 11:28:45.505: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.167583727s Aug 18 11:28:47.508: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.170883106s Aug 18 11:28:49.512: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.174662719s Aug 18 11:28:51.516: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.178958052s Aug 18 11:28:53.520: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.182216047s Aug 18 11:28:55.522: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.18511425s Aug 18 11:28:57.526: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.188808703s Aug 18 11:28:59.529: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.191369505s Aug 18 11:29:01.533: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.19532281s Aug 18 11:29:03.536: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.198507519s Aug 18 11:29:05.539: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.202127464s Aug 18 11:29:07.542: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.2051373s Aug 18 11:29:09.545: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.207803913s Aug 18 11:29:11.548: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.210907844s Aug 18 11:29:13.551: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.214068374s Aug 18 11:29:15.556: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.218266411s Aug 18 11:29:17.559: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.221592473s Aug 18 11:29:19.562: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.225047869s Aug 18 11:29:21.568: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.230288375s Aug 18 11:29:23.572: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.234446525s Aug 18 11:29:25.575: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.23737074s Aug 18 11:29:27.577: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.239868338s Aug 18 11:29:29.581: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.243505758s Aug 18 11:29:31.584: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.247135197s Aug 18 11:29:33.587: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.250107368s Aug 18 11:29:35.591: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.253896829s Aug 18 11:29:37.595: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.257506824s Aug 18 11:29:39.599: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.261264901s Aug 18 11:29:41.604: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.266231538s Aug 18 11:29:43.608: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.270660962s Aug 18 11:29:45.611: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.274178924s Aug 18 11:29:47.615: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.277250671s Aug 18 11:29:49.618: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.280841887s Aug 18 11:29:51.621: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.284098544s Aug 18 11:29:53.625: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.287612482s Aug 18 11:29:55.629: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.291802811s Aug 18 11:29:57.633: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.295822687s Aug 18 11:29:59.636: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.298708687s Aug 18 11:30:01.640: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.302242742s Aug 18 11:30:03.643: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.305942367s Aug 18 11:30:05.647: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.309554357s Aug 18 11:30:07.650: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.312651449s Aug 18 11:30:09.655: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.317610233s Aug 18 11:30:11.658: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.320507185s Aug 18 11:30:13.661: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.3240956s Aug 18 11:30:15.668: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.330299697s Aug 18 11:30:17.672: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.334382945s Aug 18 11:30:19.675: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.337819111s Aug 18 11:30:21.679: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.341526964s Aug 18 11:30:23.683: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.345205467s Aug 18 11:30:25.687: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.349263007s Aug 18 11:30:27.690: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.352377578s Aug 18 11:30:29.693: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.356065328s Aug 18 11:30:31.697: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.360047577s Aug 18 11:30:33.701: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.364171085s Aug 18 11:30:35.706: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.368294939s Aug 18 11:30:37.709: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.371972918s Aug 18 11:30:39.712: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.375135882s Aug 18 11:30:41.716: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.379165197s Aug 18 11:30:43.721: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.383355203s Aug 18 11:30:45.725: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.38731465s Aug 18 11:30:47.727: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.390037749s Aug 18 11:30:49.731: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.394025005s Aug 18 11:30:51.735: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.397794009s Aug 18 11:30:53.739: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.401592813s Aug 18 11:30:55.742: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.405166316s Aug 18 11:30:57.747: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.409226095s Aug 18 11:30:59.751: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.413642925s Aug 18 11:31:01.753: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.416152485s Aug 18 11:31:03.757: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.419990179s Aug 18 11:31:05.760: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.422835355s Aug 18 11:31:07.764: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.426565202s Aug 18 11:31:09.768: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.430931846s Aug 18 11:31:11.772: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.434577963s Aug 18 11:31:13.775: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.437760899s Aug 18 11:31:15.780: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.442379946s Aug 18 11:31:17.785: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.447349183s Aug 18 11:31:19.790: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.453122053s Aug 18 11:31:21.794: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.457110481s Aug 18 11:31:23.800: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.462581805s Aug 18 11:31:25.805: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.467967211s Aug 18 11:31:27.810: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.472227918s Aug 18 11:31:29.812: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.474859572s Aug 18 11:31:31.818: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.480884592s Aug 18 11:31:33.821: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.484012463s Aug 18 11:31:35.824: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.4870172s Aug 18 11:31:37.828: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.490498927s Aug 18 11:31:39.833: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.495347524s Aug 18 11:31:41.837: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.499315658s Aug 18 11:31:43.843: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.505229118s Aug 18 11:31:45.846: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.509166534s Aug 18 11:31:47.850: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.512569326s Aug 18 11:31:49.853: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.51612032s Aug 18 11:31:51.857: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.519899187s Aug 18 11:31:53.861: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.523220863s Aug 18 11:31:55.865: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.527398528s Aug 18 11:31:57.867: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.53007101s Aug 18 11:31:59.870: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.53306681s Aug 18 11:32:01.875: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.537508098s Aug 18 11:32:03.879: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.542055675s Aug 18 11:32:05.884: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.546895756s Aug 18 11:32:07.887: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.550111088s Aug 18 11:32:09.891: INFO: Pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.553242918s Aug 18 11:32:11.904: INFO: Failed to get logs from node "node1" pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25" container "dapi-container": the server rejected our request for an unknown reason (get pods downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25) STEP: delete the pod Aug 18 11:32:11.910: INFO: Waiting for pod downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25 to disappear Aug 18 11:32:11.913: INFO: Pod downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25 still exists Aug 18 11:32:13.914: INFO: Waiting for pod downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25 to disappear Aug 18 11:32:13.917: INFO: Pod downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25 still exists Aug 18 11:32:15.915: INFO: Waiting for pod downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25 to disappear Aug 18 11:32:15.918: INFO: Pod downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25 no longer exists Aug 18 11:32:15.919: FAIL: Unexpected error: <*errors.errorString | 0xc003426ea0>: { s: "expected pod \"downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25\" success: Gave up after waiting 5m0s for pod \"downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25\" to be \"Succeeded or Failed\"", } expected pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25" success: Gave up after waiting 5m0s for pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25" to be "Succeeded or Failed" occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).testContainerOutputMatcher(0xc0001b26e0, 0x4c3168b, 0x15, 0xc002d94c00, 0x0, 0xc001c6f1a8, 0x1, 0x1, 0x4deefb0) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 +0x1ee k8s.io/kubernetes/test/e2e/framework.(*Framework).TestContainerOutputRegexp(...) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:532 k8s.io/kubernetes/test/e2e/common.testDownwardAPIUsingPod(...) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/downward_api.go:425 k8s.io/kubernetes/test/e2e/common.testDownwardAPI(0xc0001b26e0, 0xc00316b080, 0x31, 0xc003081d10, 0x1, 0x1, 0xc001c6f1a8, 0x1, 0x1) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/downward_api.go:391 +0x75c k8s.io/kubernetes/test/e2e/common.glob..func5.2() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/downward_api.go:106 +0x21d k8s.io/kubernetes/test/e2e.RunE2ETests(0xc001283680) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc001283680) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc001283680, 0x4deb2c0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [sig-node] Downward API /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "downward-api-3052". STEP: Found 11 events. Aug 18 11:32:15.925: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25: { } Scheduled: Successfully assigned downward-api-3052/downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25 to node1 Aug 18 11:32:15.925: INFO: At 2021-08-18 11:27:12 +0000 UTC - event for downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25: {multus } AddedInterface: Add eth0 [10.244.4.241/24] Aug 18 11:32:15.925: INFO: At 2021-08-18 11:27:12 +0000 UTC - event for downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25: {kubelet node1} Pulling: Pulling image "docker.io/library/busybox:1.29" Aug 18 11:32:15.925: INFO: At 2021-08-18 11:27:13 +0000 UTC - event for downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25: {kubelet node1} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit Aug 18 11:32:15.925: INFO: At 2021-08-18 11:27:13 +0000 UTC - event for downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25: {kubelet node1} Failed: Error: ErrImagePull Aug 18 11:32:15.925: INFO: At 2021-08-18 11:27:13 +0000 UTC - event for downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25: {kubelet node1} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Aug 18 11:32:15.925: INFO: At 2021-08-18 11:27:16 +0000 UTC - event for downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25: {multus } AddedInterface: Add eth0 [10.244.4.242/24] Aug 18 11:32:15.925: INFO: At 2021-08-18 11:27:16 +0000 UTC - event for downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25: {kubelet node1} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" Aug 18 11:32:15.925: INFO: At 2021-08-18 11:27:16 +0000 UTC - event for downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25: {kubelet node1} Failed: Error: ImagePullBackOff Aug 18 11:32:15.925: INFO: At 2021-08-18 11:27:20 +0000 UTC - event for downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25: {multus } AddedInterface: Add eth0 [10.244.4.245/24] Aug 18 11:32:15.925: INFO: At 2021-08-18 11:27:23 +0000 UTC - event for downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25: {multus } AddedInterface: Add eth0 [10.244.4.246/24] Aug 18 11:32:15.928: INFO: POD NODE PHASE GRACE CONDITIONS Aug 18 11:32:15.928: INFO: Aug 18 11:32:15.932: INFO: Logging node info for node master1 Aug 18 11:32:15.934: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 ebb211fa-503f-4cfe-b1ed-c95d27a70e6e 60120 0 2021-08-18 08:20:52 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"3a:82:be:72:b5:15"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:20:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:20:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:25:59 +0000 UTC,LastTransitionTime:2021-08-18 08:25:59 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:13 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:13 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:13 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:32:13 +0000 UTC,LastTransitionTime:2021-08-18 08:25:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:58c3e57359b641ad92fa1959f2fecf5d,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:012cd796-2076-45d6-8b14-d3e0451b1e64,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[@ :],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:32:15.935: INFO: Logging kubelet events for node master1 Aug 18 11:32:15.938: INFO: Logging pods the kubelet thinks is on node master1 Aug 18 11:32:15.959: INFO: kube-controller-manager-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:15.959: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:32:15.959: INFO: kube-multus-ds-amd64-kbcp6 started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:15.959: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:32:15.959: INFO: docker-registry-docker-registry-56cbc7bc58-49kl2 started at 2021-08-18 08:26:23 +0000 UTC (0+2 container statuses recorded) Aug 18 11:32:15.959: INFO: Container docker-registry ready: true, restart count 0 Aug 18 11:32:15.959: INFO: Container nginx ready: true, restart count 0 Aug 18 11:32:15.959: INFO: node-exporter-5hwz9 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:32:15.959: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:32:15.959: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:32:15.959: INFO: kube-apiserver-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:15.959: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:32:15.959: INFO: kube-proxy-vqk4v started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:15.959: INFO: Container kube-proxy ready: true, restart count 1 Aug 18 11:32:15.959: INFO: kube-flannel-q64cq started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:32:15.959: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:32:15.959: INFO: Container kube-flannel ready: true, restart count 3 Aug 18 11:32:15.959: INFO: coredns-7677f9bb54-kn2qg started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:15.959: INFO: Container coredns ready: true, restart count 2 Aug 18 11:32:15.959: INFO: kube-scheduler-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:15.959: INFO: Container kube-scheduler ready: true, restart count 0 W0818 11:32:15.970661 27 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:32:15.993: INFO: Latency metrics for node master1 Aug 18 11:32:15.993: INFO: Logging node info for node master2 Aug 18 11:32:15.996: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 78946293-3abe-4442-84d4-8ed6b1d15ce0 60113 0 2021-08-18 08:21:31 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"7e:f5:c2:cc:3a:b4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:21:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:21:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-08-18 08:29:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:12 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:12 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:12 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:32:12 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0c44122c7a7248c18d8571e1cc667258,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:0cd329f2-48e0-4c8f-b8b9-fa3ae0ed8406,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:32:15.996: INFO: Logging kubelet events for node master2 Aug 18 11:32:15.998: INFO: Logging pods the kubelet thinks is on node master2 Aug 18 11:32:16.007: INFO: kube-apiserver-master2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:16.007: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:32:16.007: INFO: kube-scheduler-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:16.007: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:32:16.007: INFO: kube-multus-ds-amd64-mld8g started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:16.007: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:32:16.007: INFO: dns-autoscaler-5b7b5c9b6f-hh47r started at 2021-08-18 08:23:57 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:16.007: INFO: Container autoscaler ready: true, restart count 2 Aug 18 11:32:16.007: INFO: node-feature-discovery-controller-5bf5c49849-mq57c started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:16.007: INFO: Container nfd-controller ready: true, restart count 0 Aug 18 11:32:16.007: INFO: node-exporter-48nfx started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:32:16.007: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:32:16.007: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:32:16.007: INFO: kube-controller-manager-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:16.007: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:32:16.007: INFO: kube-proxy-kh2l9 started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:16.007: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:32:16.007: INFO: kube-flannel-pp56h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:32:16.007: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:32:16.007: INFO: Container kube-flannel ready: true, restart count 1 W0818 11:32:16.018696 27 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:32:16.042: INFO: Latency metrics for node master2 Aug 18 11:32:16.042: INFO: Logging node info for node master3 Aug 18 11:32:16.045: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 44feac2b-9447-4be2-9fcd-62f836d67c72 60009 0 2021-08-18 08:21:41 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"86:e4:31:99:58:40"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {kubelet Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:07 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:07 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:07 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:32:07 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1fae19ae59884c44899bcd08aa243244,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:5db926c5-6530-4635-a0d5-806974a3b732,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:32:16.045: INFO: Logging kubelet events for node master3 Aug 18 11:32:16.047: INFO: Logging pods the kubelet thinks is on node master3 Aug 18 11:32:16.056: INFO: coredns-7677f9bb54-5hxfh started at 2021-08-18 08:23:54 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:16.056: INFO: Container coredns ready: true, restart count 1 Aug 18 11:32:16.056: INFO: node-exporter-vq7d8 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:32:16.056: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:32:16.056: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:32:16.056: INFO: kube-controller-manager-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:16.056: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:32:16.056: INFO: kube-scheduler-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:16.056: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:32:16.056: INFO: kube-apiserver-master3 started at 2021-08-18 08:29:12 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:16.056: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:32:16.056: INFO: kube-proxy-sd5lc started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:16.056: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:32:16.056: INFO: kube-flannel-x6tlr started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:32:16.056: INFO: Init container install-cni ready: true, restart count 1 Aug 18 11:32:16.056: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:32:16.056: INFO: kube-multus-ds-amd64-bkw6c started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:16.056: INFO: Container kube-multus ready: true, restart count 1 W0818 11:32:16.069384 27 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:32:16.092: INFO: Latency metrics for node master3 Aug 18 11:32:16.092: INFO: Logging node info for node node1 Aug 18 11:32:16.094: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 84defabd-6ebf-43ec-a629-44c6713da9c9 60060 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"9a:87:55:36:7b:df"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:13 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:35 +0000 UTC,LastTransitionTime:2021-08-18 08:26:35 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:09 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:09 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:09 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:32:09 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:69946ff2b7bc462fa25eb7adb4703c23,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:736dc52f-f5e3-494e-86ca-01eedbea015c,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:a7cea43d9d2f67c38fbf0407786edbe660ee9072945f7bb272b55fd255e8eaca opnfv/barometer-collectd:stable],SizeBytes:1075746799,},ContainerImage{Names:[@ :],SizeBytes:1003788820,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[aquasec/kube-hunter@sha256:2be6820bc1d7e0f57193a9a27d5a3e16b2fd93c53747b03ce8ca48c6fc323781 aquasec/kube-hunter:0.3.1],SizeBytes:347611549,},ContainerImage{Names:[golang@sha256:db2475a1dbb2149508e5db31d7d77a75e6600d54be645f37681f03f2762169ba golang:alpine3.12],SizeBytes:301186719,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:de25c7fc6c4f3a27c7f0c2dff454e4671823a34d88abd533f210848d527e0fbb alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:32:16.095: INFO: Logging kubelet events for node node1 Aug 18 11:32:16.097: INFO: Logging pods the kubelet thinks is on node node1 Aug 18 11:32:16.111: INFO: nginx-proxy-node1 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:16.112: INFO: Container nginx-proxy ready: true, restart count 2 Aug 18 11:32:16.112: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-vsxvg started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:16.112: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:32:16.112: INFO: test-rolling-update-controller-wx48f started at 2021-08-18 11:29:47 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:16.112: INFO: Container httpd ready: false, restart count 0 Aug 18 11:32:16.112: INFO: ss2-1 started at 2021-08-18 11:26:31 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:16.112: INFO: Container webserver ready: true, restart count 0 Aug 18 11:32:16.112: INFO: kube-flannel-q78nd started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:32:16.112: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:32:16.112: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:32:16.112: INFO: prometheus-k8s-0 started at 2021-08-18 08:34:03 +0000 UTC (0+5 container statuses recorded) Aug 18 11:32:16.112: INFO: Container custom-metrics-apiserver ready: true, restart count 0 Aug 18 11:32:16.112: INFO: Container grafana ready: true, restart count 0 Aug 18 11:32:16.112: INFO: Container prometheus ready: true, restart count 1 Aug 18 11:32:16.112: INFO: Container prometheus-config-reloader ready: true, restart count 0 Aug 18 11:32:16.112: INFO: Container rules-configmap-reloader ready: true, restart count 0 Aug 18 11:32:16.112: INFO: pod-init-b68a6dc1-5b80-476f-a5fe-c89c90dac8b1 started at 2021-08-18 11:27:37 +0000 UTC (2+1 container statuses recorded) Aug 18 11:32:16.112: INFO: Init container init1 ready: false, restart count 0 Aug 18 11:32:16.112: INFO: Init container init2 ready: false, restart count 0 Aug 18 11:32:16.112: INFO: Container run1 ready: false, restart count 0 Aug 18 11:32:16.112: INFO: labelsupdate6d13f820-2ca1-40a0-8b73-fdd72ab45b4e started at 2021-08-18 11:32:04 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:16.112: INFO: Container client-container ready: true, restart count 0 Aug 18 11:32:16.112: INFO: pod-logs-websocket-d8642f34-1a3a-44bb-86fd-c0e2f884df31 started at 2021-08-18 11:32:11 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:16.112: INFO: Container main ready: false, restart count 0 Aug 18 11:32:16.112: INFO: kube-multus-ds-amd64-rrvmb started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:16.112: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:32:16.112: INFO: node-feature-discovery-worker-pflgw started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:16.112: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:32:16.112: INFO: node-exporter-kcwvn started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:32:16.112: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:32:16.112: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:32:16.112: INFO: cmk-d8r27 started at 2021-08-18 08:32:52 +0000 UTC (0+2 container statuses recorded) Aug 18 11:32:16.112: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:32:16.112: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:32:16.112: INFO: collectd-xdprr started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:32:16.112: INFO: Container collectd ready: true, restart count 0 Aug 18 11:32:16.112: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:32:16.112: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:32:16.112: INFO: ss2-0 started at 2021-08-18 11:26:45 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:16.112: INFO: Container webserver ready: true, restart count 0 Aug 18 11:32:16.112: INFO: kube-proxy-p6jvp started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:16.112: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:32:16.112: INFO: kubernetes-metrics-scraper-678c97765c-9nsv5 started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:16.112: INFO: Container kubernetes-metrics-scraper ready: true, restart count 2 Aug 18 11:32:16.112: INFO: cmk-init-discover-node1-bxznx started at 2021-08-18 08:32:10 +0000 UTC (0+3 container statuses recorded) Aug 18 11:32:16.112: INFO: Container discover ready: false, restart count 0 Aug 18 11:32:16.112: INFO: Container init ready: false, restart count 0 Aug 18 11:32:16.112: INFO: Container install ready: false, restart count 0 Aug 18 11:32:16.112: INFO: pod-submit-remove-74dabc56-7cc6-4841-8b80-3d7505da846f started at 2021-08-18 11:27:24 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:16.112: INFO: Container nginx ready: false, restart count 0 W0818 11:32:16.125032 27 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:32:16.166: INFO: Latency metrics for node node1 Aug 18 11:32:16.166: INFO: Logging node info for node node2 Aug 18 11:32:16.168: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 1d01177e-3dbb-48a1-a0bc-d18af27ab7f8 60083 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:d1:47:f8:1d:22"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:36 +0000 UTC,LastTransitionTime:2021-08-18 08:26:36 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:10 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:10 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:10 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:32:10 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:dc1f286135c145349b8a016880b65a2f,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:037e7e2d-94e9-42f4-a719-896e5005ac70,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:32:16.170: INFO: Logging kubelet events for node node2 Aug 18 11:32:16.172: INFO: Logging pods the kubelet thinks is on node node2 Aug 18 11:32:16.185: INFO: kube-flannel-h7t5h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:32:16.185: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:32:16.185: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:32:16.185: INFO: node-exporter-lrrf2 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:32:16.185: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:32:16.185: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:32:16.185: INFO: var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15 started at 2021-08-18 11:27:32 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:16.185: INFO: Container dapi-container ready: false, restart count 0 Aug 18 11:32:16.185: INFO: my-hostname-basic-16cdf8c4-a1c2-4116-a63e-245ac8d1f42b-7wp9c started at 2021-08-18 11:32:09 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:16.185: INFO: Container my-hostname-basic-16cdf8c4-a1c2-4116-a63e-245ac8d1f42b ready: true, restart count 0 Aug 18 11:32:16.185: INFO: nginx-proxy-node2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:16.185: INFO: Container nginx-proxy ready: true, restart count 1 Aug 18 11:32:16.185: INFO: cmk-init-discover-node2-6b2kz started at 2021-08-18 08:32:30 +0000 UTC (0+3 container statuses recorded) Aug 18 11:32:16.185: INFO: Container discover ready: false, restart count 0 Aug 18 11:32:16.185: INFO: Container init ready: false, restart count 0 Aug 18 11:32:16.185: INFO: Container install ready: false, restart count 0 Aug 18 11:32:16.185: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-7rn45 started at 2021-08-18 08:36:42 +0000 UTC (0+2 container statuses recorded) Aug 18 11:32:16.185: INFO: Container tas-controller ready: true, restart count 0 Aug 18 11:32:16.185: INFO: Container tas-extender ready: true, restart count 0 Aug 18 11:32:16.185: INFO: ss2-2 started at 2021-08-18 11:27:31 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:16.185: INFO: Container webserver ready: false, restart count 0 Aug 18 11:32:16.185: INFO: kubernetes-dashboard-86c6f9df5b-qrtdk started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:16.185: INFO: Container kubernetes-dashboard ready: true, restart count 2 Aug 18 11:32:16.185: INFO: cmk-748rz started at 2021-08-18 08:32:53 +0000 UTC (0+2 container statuses recorded) Aug 18 11:32:16.185: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:32:16.185: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:32:16.185: INFO: kube-proxy-qkj9c started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:16.185: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:32:16.185: INFO: node-feature-discovery-worker-hzpf5 started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:16.185: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:32:16.185: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-c82pt started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:16.185: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:32:16.185: INFO: prometheus-operator-5bb8cb9d8f-k97ws started at 2021-08-18 08:33:38 +0000 UTC (0+2 container statuses recorded) Aug 18 11:32:16.185: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:32:16.185: INFO: Container prometheus-operator ready: true, restart count 0 Aug 18 11:32:16.185: INFO: kube-multus-ds-amd64-rvzsg started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:16.185: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:32:16.185: INFO: collectd-67ntq started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:32:16.185: INFO: Container collectd ready: true, restart count 0 Aug 18 11:32:16.185: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:32:16.185: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:32:16.185: INFO: downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a started at 2021-08-18 11:31:01 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:16.185: INFO: Container dapi-container ready: false, restart count 0 Aug 18 11:32:16.185: INFO: var-expansion-cf1f3322-29ba-472a-9702-20756a20f986 started at 2021-08-18 11:28:58 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:16.185: INFO: Container dapi-container ready: false, restart count 0 Aug 18 11:32:16.185: INFO: cmk-webhook-6c9d5f8578-7cxjr started at 2021-08-18 08:32:53 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:16.185: INFO: Container cmk-webhook ready: true, restart count 0 W0818 11:32:16.199204 27 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:32:16.227: INFO: Latency metrics for node node2 Aug 18 11:32:16.227: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "downward-api-3052" for this suite. • Failure [304.933 seconds] [sig-node] Downward API /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/downward_api.go:34 should provide host IP as an env var [NodeConformance] [Conformance] [It] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:32:15.919: Unexpected error: <*errors.errorString | 0xc003426ea0>: { s: "expected pod \"downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25\" success: Gave up after waiting 5m0s for pod \"downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25\" to be \"Succeeded or Failed\"", } expected pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25" success: Gave up after waiting 5m0s for pod "downward-api-c1e0efbe-f569-4cd0-ab7a-b70694ffbc25" to be "Succeeded or Failed" occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 ------------------------------ {"msg":"FAILED [sig-node] Downward API should provide host IP as an env var [NodeConformance] [Conformance]","total":-1,"completed":6,"skipped":51,"failed":1,"failures":["[sig-node] Downward API should provide host IP as an env var [NodeConformance] [Conformance]"]} SSSSSSSS ------------------------------ [BeforeEach] [sig-apps] ReplicationController /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:32:09.307: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename replication-controller STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-apps] ReplicationController /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/rc.go:54 [It] should serve a basic image on each replica with a public image [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating replication controller my-hostname-basic-16cdf8c4-a1c2-4116-a63e-245ac8d1f42b Aug 18 11:32:09.331: INFO: Pod name my-hostname-basic-16cdf8c4-a1c2-4116-a63e-245ac8d1f42b: Found 0 pods out of 1 Aug 18 11:32:14.337: INFO: Pod name my-hostname-basic-16cdf8c4-a1c2-4116-a63e-245ac8d1f42b: Found 1 pods out of 1 Aug 18 11:32:14.337: INFO: Ensuring all pods for ReplicationController "my-hostname-basic-16cdf8c4-a1c2-4116-a63e-245ac8d1f42b" are running Aug 18 11:32:14.342: INFO: Pod "my-hostname-basic-16cdf8c4-a1c2-4116-a63e-245ac8d1f42b-7wp9c" is running (conditions: [{Type:Initialized Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2021-08-18 11:32:09 +0000 UTC Reason: Message:} {Type:Ready Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2021-08-18 11:32:12 +0000 UTC Reason: Message:} {Type:ContainersReady Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2021-08-18 11:32:12 +0000 UTC Reason: Message:} {Type:PodScheduled Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2021-08-18 11:32:09 +0000 UTC Reason: Message:}]) Aug 18 11:32:14.343: INFO: Trying to dial the pod Aug 18 11:32:19.354: INFO: Controller my-hostname-basic-16cdf8c4-a1c2-4116-a63e-245ac8d1f42b: Got expected result from replica 1 [my-hostname-basic-16cdf8c4-a1c2-4116-a63e-245ac8d1f42b-7wp9c]: "my-hostname-basic-16cdf8c4-a1c2-4116-a63e-245ac8d1f42b-7wp9c", 1 of 1 required successes so far [AfterEach] [sig-apps] ReplicationController /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:32:19.354: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "replication-controller-6175" for this suite. • [SLOW TEST:10.056 seconds] [sig-apps] ReplicationController /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/framework.go:23 should serve a basic image on each replica with a public image [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-apps] ReplicationController should serve a basic image on each replica with a public image [Conformance]","total":-1,"completed":11,"skipped":187,"failed":1,"failures":["[sig-apps] Deployment deployment should support rollover [Conformance]"]} SS ------------------------------ [BeforeEach] [sig-storage] Projected secret /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:32:16.264: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename projected STEP: Waiting for a default service account to be provisioned in namespace [It] should be consumable from pods in volume with defaultMode set [LinuxOnly] [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating projection with secret that has name projected-secret-test-15f7dc97-0645-4ab7-a052-280a9a966d79 STEP: Creating a pod to test consume secrets Aug 18 11:32:16.303: INFO: Waiting up to 5m0s for pod "pod-projected-secrets-840c4f86-8e4e-4ad1-bc76-dad3f23353b5" in namespace "projected-9578" to be "Succeeded or Failed" Aug 18 11:32:16.305: INFO: Pod "pod-projected-secrets-840c4f86-8e4e-4ad1-bc76-dad3f23353b5": Phase="Pending", Reason="", readiness=false. Elapsed: 2.075475ms Aug 18 11:32:18.309: INFO: Pod "pod-projected-secrets-840c4f86-8e4e-4ad1-bc76-dad3f23353b5": Phase="Pending", Reason="", readiness=false. Elapsed: 2.006402172s Aug 18 11:32:20.314: INFO: Pod "pod-projected-secrets-840c4f86-8e4e-4ad1-bc76-dad3f23353b5": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.010901504s STEP: Saw pod success Aug 18 11:32:20.314: INFO: Pod "pod-projected-secrets-840c4f86-8e4e-4ad1-bc76-dad3f23353b5" satisfied condition "Succeeded or Failed" Aug 18 11:32:20.316: INFO: Trying to get logs from node node2 pod pod-projected-secrets-840c4f86-8e4e-4ad1-bc76-dad3f23353b5 container projected-secret-volume-test: STEP: delete the pod Aug 18 11:32:20.340: INFO: Waiting for pod pod-projected-secrets-840c4f86-8e4e-4ad1-bc76-dad3f23353b5 to disappear Aug 18 11:32:20.343: INFO: Pod pod-projected-secrets-840c4f86-8e4e-4ad1-bc76-dad3f23353b5 no longer exists [AfterEach] [sig-storage] Projected secret /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:32:20.343: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "projected-9578" for this suite. • ------------------------------ {"msg":"PASSED [sig-storage] Projected secret should be consumable from pods in volume with defaultMode set [LinuxOnly] [NodeConformance] [Conformance]","total":-1,"completed":7,"skipped":59,"failed":1,"failures":["[sig-node] Downward API should provide host IP as an env var [NodeConformance] [Conformance]"]} SSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-storage] Projected configMap /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:32:20.412: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename projected STEP: Waiting for a default service account to be provisioned in namespace [It] should be consumable from pods in volume as non-root [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating configMap with name projected-configmap-test-volume-ef9fd316-42dd-40c1-9163-341ee357d93a STEP: Creating a pod to test consume configMaps Aug 18 11:32:20.447: INFO: Waiting up to 5m0s for pod "pod-projected-configmaps-37caefc7-8dbb-4274-97ac-41cc56558e33" in namespace "projected-6188" to be "Succeeded or Failed" Aug 18 11:32:20.451: INFO: Pod "pod-projected-configmaps-37caefc7-8dbb-4274-97ac-41cc56558e33": Phase="Pending", Reason="", readiness=false. Elapsed: 3.886356ms Aug 18 11:32:22.454: INFO: Pod "pod-projected-configmaps-37caefc7-8dbb-4274-97ac-41cc56558e33": Phase="Pending", Reason="", readiness=false. Elapsed: 2.006817439s Aug 18 11:32:24.457: INFO: Pod "pod-projected-configmaps-37caefc7-8dbb-4274-97ac-41cc56558e33": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.009899736s STEP: Saw pod success Aug 18 11:32:24.457: INFO: Pod "pod-projected-configmaps-37caefc7-8dbb-4274-97ac-41cc56558e33" satisfied condition "Succeeded or Failed" Aug 18 11:32:24.464: INFO: Trying to get logs from node node2 pod pod-projected-configmaps-37caefc7-8dbb-4274-97ac-41cc56558e33 container projected-configmap-volume-test: STEP: delete the pod Aug 18 11:32:24.478: INFO: Waiting for pod pod-projected-configmaps-37caefc7-8dbb-4274-97ac-41cc56558e33 to disappear Aug 18 11:32:24.480: INFO: Pod pod-projected-configmaps-37caefc7-8dbb-4274-97ac-41cc56558e33 no longer exists [AfterEach] [sig-storage] Projected configMap /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:32:24.480: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "projected-6188" for this suite. • ------------------------------ {"msg":"PASSED [sig-storage] Projected configMap should be consumable from pods in volume as non-root [NodeConformance] [Conformance]","total":-1,"completed":8,"skipped":86,"failed":1,"failures":["[sig-node] Downward API should provide host IP as an env var [NodeConformance] [Conformance]"]} SS ------------------------------ [BeforeEach] [k8s.io] Pods /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:27:24.893: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename pods STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [k8s.io] Pods /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/pods.go:181 [It] should be submitted and removed [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: creating the pod STEP: setting up watch STEP: submitting the pod to kubernetes Aug 18 11:27:24.917: INFO: observed the pod list STEP: verifying the pod is in kubernetes STEP: verifying pod creation was observed Aug 18 11:32:24.939: FAIL: Unexpected error: <*errors.errorString | 0xc0002f61f0>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/common.glob..func18.3() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/pods.go:296 +0xdf7 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc0027eb380) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc0027eb380) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc0027eb380, 0x4deb2c0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] Pods /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "pods-8382". STEP: Found 7 events. Aug 18 11:32:24.943: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for pod-submit-remove-74dabc56-7cc6-4841-8b80-3d7505da846f: { } Scheduled: Successfully assigned pods-8382/pod-submit-remove-74dabc56-7cc6-4841-8b80-3d7505da846f to node1 Aug 18 11:32:24.943: INFO: At 2021-08-18 11:27:26 +0000 UTC - event for pod-submit-remove-74dabc56-7cc6-4841-8b80-3d7505da846f: {multus } AddedInterface: Add eth0 [10.244.4.247/24] Aug 18 11:32:24.943: INFO: At 2021-08-18 11:27:26 +0000 UTC - event for pod-submit-remove-74dabc56-7cc6-4841-8b80-3d7505da846f: {kubelet node1} Pulling: Pulling image "docker.io/library/nginx:1.14-alpine" Aug 18 11:32:24.943: INFO: At 2021-08-18 11:27:27 +0000 UTC - event for pod-submit-remove-74dabc56-7cc6-4841-8b80-3d7505da846f: {kubelet node1} Failed: Failed to pull image "docker.io/library/nginx:1.14-alpine": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit Aug 18 11:32:24.943: INFO: At 2021-08-18 11:27:27 +0000 UTC - event for pod-submit-remove-74dabc56-7cc6-4841-8b80-3d7505da846f: {kubelet node1} Failed: Error: ErrImagePull Aug 18 11:32:24.943: INFO: At 2021-08-18 11:27:28 +0000 UTC - event for pod-submit-remove-74dabc56-7cc6-4841-8b80-3d7505da846f: {kubelet node1} BackOff: Back-off pulling image "docker.io/library/nginx:1.14-alpine" Aug 18 11:32:24.943: INFO: At 2021-08-18 11:27:28 +0000 UTC - event for pod-submit-remove-74dabc56-7cc6-4841-8b80-3d7505da846f: {kubelet node1} Failed: Error: ImagePullBackOff Aug 18 11:32:24.945: INFO: POD NODE PHASE GRACE CONDITIONS Aug 18 11:32:24.945: INFO: pod-submit-remove-74dabc56-7cc6-4841-8b80-3d7505da846f node1 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:27:24 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:27:24 +0000 UTC ContainersNotReady containers with unready status: [nginx]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:27:24 +0000 UTC ContainersNotReady containers with unready status: [nginx]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:27:24 +0000 UTC }] Aug 18 11:32:24.945: INFO: Aug 18 11:32:24.949: INFO: Logging node info for node master1 Aug 18 11:32:24.952: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 ebb211fa-503f-4cfe-b1ed-c95d27a70e6e 60319 0 2021-08-18 08:20:52 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"3a:82:be:72:b5:15"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:20:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:20:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:25:59 +0000 UTC,LastTransitionTime:2021-08-18 08:25:59 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:23 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:23 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:23 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:32:23 +0000 UTC,LastTransitionTime:2021-08-18 08:25:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:58c3e57359b641ad92fa1959f2fecf5d,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:012cd796-2076-45d6-8b14-d3e0451b1e64,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[@ :],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:32:24.952: INFO: Logging kubelet events for node master1 Aug 18 11:32:24.955: INFO: Logging pods the kubelet thinks is on node master1 Aug 18 11:32:24.975: INFO: kube-multus-ds-amd64-kbcp6 started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:24.975: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:32:24.975: INFO: docker-registry-docker-registry-56cbc7bc58-49kl2 started at 2021-08-18 08:26:23 +0000 UTC (0+2 container statuses recorded) Aug 18 11:32:24.975: INFO: Container docker-registry ready: true, restart count 0 Aug 18 11:32:24.975: INFO: Container nginx ready: true, restart count 0 Aug 18 11:32:24.975: INFO: node-exporter-5hwz9 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:32:24.975: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:32:24.975: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:32:24.975: INFO: kube-controller-manager-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:24.975: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:32:24.975: INFO: kube-proxy-vqk4v started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:24.975: INFO: Container kube-proxy ready: true, restart count 1 Aug 18 11:32:24.975: INFO: kube-flannel-q64cq started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:32:24.975: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:32:24.975: INFO: Container kube-flannel ready: true, restart count 3 Aug 18 11:32:24.975: INFO: coredns-7677f9bb54-kn2qg started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:24.975: INFO: Container coredns ready: true, restart count 2 Aug 18 11:32:24.975: INFO: kube-scheduler-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:24.975: INFO: Container kube-scheduler ready: true, restart count 0 Aug 18 11:32:24.975: INFO: kube-apiserver-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:24.975: INFO: Container kube-apiserver ready: true, restart count 0 W0818 11:32:24.988147 38 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:32:25.010: INFO: Latency metrics for node master1 Aug 18 11:32:25.011: INFO: Logging node info for node master2 Aug 18 11:32:25.013: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 78946293-3abe-4442-84d4-8ed6b1d15ce0 60301 0 2021-08-18 08:21:31 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"7e:f5:c2:cc:3a:b4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:21:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:21:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-08-18 08:29:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:22 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:22 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:22 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:32:22 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0c44122c7a7248c18d8571e1cc667258,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:0cd329f2-48e0-4c8f-b8b9-fa3ae0ed8406,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:32:25.013: INFO: Logging kubelet events for node master2 Aug 18 11:32:25.015: INFO: Logging pods the kubelet thinks is on node master2 Aug 18 11:32:25.023: INFO: kube-proxy-kh2l9 started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:25.023: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:32:25.023: INFO: kube-flannel-pp56h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:32:25.023: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:32:25.023: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:32:25.023: INFO: kube-controller-manager-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:25.023: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:32:25.023: INFO: kube-scheduler-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:25.023: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:32:25.023: INFO: kube-multus-ds-amd64-mld8g started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:25.023: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:32:25.023: INFO: dns-autoscaler-5b7b5c9b6f-hh47r started at 2021-08-18 08:23:57 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:25.023: INFO: Container autoscaler ready: true, restart count 2 Aug 18 11:32:25.023: INFO: node-feature-discovery-controller-5bf5c49849-mq57c started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:25.023: INFO: Container nfd-controller ready: true, restart count 0 Aug 18 11:32:25.023: INFO: node-exporter-48nfx started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:32:25.023: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:32:25.023: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:32:25.023: INFO: kube-apiserver-master2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:25.023: INFO: Container kube-apiserver ready: true, restart count 0 W0818 11:32:25.034383 38 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:32:25.061: INFO: Latency metrics for node master2 Aug 18 11:32:25.061: INFO: Logging node info for node master3 Aug 18 11:32:25.063: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 44feac2b-9447-4be2-9fcd-62f836d67c72 60185 0 2021-08-18 08:21:41 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"86:e4:31:99:58:40"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {kubelet Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:17 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:17 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:17 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:32:17 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1fae19ae59884c44899bcd08aa243244,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:5db926c5-6530-4635-a0d5-806974a3b732,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:32:25.063: INFO: Logging kubelet events for node master3 Aug 18 11:32:25.065: INFO: Logging pods the kubelet thinks is on node master3 Aug 18 11:32:25.072: INFO: kube-scheduler-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:25.073: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:32:25.073: INFO: kube-apiserver-master3 started at 2021-08-18 08:29:12 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:25.073: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:32:25.073: INFO: kube-proxy-sd5lc started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:25.073: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:32:25.073: INFO: kube-flannel-x6tlr started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:32:25.073: INFO: Init container install-cni ready: true, restart count 1 Aug 18 11:32:25.073: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:32:25.073: INFO: kube-multus-ds-amd64-bkw6c started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:25.073: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:32:25.073: INFO: coredns-7677f9bb54-5hxfh started at 2021-08-18 08:23:54 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:25.073: INFO: Container coredns ready: true, restart count 1 Aug 18 11:32:25.073: INFO: node-exporter-vq7d8 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:32:25.073: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:32:25.073: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:32:25.073: INFO: kube-controller-manager-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:25.073: INFO: Container kube-controller-manager ready: true, restart count 2 W0818 11:32:25.089311 38 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:32:25.111: INFO: Latency metrics for node master3 Aug 18 11:32:25.111: INFO: Logging node info for node node1 Aug 18 11:32:25.113: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 84defabd-6ebf-43ec-a629-44c6713da9c9 60238 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"9a:87:55:36:7b:df"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:13 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:35 +0000 UTC,LastTransitionTime:2021-08-18 08:26:35 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:20 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:20 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:20 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:32:20 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:69946ff2b7bc462fa25eb7adb4703c23,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:736dc52f-f5e3-494e-86ca-01eedbea015c,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:a7cea43d9d2f67c38fbf0407786edbe660ee9072945f7bb272b55fd255e8eaca opnfv/barometer-collectd:stable],SizeBytes:1075746799,},ContainerImage{Names:[@ :],SizeBytes:1003788820,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[aquasec/kube-hunter@sha256:2be6820bc1d7e0f57193a9a27d5a3e16b2fd93c53747b03ce8ca48c6fc323781 aquasec/kube-hunter:0.3.1],SizeBytes:347611549,},ContainerImage{Names:[golang@sha256:db2475a1dbb2149508e5db31d7d77a75e6600d54be645f37681f03f2762169ba golang:alpine3.12],SizeBytes:301186719,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:de25c7fc6c4f3a27c7f0c2dff454e4671823a34d88abd533f210848d527e0fbb alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:32:25.114: INFO: Logging kubelet events for node node1 Aug 18 11:32:25.116: INFO: Logging pods the kubelet thinks is on node node1 Aug 18 11:32:25.131: INFO: cmk-init-discover-node1-bxznx started at 2021-08-18 08:32:10 +0000 UTC (0+3 container statuses recorded) Aug 18 11:32:25.132: INFO: Container discover ready: false, restart count 0 Aug 18 11:32:25.132: INFO: Container init ready: false, restart count 0 Aug 18 11:32:25.132: INFO: Container install ready: false, restart count 0 Aug 18 11:32:25.132: INFO: cmk-d8r27 started at 2021-08-18 08:32:52 +0000 UTC (0+2 container statuses recorded) Aug 18 11:32:25.132: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:32:25.132: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:32:25.132: INFO: collectd-xdprr started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:32:25.132: INFO: Container collectd ready: true, restart count 0 Aug 18 11:32:25.132: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:32:25.132: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:32:25.132: INFO: affinity-nodeport-transition-7hhl7 started at 2021-08-18 11:32:19 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:25.132: INFO: Container affinity-nodeport-transition ready: true, restart count 0 Aug 18 11:32:25.132: INFO: ss2-0 started at 2021-08-18 11:26:45 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:25.132: INFO: Container webserver ready: true, restart count 0 Aug 18 11:32:25.132: INFO: kube-proxy-p6jvp started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:25.132: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:32:25.132: INFO: kubernetes-metrics-scraper-678c97765c-9nsv5 started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:25.132: INFO: Container kubernetes-metrics-scraper ready: true, restart count 2 Aug 18 11:32:25.132: INFO: pod-submit-remove-74dabc56-7cc6-4841-8b80-3d7505da846f started at 2021-08-18 11:27:24 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:25.132: INFO: Container nginx ready: false, restart count 0 Aug 18 11:32:25.132: INFO: nginx-proxy-node1 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:25.132: INFO: Container nginx-proxy ready: true, restart count 2 Aug 18 11:32:25.132: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-vsxvg started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:25.132: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:32:25.132: INFO: test-rolling-update-controller-wx48f started at 2021-08-18 11:29:47 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:25.132: INFO: Container httpd ready: false, restart count 0 Aug 18 11:32:25.132: INFO: ss2-1 started at 2021-08-18 11:26:31 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:25.132: INFO: Container webserver ready: true, restart count 0 Aug 18 11:32:25.132: INFO: kube-flannel-q78nd started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:32:25.132: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:32:25.132: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:32:25.132: INFO: prometheus-k8s-0 started at 2021-08-18 08:34:03 +0000 UTC (0+5 container statuses recorded) Aug 18 11:32:25.132: INFO: Container custom-metrics-apiserver ready: true, restart count 0 Aug 18 11:32:25.132: INFO: Container grafana ready: true, restart count 0 Aug 18 11:32:25.132: INFO: Container prometheus ready: true, restart count 1 Aug 18 11:32:25.132: INFO: Container prometheus-config-reloader ready: true, restart count 0 Aug 18 11:32:25.132: INFO: Container rules-configmap-reloader ready: true, restart count 0 Aug 18 11:32:25.132: INFO: node-exporter-kcwvn started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:32:25.132: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:32:25.132: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:32:25.132: INFO: pod-init-b68a6dc1-5b80-476f-a5fe-c89c90dac8b1 started at 2021-08-18 11:27:37 +0000 UTC (2+1 container statuses recorded) Aug 18 11:32:25.132: INFO: Init container init1 ready: false, restart count 0 Aug 18 11:32:25.132: INFO: Init container init2 ready: false, restart count 0 Aug 18 11:32:25.132: INFO: Container run1 ready: false, restart count 0 Aug 18 11:32:25.132: INFO: pod-logs-websocket-d8642f34-1a3a-44bb-86fd-c0e2f884df31 started at 2021-08-18 11:32:11 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:25.132: INFO: Container main ready: false, restart count 0 Aug 18 11:32:25.132: INFO: affinity-nodeport-transition-w7b49 started at 2021-08-18 11:32:19 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:25.132: INFO: Container affinity-nodeport-transition ready: true, restart count 0 Aug 18 11:32:25.132: INFO: kube-multus-ds-amd64-rrvmb started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:25.132: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:32:25.132: INFO: node-feature-discovery-worker-pflgw started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:25.132: INFO: Container nfd-worker ready: true, restart count 0 W0818 11:32:25.146781 38 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:32:25.176: INFO: Latency metrics for node node1 Aug 18 11:32:25.176: INFO: Logging node info for node node2 Aug 18 11:32:25.178: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 1d01177e-3dbb-48a1-a0bc-d18af27ab7f8 60261 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:d1:47:f8:1d:22"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:36 +0000 UTC,LastTransitionTime:2021-08-18 08:26:36 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:21 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:21 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:21 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:32:21 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:dc1f286135c145349b8a016880b65a2f,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:037e7e2d-94e9-42f4-a719-896e5005ac70,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:32:25.179: INFO: Logging kubelet events for node node2 Aug 18 11:32:25.181: INFO: Logging pods the kubelet thinks is on node node2 Aug 18 11:32:25.194: INFO: nginx-proxy-node2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:25.194: INFO: Container nginx-proxy ready: true, restart count 1 Aug 18 11:32:25.194: INFO: cmk-init-discover-node2-6b2kz started at 2021-08-18 08:32:30 +0000 UTC (0+3 container statuses recorded) Aug 18 11:32:25.194: INFO: Container discover ready: false, restart count 0 Aug 18 11:32:25.194: INFO: Container init ready: false, restart count 0 Aug 18 11:32:25.194: INFO: Container install ready: false, restart count 0 Aug 18 11:32:25.194: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-7rn45 started at 2021-08-18 08:36:42 +0000 UTC (0+2 container statuses recorded) Aug 18 11:32:25.194: INFO: Container tas-controller ready: true, restart count 0 Aug 18 11:32:25.194: INFO: Container tas-extender ready: true, restart count 0 Aug 18 11:32:25.194: INFO: ss2-2 started at 2021-08-18 11:27:31 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:25.194: INFO: Container webserver ready: false, restart count 0 Aug 18 11:32:25.194: INFO: kubernetes-dashboard-86c6f9df5b-qrtdk started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:25.194: INFO: Container kubernetes-dashboard ready: true, restart count 2 Aug 18 11:32:25.194: INFO: cmk-748rz started at 2021-08-18 08:32:53 +0000 UTC (0+2 container statuses recorded) Aug 18 11:32:25.194: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:32:25.195: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:32:25.195: INFO: kube-proxy-qkj9c started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:25.195: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:32:25.195: INFO: node-feature-discovery-worker-hzpf5 started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:25.195: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:32:25.195: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-c82pt started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:25.195: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:32:25.195: INFO: prometheus-operator-5bb8cb9d8f-k97ws started at 2021-08-18 08:33:38 +0000 UTC (0+2 container statuses recorded) Aug 18 11:32:25.195: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:32:25.195: INFO: Container prometheus-operator ready: true, restart count 0 Aug 18 11:32:25.195: INFO: pod-secrets-caa4b22f-5cd6-4e5b-91dd-efee58971698 started at 2021-08-18 11:32:24 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:25.195: INFO: Container secret-volume-test ready: false, restart count 0 Aug 18 11:32:25.195: INFO: kube-multus-ds-amd64-rvzsg started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:25.195: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:32:25.195: INFO: collectd-67ntq started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:32:25.195: INFO: Container collectd ready: true, restart count 0 Aug 18 11:32:25.195: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:32:25.195: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:32:25.195: INFO: downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a started at 2021-08-18 11:31:01 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:25.195: INFO: Container dapi-container ready: false, restart count 0 Aug 18 11:32:25.195: INFO: var-expansion-cf1f3322-29ba-472a-9702-20756a20f986 started at 2021-08-18 11:28:58 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:25.195: INFO: Container dapi-container ready: false, restart count 0 Aug 18 11:32:25.195: INFO: affinity-nodeport-transition-v84k6 started at 2021-08-18 11:32:19 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:25.195: INFO: Container affinity-nodeport-transition ready: true, restart count 0 Aug 18 11:32:25.195: INFO: cmk-webhook-6c9d5f8578-7cxjr started at 2021-08-18 08:32:53 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:25.195: INFO: Container cmk-webhook ready: true, restart count 0 Aug 18 11:32:25.195: INFO: kube-flannel-h7t5h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:32:25.195: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:32:25.195: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:32:25.195: INFO: node-exporter-lrrf2 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:32:25.195: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:32:25.195: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:32:25.195: INFO: var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15 started at 2021-08-18 11:27:32 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:25.195: INFO: Container dapi-container ready: false, restart count 0 W0818 11:32:25.208087 38 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:32:25.396: INFO: Latency metrics for node node2 Aug 18 11:32:25.396: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "pods-8382" for this suite. • Failure [300.510 seconds] [k8s.io] Pods /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 should be submitted and removed [NodeConformance] [Conformance] [It] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:32:24.939: Unexpected error: <*errors.errorString | 0xc0002f61f0>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/pods.go:296 ------------------------------ {"msg":"FAILED [k8s.io] Pods should be submitted and removed [NodeConformance] [Conformance]","total":-1,"completed":16,"skipped":323,"failed":1,"failures":["[k8s.io] Pods should be submitted and removed [NodeConformance] [Conformance]"]} SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-storage] Secrets /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:32:24.495: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename secrets STEP: Waiting for a default service account to be provisioned in namespace [It] should be consumable from pods in volume with defaultMode set [LinuxOnly] [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating secret with name secret-test-db1cdad8-5b53-436f-a475-417e5ae79fa1 STEP: Creating a pod to test consume secrets Aug 18 11:32:24.528: INFO: Waiting up to 5m0s for pod "pod-secrets-caa4b22f-5cd6-4e5b-91dd-efee58971698" in namespace "secrets-9985" to be "Succeeded or Failed" Aug 18 11:32:24.531: INFO: Pod "pod-secrets-caa4b22f-5cd6-4e5b-91dd-efee58971698": Phase="Pending", Reason="", readiness=false. Elapsed: 2.191105ms Aug 18 11:32:26.535: INFO: Pod "pod-secrets-caa4b22f-5cd6-4e5b-91dd-efee58971698": Phase="Pending", Reason="", readiness=false. Elapsed: 2.006364953s Aug 18 11:32:28.541: INFO: Pod "pod-secrets-caa4b22f-5cd6-4e5b-91dd-efee58971698": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.012101315s STEP: Saw pod success Aug 18 11:32:28.541: INFO: Pod "pod-secrets-caa4b22f-5cd6-4e5b-91dd-efee58971698" satisfied condition "Succeeded or Failed" Aug 18 11:32:28.543: INFO: Trying to get logs from node node2 pod pod-secrets-caa4b22f-5cd6-4e5b-91dd-efee58971698 container secret-volume-test: STEP: delete the pod Aug 18 11:32:28.557: INFO: Waiting for pod pod-secrets-caa4b22f-5cd6-4e5b-91dd-efee58971698 to disappear Aug 18 11:32:28.559: INFO: Pod pod-secrets-caa4b22f-5cd6-4e5b-91dd-efee58971698 no longer exists [AfterEach] [sig-storage] Secrets /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:32:28.559: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "secrets-9985" for this suite. • ------------------------------ {"msg":"PASSED [sig-storage] Secrets should be consumable from pods in volume with defaultMode set [LinuxOnly] [NodeConformance] [Conformance]","total":-1,"completed":9,"skipped":88,"failed":1,"failures":["[sig-node] Downward API should provide host IP as an env var [NodeConformance] [Conformance]"]} SSSS ------------------------------ [BeforeEach] [sig-storage] EmptyDir volumes /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:32:25.500: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename emptydir STEP: Waiting for a default service account to be provisioned in namespace [It] volume on default medium should have the correct mode [LinuxOnly] [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating a pod to test emptydir volume type on node default medium Aug 18 11:32:25.540: INFO: Waiting up to 5m0s for pod "pod-3804b148-b23f-4e9c-91e3-a3f61b9494d7" in namespace "emptydir-3767" to be "Succeeded or Failed" Aug 18 11:32:25.542: INFO: Pod "pod-3804b148-b23f-4e9c-91e3-a3f61b9494d7": Phase="Pending", Reason="", readiness=false. Elapsed: 1.854348ms Aug 18 11:32:27.544: INFO: Pod "pod-3804b148-b23f-4e9c-91e3-a3f61b9494d7": Phase="Pending", Reason="", readiness=false. Elapsed: 2.004282661s Aug 18 11:32:29.547: INFO: Pod "pod-3804b148-b23f-4e9c-91e3-a3f61b9494d7": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.007403084s STEP: Saw pod success Aug 18 11:32:29.547: INFO: Pod "pod-3804b148-b23f-4e9c-91e3-a3f61b9494d7" satisfied condition "Succeeded or Failed" Aug 18 11:32:29.549: INFO: Trying to get logs from node node1 pod pod-3804b148-b23f-4e9c-91e3-a3f61b9494d7 container test-container: STEP: delete the pod Aug 18 11:32:29.574: INFO: Waiting for pod pod-3804b148-b23f-4e9c-91e3-a3f61b9494d7 to disappear Aug 18 11:32:29.575: INFO: Pod pod-3804b148-b23f-4e9c-91e3-a3f61b9494d7 no longer exists [AfterEach] [sig-storage] EmptyDir volumes /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:32:29.575: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "emptydir-3767" for this suite. • ------------------------------ {"msg":"PASSED [sig-storage] EmptyDir volumes volume on default medium should have the correct mode [LinuxOnly] [NodeConformance] [Conformance]","total":-1,"completed":17,"skipped":362,"failed":1,"failures":["[k8s.io] Pods should be submitted and removed [NodeConformance] [Conformance]"]} SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-api-machinery] Events /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:32:29.689: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename events STEP: Waiting for a default service account to be provisioned in namespace [It] should ensure that an event can be fetched, patched, deleted, and listed [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: creating a test event STEP: listing all events in all namespaces STEP: patching the test event STEP: fetching the test event STEP: deleting the test event STEP: listing all events in all namespaces [AfterEach] [sig-api-machinery] Events /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:32:29.732: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "events-5565" for this suite. • ------------------------------ [BeforeEach] [k8s.io] Variable Expansion /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:27:32.423: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename var-expansion STEP: Waiting for a default service account to be provisioned in namespace [It] should allow substituting values in a volume subpath [sig-storage] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating a pod to test substitution in volume subpath Aug 18 11:27:32.453: INFO: Waiting up to 5m0s for pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15" in namespace "var-expansion-1549" to be "Succeeded or Failed" Aug 18 11:27:32.455: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 1.971801ms Aug 18 11:27:34.458: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 2.004971462s Aug 18 11:27:36.461: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 4.007931835s Aug 18 11:27:38.465: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 6.011799724s Aug 18 11:27:40.469: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 8.015738211s Aug 18 11:27:42.472: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 10.018347012s Aug 18 11:27:44.475: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 12.021557197s Aug 18 11:27:46.479: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 14.0250123s Aug 18 11:27:48.482: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 16.028407494s Aug 18 11:27:50.485: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 18.031688793s Aug 18 11:27:52.489: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 20.03538605s Aug 18 11:27:54.493: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 22.039577687s Aug 18 11:27:56.496: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 24.042599082s Aug 18 11:27:58.499: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 26.045947655s Aug 18 11:28:00.502: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 28.048702265s Aug 18 11:28:02.505: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 30.051876982s Aug 18 11:28:04.510: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 32.056088925s Aug 18 11:28:06.515: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 34.061664023s Aug 18 11:28:08.519: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 36.065884061s Aug 18 11:28:10.525: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 38.071297454s Aug 18 11:28:12.528: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 40.074886499s Aug 18 11:28:14.532: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 42.078702435s Aug 18 11:28:16.535: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 44.081105636s Aug 18 11:28:18.538: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 46.084032672s Aug 18 11:28:20.543: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 48.089460059s Aug 18 11:28:22.547: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 50.093275412s Aug 18 11:28:24.551: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 52.097570892s Aug 18 11:28:26.557: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 54.103273335s Aug 18 11:28:28.560: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 56.106205262s Aug 18 11:28:30.563: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 58.109624837s Aug 18 11:28:32.567: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.113645054s Aug 18 11:28:34.570: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.116453107s Aug 18 11:28:36.575: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.121022277s Aug 18 11:28:38.578: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.124810344s Aug 18 11:28:40.583: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.12922366s Aug 18 11:28:42.587: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.133189433s Aug 18 11:28:44.591: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.137205698s Aug 18 11:28:46.594: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.140956219s Aug 18 11:28:48.598: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.144556749s Aug 18 11:28:50.603: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.149187106s Aug 18 11:28:52.606: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.15293726s Aug 18 11:28:54.610: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.156135241s Aug 18 11:28:56.613: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.159762502s Aug 18 11:28:58.616: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.162190658s Aug 18 11:29:00.618: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.164942536s Aug 18 11:29:02.622: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.168311927s Aug 18 11:29:04.626: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.172109609s Aug 18 11:29:06.628: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.174861633s Aug 18 11:29:08.632: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.178204596s Aug 18 11:29:10.635: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.181497317s Aug 18 11:29:12.638: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.184407251s Aug 18 11:29:14.641: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.187897245s Aug 18 11:29:16.645: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.191552871s Aug 18 11:29:18.648: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.194923926s Aug 18 11:29:20.651: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.197926874s Aug 18 11:29:22.654: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.200836072s Aug 18 11:29:24.657: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.203829819s Aug 18 11:29:26.661: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.207832159s Aug 18 11:29:28.664: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.210464631s Aug 18 11:29:30.668: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.214215992s Aug 18 11:29:32.671: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.217184656s Aug 18 11:29:34.674: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.220776011s Aug 18 11:29:36.677: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.223194912s Aug 18 11:29:38.681: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.227217112s Aug 18 11:29:40.684: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.230715298s Aug 18 11:29:42.687: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.233859198s Aug 18 11:29:44.691: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.237874617s Aug 18 11:29:46.694: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.240304431s Aug 18 11:29:48.697: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.243320782s Aug 18 11:29:50.700: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.24623491s Aug 18 11:29:52.703: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.249023208s Aug 18 11:29:54.705: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.251546393s Aug 18 11:29:56.708: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.254942441s Aug 18 11:29:58.712: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.258414863s Aug 18 11:30:00.716: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.262639678s Aug 18 11:30:02.719: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.265902354s Aug 18 11:30:04.723: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.269163439s Aug 18 11:30:06.726: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.272005162s Aug 18 11:30:08.730: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.276133807s Aug 18 11:30:10.735: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.281219457s Aug 18 11:30:12.738: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.284565105s Aug 18 11:30:14.741: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.287844772s Aug 18 11:30:16.745: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.291464158s Aug 18 11:30:18.748: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.294455614s Aug 18 11:30:20.753: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.298998229s Aug 18 11:30:22.756: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.302292047s Aug 18 11:30:24.759: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.305650967s Aug 18 11:30:26.762: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.308590807s Aug 18 11:30:28.765: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.311956093s Aug 18 11:30:30.768: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.314807368s Aug 18 11:30:32.771: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.317554356s Aug 18 11:30:34.778: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.32444004s Aug 18 11:30:36.780: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.326729622s Aug 18 11:30:38.785: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.330989809s Aug 18 11:30:40.787: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.333410945s Aug 18 11:30:42.790: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.336808719s Aug 18 11:30:44.793: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.339789651s Aug 18 11:30:46.797: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.343264187s Aug 18 11:30:48.801: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.34709552s Aug 18 11:30:50.804: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.350359545s Aug 18 11:30:52.808: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.354032698s Aug 18 11:30:54.811: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.357131976s Aug 18 11:30:56.814: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.360358236s Aug 18 11:30:58.817: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.363562267s Aug 18 11:31:00.820: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.366817463s Aug 18 11:31:02.824: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.370716871s Aug 18 11:31:04.827: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.373388579s Aug 18 11:31:06.830: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.376596462s Aug 18 11:31:08.834: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.380904516s Aug 18 11:31:10.838: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.384742236s Aug 18 11:31:12.842: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.388218473s Aug 18 11:31:14.845: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.391418023s Aug 18 11:31:16.848: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.394656359s Aug 18 11:31:18.852: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.398669936s Aug 18 11:31:20.855: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.401905889s Aug 18 11:31:22.860: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.406057648s Aug 18 11:31:24.864: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.410055954s Aug 18 11:31:26.867: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.413632576s Aug 18 11:31:28.870: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.416162878s Aug 18 11:31:30.872: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.418874166s Aug 18 11:31:32.875: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.421748337s Aug 18 11:31:34.878: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.424722087s Aug 18 11:31:36.881: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.427830956s Aug 18 11:31:38.885: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.431255638s Aug 18 11:31:40.888: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.434288085s Aug 18 11:31:42.892: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.438660557s Aug 18 11:31:44.895: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.441777393s Aug 18 11:31:46.898: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.444940204s Aug 18 11:31:48.902: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.448377002s Aug 18 11:31:50.905: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.451811529s Aug 18 11:31:52.909: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.455690472s Aug 18 11:31:54.912: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.458793224s Aug 18 11:31:56.916: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.461994422s Aug 18 11:31:58.919: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.465757339s Aug 18 11:32:00.923: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.469708725s Aug 18 11:32:02.926: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.472479216s Aug 18 11:32:04.928: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.47461138s Aug 18 11:32:06.935: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.480985881s Aug 18 11:32:08.937: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.483432031s Aug 18 11:32:10.939: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.485939219s Aug 18 11:32:12.943: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.489122725s Aug 18 11:32:14.947: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.493033139s Aug 18 11:32:16.952: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.498545144s Aug 18 11:32:18.955: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.501813751s Aug 18 11:32:20.959: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.505819082s Aug 18 11:32:22.963: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.509432175s Aug 18 11:32:24.965: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.511828147s Aug 18 11:32:26.969: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.515803151s Aug 18 11:32:28.972: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.51862489s Aug 18 11:32:30.976: INFO: Pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.522947918s Aug 18 11:32:32.985: INFO: Failed to get logs from node "node2" pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15" container "dapi-container": the server rejected our request for an unknown reason (get pods var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15) STEP: delete the pod Aug 18 11:32:32.988: INFO: Waiting for pod var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15 to disappear Aug 18 11:32:32.991: INFO: Pod var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15 still exists Aug 18 11:32:34.991: INFO: Waiting for pod var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15 to disappear Aug 18 11:32:34.993: INFO: Pod var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15 no longer exists Aug 18 11:32:34.994: FAIL: Unexpected error: <*errors.errorString | 0xc00119f880>: { s: "expected pod \"var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15\" success: Gave up after waiting 5m0s for pod \"var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15\" to be \"Succeeded or Failed\"", } expected pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15" success: Gave up after waiting 5m0s for pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15" to be "Succeeded or Failed" occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).testContainerOutputMatcher(0xc00004e160, 0x4c6bcdb, 0x1e, 0xc00062dc00, 0x0, 0xc0023031c8, 0x1, 0x1, 0x4deefa8) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 +0x1ee k8s.io/kubernetes/test/e2e/framework.(*Framework).TestContainerOutput(...) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:525 k8s.io/kubernetes/test/e2e/common.glob..func9.4() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/expansion.go:139 +0x35a k8s.io/kubernetes/test/e2e.RunE2ETests(0xc003198780) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc003198780) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc003198780, 0x4deb2c0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] Variable Expansion /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "var-expansion-1549". STEP: Found 7 events. Aug 18 11:32:34.998: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15: { } Scheduled: Successfully assigned var-expansion-1549/var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15 to node2 Aug 18 11:32:34.999: INFO: At 2021-08-18 11:27:34 +0000 UTC - event for var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15: {multus } AddedInterface: Add eth0 [10.244.3.234/24] Aug 18 11:32:34.999: INFO: At 2021-08-18 11:27:34 +0000 UTC - event for var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15: {kubelet node2} Pulling: Pulling image "docker.io/library/busybox:1.29" Aug 18 11:32:34.999: INFO: At 2021-08-18 11:27:35 +0000 UTC - event for var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15: {kubelet node2} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit Aug 18 11:32:34.999: INFO: At 2021-08-18 11:27:35 +0000 UTC - event for var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15: {kubelet node2} Failed: Error: ErrImagePull Aug 18 11:32:34.999: INFO: At 2021-08-18 11:27:35 +0000 UTC - event for var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15: {kubelet node2} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" Aug 18 11:32:34.999: INFO: At 2021-08-18 11:27:35 +0000 UTC - event for var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15: {kubelet node2} Failed: Error: ImagePullBackOff Aug 18 11:32:35.001: INFO: POD NODE PHASE GRACE CONDITIONS Aug 18 11:32:35.001: INFO: Aug 18 11:32:35.005: INFO: Logging node info for node master1 Aug 18 11:32:35.007: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 ebb211fa-503f-4cfe-b1ed-c95d27a70e6e 60796 0 2021-08-18 08:20:52 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"3a:82:be:72:b5:15"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:20:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:20:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:25:59 +0000 UTC,LastTransitionTime:2021-08-18 08:25:59 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:33 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:33 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:33 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:32:33 +0000 UTC,LastTransitionTime:2021-08-18 08:25:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:58c3e57359b641ad92fa1959f2fecf5d,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:012cd796-2076-45d6-8b14-d3e0451b1e64,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[@ :],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:32:35.008: INFO: Logging kubelet events for node master1 Aug 18 11:32:35.010: INFO: Logging pods the kubelet thinks is on node master1 Aug 18 11:32:35.030: INFO: docker-registry-docker-registry-56cbc7bc58-49kl2 started at 2021-08-18 08:26:23 +0000 UTC (0+2 container statuses recorded) Aug 18 11:32:35.030: INFO: Container docker-registry ready: true, restart count 0 Aug 18 11:32:35.030: INFO: Container nginx ready: true, restart count 0 Aug 18 11:32:35.030: INFO: node-exporter-5hwz9 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:32:35.030: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:32:35.030: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:32:35.030: INFO: kube-controller-manager-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:35.030: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:32:35.030: INFO: kube-multus-ds-amd64-kbcp6 started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:35.030: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:32:35.030: INFO: coredns-7677f9bb54-kn2qg started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:35.030: INFO: Container coredns ready: true, restart count 2 Aug 18 11:32:35.030: INFO: kube-scheduler-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:35.030: INFO: Container kube-scheduler ready: true, restart count 0 Aug 18 11:32:35.030: INFO: kube-apiserver-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:35.030: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:32:35.030: INFO: kube-proxy-vqk4v started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:35.030: INFO: Container kube-proxy ready: true, restart count 1 Aug 18 11:32:35.030: INFO: kube-flannel-q64cq started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:32:35.030: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:32:35.030: INFO: Container kube-flannel ready: true, restart count 3 W0818 11:32:35.042876 28 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:32:35.072: INFO: Latency metrics for node master1 Aug 18 11:32:35.072: INFO: Logging node info for node master2 Aug 18 11:32:35.075: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 78946293-3abe-4442-84d4-8ed6b1d15ce0 60698 0 2021-08-18 08:21:31 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"7e:f5:c2:cc:3a:b4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:21:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:21:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-08-18 08:29:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:32 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:32 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:32 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:32:32 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0c44122c7a7248c18d8571e1cc667258,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:0cd329f2-48e0-4c8f-b8b9-fa3ae0ed8406,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:32:35.075: INFO: Logging kubelet events for node master2 Aug 18 11:32:35.077: INFO: Logging pods the kubelet thinks is on node master2 Aug 18 11:32:35.086: INFO: kube-multus-ds-amd64-mld8g started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:35.086: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:32:35.086: INFO: dns-autoscaler-5b7b5c9b6f-hh47r started at 2021-08-18 08:23:57 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:35.086: INFO: Container autoscaler ready: true, restart count 2 Aug 18 11:32:35.086: INFO: node-feature-discovery-controller-5bf5c49849-mq57c started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:35.086: INFO: Container nfd-controller ready: true, restart count 0 Aug 18 11:32:35.086: INFO: node-exporter-48nfx started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:32:35.086: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:32:35.086: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:32:35.086: INFO: kube-apiserver-master2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:35.086: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:32:35.086: INFO: kube-scheduler-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:35.086: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:32:35.086: INFO: kube-flannel-pp56h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:32:35.086: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:32:35.086: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:32:35.086: INFO: kube-controller-manager-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:35.086: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:32:35.086: INFO: kube-proxy-kh2l9 started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:35.086: INFO: Container kube-proxy ready: true, restart count 2 W0818 11:32:35.099100 28 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:32:35.127: INFO: Latency metrics for node master2 Aug 18 11:32:35.128: INFO: Logging node info for node master3 Aug 18 11:32:35.130: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 44feac2b-9447-4be2-9fcd-62f836d67c72 60409 0 2021-08-18 08:21:41 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"86:e4:31:99:58:40"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {kubelet Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:27 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:27 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:27 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:32:27 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1fae19ae59884c44899bcd08aa243244,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:5db926c5-6530-4635-a0d5-806974a3b732,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:32:35.131: INFO: Logging kubelet events for node master3 Aug 18 11:32:35.132: INFO: Logging pods the kubelet thinks is on node master3 Aug 18 11:32:35.140: INFO: kube-controller-manager-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:35.140: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:32:35.140: INFO: kube-scheduler-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:35.140: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:32:35.140: INFO: kube-apiserver-master3 started at 2021-08-18 08:29:12 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:35.140: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:32:35.140: INFO: kube-proxy-sd5lc started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:35.140: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:32:35.140: INFO: kube-flannel-x6tlr started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:32:35.140: INFO: Init container install-cni ready: true, restart count 1 Aug 18 11:32:35.140: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:32:35.140: INFO: kube-multus-ds-amd64-bkw6c started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:35.140: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:32:35.140: INFO: coredns-7677f9bb54-5hxfh started at 2021-08-18 08:23:54 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:35.140: INFO: Container coredns ready: true, restart count 1 Aug 18 11:32:35.140: INFO: node-exporter-vq7d8 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:32:35.140: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:32:35.140: INFO: Container node-exporter ready: true, restart count 0 W0818 11:32:35.152634 28 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:32:35.175: INFO: Latency metrics for node master3 Aug 18 11:32:35.175: INFO: Logging node info for node node1 Aug 18 11:32:35.178: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 84defabd-6ebf-43ec-a629-44c6713da9c9 60474 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"9a:87:55:36:7b:df"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:13 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:35 +0000 UTC,LastTransitionTime:2021-08-18 08:26:35 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:30 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:30 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:30 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:32:30 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:69946ff2b7bc462fa25eb7adb4703c23,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:736dc52f-f5e3-494e-86ca-01eedbea015c,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:a7cea43d9d2f67c38fbf0407786edbe660ee9072945f7bb272b55fd255e8eaca opnfv/barometer-collectd:stable],SizeBytes:1075746799,},ContainerImage{Names:[@ :],SizeBytes:1003788820,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[aquasec/kube-hunter@sha256:2be6820bc1d7e0f57193a9a27d5a3e16b2fd93c53747b03ce8ca48c6fc323781 aquasec/kube-hunter:0.3.1],SizeBytes:347611549,},ContainerImage{Names:[golang@sha256:db2475a1dbb2149508e5db31d7d77a75e6600d54be645f37681f03f2762169ba golang:alpine3.12],SizeBytes:301186719,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:de25c7fc6c4f3a27c7f0c2dff454e4671823a34d88abd533f210848d527e0fbb alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:32:35.179: INFO: Logging kubelet events for node node1 Aug 18 11:32:35.181: INFO: Logging pods the kubelet thinks is on node node1 Aug 18 11:32:35.195: INFO: nginx-proxy-node1 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:35.195: INFO: Container nginx-proxy ready: true, restart count 2 Aug 18 11:32:35.195: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-vsxvg started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:35.195: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:32:35.195: INFO: svc-latency-rc-55qj6 started at 2021-08-18 11:32:28 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:35.195: INFO: Container svc-latency-rc ready: true, restart count 0 Aug 18 11:32:35.195: INFO: kube-flannel-q78nd started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:32:35.195: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:32:35.195: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:32:35.195: INFO: prometheus-k8s-0 started at 2021-08-18 08:34:03 +0000 UTC (0+5 container statuses recorded) Aug 18 11:32:35.195: INFO: Container custom-metrics-apiserver ready: true, restart count 0 Aug 18 11:32:35.195: INFO: Container grafana ready: true, restart count 0 Aug 18 11:32:35.195: INFO: Container prometheus ready: true, restart count 1 Aug 18 11:32:35.195: INFO: Container prometheus-config-reloader ready: true, restart count 0 Aug 18 11:32:35.195: INFO: Container rules-configmap-reloader ready: true, restart count 0 Aug 18 11:32:35.195: INFO: test-rolling-update-controller-wx48f started at 2021-08-18 11:29:47 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:35.196: INFO: Container httpd ready: false, restart count 0 Aug 18 11:32:35.196: INFO: ss2-1 started at 2021-08-18 11:26:31 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:35.196: INFO: Container webserver ready: true, restart count 0 Aug 18 11:32:35.196: INFO: kube-multus-ds-amd64-rrvmb started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:35.196: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:32:35.196: INFO: node-feature-discovery-worker-pflgw started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:35.196: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:32:35.196: INFO: node-exporter-kcwvn started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:32:35.196: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:32:35.196: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:32:35.196: INFO: pod-init-b68a6dc1-5b80-476f-a5fe-c89c90dac8b1 started at 2021-08-18 11:27:37 +0000 UTC (2+1 container statuses recorded) Aug 18 11:32:35.196: INFO: Init container init1 ready: false, restart count 0 Aug 18 11:32:35.196: INFO: Init container init2 ready: false, restart count 0 Aug 18 11:32:35.196: INFO: Container run1 ready: false, restart count 0 Aug 18 11:32:35.196: INFO: pod-logs-websocket-d8642f34-1a3a-44bb-86fd-c0e2f884df31 started at 2021-08-18 11:32:11 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:35.196: INFO: Container main ready: false, restart count 0 Aug 18 11:32:35.196: INFO: affinity-nodeport-transition-w7b49 started at 2021-08-18 11:32:19 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:35.196: INFO: Container affinity-nodeport-transition ready: true, restart count 0 Aug 18 11:32:35.196: INFO: kube-proxy-p6jvp started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:35.196: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:32:35.196: INFO: kubernetes-metrics-scraper-678c97765c-9nsv5 started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:35.196: INFO: Container kubernetes-metrics-scraper ready: true, restart count 2 Aug 18 11:32:35.196: INFO: cmk-init-discover-node1-bxznx started at 2021-08-18 08:32:10 +0000 UTC (0+3 container statuses recorded) Aug 18 11:32:35.196: INFO: Container discover ready: false, restart count 0 Aug 18 11:32:35.196: INFO: Container init ready: false, restart count 0 Aug 18 11:32:35.196: INFO: Container install ready: false, restart count 0 Aug 18 11:32:35.196: INFO: cmk-d8r27 started at 2021-08-18 08:32:52 +0000 UTC (0+2 container statuses recorded) Aug 18 11:32:35.196: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:32:35.196: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:32:35.196: INFO: collectd-xdprr started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:32:35.196: INFO: Container collectd ready: true, restart count 0 Aug 18 11:32:35.196: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:32:35.196: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:32:35.196: INFO: affinity-nodeport-transition-7hhl7 started at 2021-08-18 11:32:19 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:35.196: INFO: Container affinity-nodeport-transition ready: true, restart count 0 Aug 18 11:32:35.196: INFO: ss2-0 started at 2021-08-18 11:26:45 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:35.196: INFO: Container webserver ready: true, restart count 0 W0818 11:32:35.208870 28 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:32:35.247: INFO: Latency metrics for node node1 Aug 18 11:32:35.247: INFO: Logging node info for node node2 Aug 18 11:32:35.249: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 1d01177e-3dbb-48a1-a0bc-d18af27ab7f8 60491 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:d1:47:f8:1d:22"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:36 +0000 UTC,LastTransitionTime:2021-08-18 08:26:36 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:31 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:31 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:31 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:32:31 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:dc1f286135c145349b8a016880b65a2f,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:037e7e2d-94e9-42f4-a719-896e5005ac70,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:32:35.250: INFO: Logging kubelet events for node node2 Aug 18 11:32:35.252: INFO: Logging pods the kubelet thinks is on node node2 Aug 18 11:32:35.265: INFO: kube-flannel-h7t5h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:32:35.265: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:32:35.265: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:32:35.265: INFO: node-exporter-lrrf2 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:32:35.265: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:32:35.265: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:32:35.265: INFO: execpod-affinityrr59g started at 2021-08-18 11:32:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:35.265: INFO: Container agnhost-container ready: true, restart count 0 Aug 18 11:32:35.265: INFO: nginx-proxy-node2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:35.265: INFO: Container nginx-proxy ready: true, restart count 1 Aug 18 11:32:35.265: INFO: cmk-init-discover-node2-6b2kz started at 2021-08-18 08:32:30 +0000 UTC (0+3 container statuses recorded) Aug 18 11:32:35.265: INFO: Container discover ready: false, restart count 0 Aug 18 11:32:35.265: INFO: Container init ready: false, restart count 0 Aug 18 11:32:35.265: INFO: Container install ready: false, restart count 0 Aug 18 11:32:35.265: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-7rn45 started at 2021-08-18 08:36:42 +0000 UTC (0+2 container statuses recorded) Aug 18 11:32:35.265: INFO: Container tas-controller ready: true, restart count 0 Aug 18 11:32:35.265: INFO: Container tas-extender ready: true, restart count 0 Aug 18 11:32:35.265: INFO: ss2-2 started at 2021-08-18 11:27:31 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:35.265: INFO: Container webserver ready: false, restart count 0 Aug 18 11:32:35.265: INFO: kubernetes-dashboard-86c6f9df5b-qrtdk started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:35.265: INFO: Container kubernetes-dashboard ready: true, restart count 2 Aug 18 11:32:35.265: INFO: cmk-748rz started at 2021-08-18 08:32:53 +0000 UTC (0+2 container statuses recorded) Aug 18 11:32:35.265: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:32:35.265: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:32:35.265: INFO: kube-proxy-qkj9c started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:35.265: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:32:35.265: INFO: node-feature-discovery-worker-hzpf5 started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:35.265: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:32:35.265: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-c82pt started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:35.265: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:32:35.265: INFO: prometheus-operator-5bb8cb9d8f-k97ws started at 2021-08-18 08:33:38 +0000 UTC (0+2 container statuses recorded) Aug 18 11:32:35.265: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:32:35.265: INFO: Container prometheus-operator ready: true, restart count 0 Aug 18 11:32:35.265: INFO: kube-multus-ds-amd64-rvzsg started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:35.265: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:32:35.265: INFO: collectd-67ntq started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:32:35.265: INFO: Container collectd ready: true, restart count 0 Aug 18 11:32:35.265: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:32:35.265: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:32:35.265: INFO: downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a started at 2021-08-18 11:31:01 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:35.265: INFO: Container dapi-container ready: false, restart count 0 Aug 18 11:32:35.265: INFO: var-expansion-cf1f3322-29ba-472a-9702-20756a20f986 started at 2021-08-18 11:28:58 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:35.265: INFO: Container dapi-container ready: false, restart count 0 Aug 18 11:32:35.265: INFO: affinity-nodeport-transition-v84k6 started at 2021-08-18 11:32:19 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:35.265: INFO: Container affinity-nodeport-transition ready: true, restart count 0 Aug 18 11:32:35.265: INFO: cmk-webhook-6c9d5f8578-7cxjr started at 2021-08-18 08:32:53 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:35.265: INFO: Container cmk-webhook ready: true, restart count 0 W0818 11:32:35.277394 28 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:32:35.323: INFO: Latency metrics for node node2 Aug 18 11:32:35.323: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "var-expansion-1549" for this suite. • Failure [302.912 seconds] [k8s.io] Variable Expansion /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 should allow substituting values in a volume subpath [sig-storage] [Conformance] [It] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:32:34.994: Unexpected error: <*errors.errorString | 0xc00119f880>: { s: "expected pod \"var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15\" success: Gave up after waiting 5m0s for pod \"var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15\" to be \"Succeeded or Failed\"", } expected pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15" success: Gave up after waiting 5m0s for pod "var-expansion-b9ae2d91-aa92-4f3b-bbfe-f9ab6aedef15" to be "Succeeded or Failed" occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 ------------------------------ {"msg":"FAILED [k8s.io] Variable Expansion should allow substituting values in a volume subpath [sig-storage] [Conformance]","total":-1,"completed":3,"skipped":78,"failed":1,"failures":["[k8s.io] Variable Expansion should allow substituting values in a volume subpath [sig-storage] [Conformance]"]} SSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [k8s.io] InitContainer [NodeConformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:27:37.910: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename init-container STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [k8s.io] InitContainer [NodeConformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/init_container.go:162 [It] should invoke init containers on a RestartAlways pod [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: creating the pod Aug 18 11:27:37.929: INFO: PodSpec: initContainers in spec.initContainers Aug 18 11:32:37.944: FAIL: Expected <*errors.errorString | 0xc0003081f0>: { s: "timed out waiting for the condition", } to be nil Full Stack Trace k8s.io/kubernetes/test/e2e/common.glob..func11.3() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/init_container.go:302 +0xcde k8s.io/kubernetes/test/e2e.RunE2ETests(0xc00393c780) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc00393c780) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc00393c780, 0x4deb2c0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] InitContainer [NodeConformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "init-container-2776". STEP: Found 7 events. Aug 18 11:32:37.949: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for pod-init-b68a6dc1-5b80-476f-a5fe-c89c90dac8b1: { } Scheduled: Successfully assigned init-container-2776/pod-init-b68a6dc1-5b80-476f-a5fe-c89c90dac8b1 to node1 Aug 18 11:32:37.949: INFO: At 2021-08-18 11:27:41 +0000 UTC - event for pod-init-b68a6dc1-5b80-476f-a5fe-c89c90dac8b1: {multus } AddedInterface: Add eth0 [10.244.4.248/24] Aug 18 11:32:37.949: INFO: At 2021-08-18 11:27:41 +0000 UTC - event for pod-init-b68a6dc1-5b80-476f-a5fe-c89c90dac8b1: {kubelet node1} Pulling: Pulling image "docker.io/library/busybox:1.29" Aug 18 11:32:37.949: INFO: At 2021-08-18 11:27:42 +0000 UTC - event for pod-init-b68a6dc1-5b80-476f-a5fe-c89c90dac8b1: {kubelet node1} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit Aug 18 11:32:37.949: INFO: At 2021-08-18 11:27:42 +0000 UTC - event for pod-init-b68a6dc1-5b80-476f-a5fe-c89c90dac8b1: {kubelet node1} Failed: Error: ErrImagePull Aug 18 11:32:37.949: INFO: At 2021-08-18 11:27:42 +0000 UTC - event for pod-init-b68a6dc1-5b80-476f-a5fe-c89c90dac8b1: {kubelet node1} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" Aug 18 11:32:37.949: INFO: At 2021-08-18 11:27:42 +0000 UTC - event for pod-init-b68a6dc1-5b80-476f-a5fe-c89c90dac8b1: {kubelet node1} Failed: Error: ImagePullBackOff Aug 18 11:32:37.952: INFO: POD NODE PHASE GRACE CONDITIONS Aug 18 11:32:37.952: INFO: pod-init-b68a6dc1-5b80-476f-a5fe-c89c90dac8b1 node1 Pending [{Initialized False 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:27:37 +0000 UTC ContainersNotInitialized containers with incomplete status: [init1 init2]} {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:27:37 +0000 UTC ContainersNotReady containers with unready status: [run1]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:27:37 +0000 UTC ContainersNotReady containers with unready status: [run1]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:27:37 +0000 UTC }] Aug 18 11:32:37.952: INFO: Aug 18 11:32:37.957: INFO: Logging node info for node master1 Aug 18 11:32:37.959: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 ebb211fa-503f-4cfe-b1ed-c95d27a70e6e 60796 0 2021-08-18 08:20:52 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"3a:82:be:72:b5:15"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:20:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:20:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:25:59 +0000 UTC,LastTransitionTime:2021-08-18 08:25:59 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:33 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:33 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:33 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:32:33 +0000 UTC,LastTransitionTime:2021-08-18 08:25:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:58c3e57359b641ad92fa1959f2fecf5d,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:012cd796-2076-45d6-8b14-d3e0451b1e64,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[@ :],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:32:37.960: INFO: Logging kubelet events for node master1 Aug 18 11:32:37.962: INFO: Logging pods the kubelet thinks is on node master1 Aug 18 11:32:37.984: INFO: kube-flannel-q64cq started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:32:37.984: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:32:37.984: INFO: Container kube-flannel ready: true, restart count 3 Aug 18 11:32:37.984: INFO: coredns-7677f9bb54-kn2qg started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:37.984: INFO: Container coredns ready: true, restart count 2 Aug 18 11:32:37.984: INFO: kube-scheduler-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:37.984: INFO: Container kube-scheduler ready: true, restart count 0 Aug 18 11:32:37.984: INFO: kube-apiserver-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:37.984: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:32:37.984: INFO: kube-proxy-vqk4v started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:37.984: INFO: Container kube-proxy ready: true, restart count 1 Aug 18 11:32:37.984: INFO: kube-multus-ds-amd64-kbcp6 started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:37.984: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:32:37.984: INFO: docker-registry-docker-registry-56cbc7bc58-49kl2 started at 2021-08-18 08:26:23 +0000 UTC (0+2 container statuses recorded) Aug 18 11:32:37.984: INFO: Container docker-registry ready: true, restart count 0 Aug 18 11:32:37.984: INFO: Container nginx ready: true, restart count 0 Aug 18 11:32:37.984: INFO: node-exporter-5hwz9 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:32:37.984: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:32:37.984: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:32:37.984: INFO: kube-controller-manager-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:37.984: INFO: Container kube-controller-manager ready: true, restart count 2 W0818 11:32:37.998480 29 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:32:38.029: INFO: Latency metrics for node master1 Aug 18 11:32:38.029: INFO: Logging node info for node master2 Aug 18 11:32:38.033: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 78946293-3abe-4442-84d4-8ed6b1d15ce0 60698 0 2021-08-18 08:21:31 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"7e:f5:c2:cc:3a:b4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:21:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:21:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-08-18 08:29:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:32 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:32 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:32 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:32:32 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0c44122c7a7248c18d8571e1cc667258,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:0cd329f2-48e0-4c8f-b8b9-fa3ae0ed8406,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:32:38.033: INFO: Logging kubelet events for node master2 Aug 18 11:32:38.035: INFO: Logging pods the kubelet thinks is on node master2 Aug 18 11:32:38.044: INFO: kube-controller-manager-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:38.044: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:32:38.044: INFO: kube-proxy-kh2l9 started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:38.044: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:32:38.044: INFO: kube-flannel-pp56h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:32:38.044: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:32:38.044: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:32:38.044: INFO: kube-apiserver-master2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:38.044: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:32:38.044: INFO: kube-scheduler-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:38.044: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:32:38.044: INFO: kube-multus-ds-amd64-mld8g started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:38.044: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:32:38.044: INFO: dns-autoscaler-5b7b5c9b6f-hh47r started at 2021-08-18 08:23:57 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:38.044: INFO: Container autoscaler ready: true, restart count 2 Aug 18 11:32:38.044: INFO: node-feature-discovery-controller-5bf5c49849-mq57c started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:38.044: INFO: Container nfd-controller ready: true, restart count 0 Aug 18 11:32:38.044: INFO: node-exporter-48nfx started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:32:38.044: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:32:38.044: INFO: Container node-exporter ready: true, restart count 0 W0818 11:32:38.056785 29 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:32:38.081: INFO: Latency metrics for node master2 Aug 18 11:32:38.081: INFO: Logging node info for node master3 Aug 18 11:32:38.083: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 44feac2b-9447-4be2-9fcd-62f836d67c72 61198 0 2021-08-18 08:21:41 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"86:e4:31:99:58:40"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {kubelet Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:37 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:37 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:37 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:32:37 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1fae19ae59884c44899bcd08aa243244,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:5db926c5-6530-4635-a0d5-806974a3b732,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:32:38.083: INFO: Logging kubelet events for node master3 Aug 18 11:32:38.085: INFO: Logging pods the kubelet thinks is on node master3 Aug 18 11:32:38.092: INFO: node-exporter-vq7d8 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:32:38.092: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:32:38.092: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:32:38.092: INFO: kube-controller-manager-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:38.092: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:32:38.092: INFO: kube-scheduler-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:38.092: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:32:38.092: INFO: kube-apiserver-master3 started at 2021-08-18 08:29:12 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:38.092: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:32:38.092: INFO: kube-proxy-sd5lc started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:38.092: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:32:38.092: INFO: kube-flannel-x6tlr started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:32:38.092: INFO: Init container install-cni ready: true, restart count 1 Aug 18 11:32:38.092: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:32:38.092: INFO: kube-multus-ds-amd64-bkw6c started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:38.092: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:32:38.092: INFO: coredns-7677f9bb54-5hxfh started at 2021-08-18 08:23:54 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:38.092: INFO: Container coredns ready: true, restart count 1 W0818 11:32:38.106363 29 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:32:38.129: INFO: Latency metrics for node master3 Aug 18 11:32:38.129: INFO: Logging node info for node node1 Aug 18 11:32:38.132: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 84defabd-6ebf-43ec-a629-44c6713da9c9 60474 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"9a:87:55:36:7b:df"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:13 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:35 +0000 UTC,LastTransitionTime:2021-08-18 08:26:35 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:30 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:30 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:30 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:32:30 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:69946ff2b7bc462fa25eb7adb4703c23,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:736dc52f-f5e3-494e-86ca-01eedbea015c,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:a7cea43d9d2f67c38fbf0407786edbe660ee9072945f7bb272b55fd255e8eaca opnfv/barometer-collectd:stable],SizeBytes:1075746799,},ContainerImage{Names:[@ :],SizeBytes:1003788820,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[aquasec/kube-hunter@sha256:2be6820bc1d7e0f57193a9a27d5a3e16b2fd93c53747b03ce8ca48c6fc323781 aquasec/kube-hunter:0.3.1],SizeBytes:347611549,},ContainerImage{Names:[golang@sha256:db2475a1dbb2149508e5db31d7d77a75e6600d54be645f37681f03f2762169ba golang:alpine3.12],SizeBytes:301186719,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:de25c7fc6c4f3a27c7f0c2dff454e4671823a34d88abd533f210848d527e0fbb alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:32:38.134: INFO: Logging kubelet events for node node1 Aug 18 11:32:38.136: INFO: Logging pods the kubelet thinks is on node node1 Aug 18 11:32:38.151: INFO: nginx-proxy-node1 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:38.151: INFO: Container nginx-proxy ready: true, restart count 2 Aug 18 11:32:38.151: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-vsxvg started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:38.151: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:32:38.151: INFO: svc-latency-rc-55qj6 started at 2021-08-18 11:32:28 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:38.151: INFO: Container svc-latency-rc ready: true, restart count 0 Aug 18 11:32:38.151: INFO: kube-flannel-q78nd started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:32:38.151: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:32:38.151: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:32:38.151: INFO: prometheus-k8s-0 started at 2021-08-18 08:34:03 +0000 UTC (0+5 container statuses recorded) Aug 18 11:32:38.151: INFO: Container custom-metrics-apiserver ready: true, restart count 0 Aug 18 11:32:38.151: INFO: Container grafana ready: true, restart count 0 Aug 18 11:32:38.151: INFO: Container prometheus ready: true, restart count 1 Aug 18 11:32:38.151: INFO: Container prometheus-config-reloader ready: true, restart count 0 Aug 18 11:32:38.151: INFO: Container rules-configmap-reloader ready: true, restart count 0 Aug 18 11:32:38.151: INFO: test-rolling-update-controller-wx48f started at 2021-08-18 11:29:47 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:38.151: INFO: Container httpd ready: false, restart count 0 Aug 18 11:32:38.151: INFO: ss2-1 started at 2021-08-18 11:26:31 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:38.151: INFO: Container webserver ready: true, restart count 0 Aug 18 11:32:38.151: INFO: kube-multus-ds-amd64-rrvmb started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:38.151: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:32:38.151: INFO: node-feature-discovery-worker-pflgw started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:38.151: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:32:38.151: INFO: node-exporter-kcwvn started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:32:38.151: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:32:38.151: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:32:38.151: INFO: pod-init-b68a6dc1-5b80-476f-a5fe-c89c90dac8b1 started at 2021-08-18 11:27:37 +0000 UTC (2+1 container statuses recorded) Aug 18 11:32:38.151: INFO: Init container init1 ready: false, restart count 0 Aug 18 11:32:38.151: INFO: Init container init2 ready: false, restart count 0 Aug 18 11:32:38.151: INFO: Container run1 ready: false, restart count 0 Aug 18 11:32:38.151: INFO: downwardapi-volume-2c6bc940-6bad-4d98-9f23-6990874495be started at 2021-08-18 11:32:35 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:38.151: INFO: Container client-container ready: false, restart count 0 Aug 18 11:32:38.151: INFO: pod-logs-websocket-d8642f34-1a3a-44bb-86fd-c0e2f884df31 started at 2021-08-18 11:32:11 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:38.151: INFO: Container main ready: false, restart count 0 Aug 18 11:32:38.151: INFO: affinity-nodeport-transition-w7b49 started at 2021-08-18 11:32:19 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:38.151: INFO: Container affinity-nodeport-transition ready: true, restart count 0 Aug 18 11:32:38.151: INFO: kube-proxy-p6jvp started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:38.151: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:32:38.151: INFO: kubernetes-metrics-scraper-678c97765c-9nsv5 started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:38.151: INFO: Container kubernetes-metrics-scraper ready: true, restart count 2 Aug 18 11:32:38.151: INFO: cmk-init-discover-node1-bxznx started at 2021-08-18 08:32:10 +0000 UTC (0+3 container statuses recorded) Aug 18 11:32:38.151: INFO: Container discover ready: false, restart count 0 Aug 18 11:32:38.151: INFO: Container init ready: false, restart count 0 Aug 18 11:32:38.151: INFO: Container install ready: false, restart count 0 Aug 18 11:32:38.151: INFO: cmk-d8r27 started at 2021-08-18 08:32:52 +0000 UTC (0+2 container statuses recorded) Aug 18 11:32:38.151: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:32:38.151: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:32:38.151: INFO: collectd-xdprr started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:32:38.151: INFO: Container collectd ready: true, restart count 0 Aug 18 11:32:38.151: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:32:38.151: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:32:38.151: INFO: affinity-nodeport-transition-7hhl7 started at 2021-08-18 11:32:19 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:38.151: INFO: Container affinity-nodeport-transition ready: true, restart count 0 Aug 18 11:32:38.151: INFO: ss2-0 started at 2021-08-18 11:26:45 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:38.151: INFO: Container webserver ready: true, restart count 0 W0818 11:32:38.163725 29 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:32:38.194: INFO: Latency metrics for node node1 Aug 18 11:32:38.194: INFO: Logging node info for node node2 Aug 18 11:32:38.197: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 1d01177e-3dbb-48a1-a0bc-d18af27ab7f8 60491 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:d1:47:f8:1d:22"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:36 +0000 UTC,LastTransitionTime:2021-08-18 08:26:36 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:31 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:31 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:31 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:32:31 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:dc1f286135c145349b8a016880b65a2f,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:037e7e2d-94e9-42f4-a719-896e5005ac70,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:32:38.198: INFO: Logging kubelet events for node node2 Aug 18 11:32:38.200: INFO: Logging pods the kubelet thinks is on node node2 Aug 18 11:32:38.214: INFO: execpod-affinityrr59g started at 2021-08-18 11:32:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:38.214: INFO: Container agnhost-container ready: true, restart count 0 Aug 18 11:32:38.214: INFO: ss2-2 started at 2021-08-18 11:27:31 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:38.214: INFO: Container webserver ready: false, restart count 0 Aug 18 11:32:38.214: INFO: nginx-proxy-node2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:38.214: INFO: Container nginx-proxy ready: true, restart count 1 Aug 18 11:32:38.214: INFO: cmk-init-discover-node2-6b2kz started at 2021-08-18 08:32:30 +0000 UTC (0+3 container statuses recorded) Aug 18 11:32:38.214: INFO: Container discover ready: false, restart count 0 Aug 18 11:32:38.214: INFO: Container init ready: false, restart count 0 Aug 18 11:32:38.214: INFO: Container install ready: false, restart count 0 Aug 18 11:32:38.214: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-7rn45 started at 2021-08-18 08:36:42 +0000 UTC (0+2 container statuses recorded) Aug 18 11:32:38.214: INFO: Container tas-controller ready: true, restart count 0 Aug 18 11:32:38.214: INFO: Container tas-extender ready: true, restart count 0 Aug 18 11:32:38.214: INFO: kubernetes-dashboard-86c6f9df5b-qrtdk started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:38.214: INFO: Container kubernetes-dashboard ready: true, restart count 2 Aug 18 11:32:38.214: INFO: cmk-748rz started at 2021-08-18 08:32:53 +0000 UTC (0+2 container statuses recorded) Aug 18 11:32:38.214: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:32:38.214: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:32:38.214: INFO: prometheus-operator-5bb8cb9d8f-k97ws started at 2021-08-18 08:33:38 +0000 UTC (0+2 container statuses recorded) Aug 18 11:32:38.214: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:32:38.214: INFO: Container prometheus-operator ready: true, restart count 0 Aug 18 11:32:38.214: INFO: kube-proxy-qkj9c started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:38.214: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:32:38.214: INFO: node-feature-discovery-worker-hzpf5 started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:38.214: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:32:38.214: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-c82pt started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:38.214: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:32:38.214: INFO: var-expansion-cf1f3322-29ba-472a-9702-20756a20f986 started at 2021-08-18 11:28:58 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:38.214: INFO: Container dapi-container ready: false, restart count 0 Aug 18 11:32:38.214: INFO: affinity-nodeport-transition-v84k6 started at 2021-08-18 11:32:19 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:38.214: INFO: Container affinity-nodeport-transition ready: true, restart count 0 Aug 18 11:32:38.214: INFO: kube-multus-ds-amd64-rvzsg started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:38.214: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:32:38.214: INFO: collectd-67ntq started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:32:38.214: INFO: Container collectd ready: true, restart count 0 Aug 18 11:32:38.214: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:32:38.214: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:32:38.214: INFO: downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a started at 2021-08-18 11:31:01 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:38.214: INFO: Container dapi-container ready: false, restart count 0 Aug 18 11:32:38.214: INFO: cmk-webhook-6c9d5f8578-7cxjr started at 2021-08-18 08:32:53 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:38.214: INFO: Container cmk-webhook ready: true, restart count 0 Aug 18 11:32:38.214: INFO: kube-flannel-h7t5h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:32:38.214: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:32:38.214: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:32:38.214: INFO: node-exporter-lrrf2 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:32:38.214: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:32:38.214: INFO: Container node-exporter ready: true, restart count 0 W0818 11:32:38.228608 29 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:32:38.262: INFO: Latency metrics for node node2 Aug 18 11:32:38.262: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "init-container-2776" for this suite. • Failure [300.360 seconds] [k8s.io] InitContainer [NodeConformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 should invoke init containers on a RestartAlways pod [Conformance] [It] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:32:37.944: Expected <*errors.errorString | 0xc0003081f0>: { s: "timed out waiting for the condition", } to be nil /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/init_container.go:302 ------------------------------ {"msg":"FAILED [k8s.io] InitContainer [NodeConformance] should invoke init containers on a RestartAlways pod [Conformance]","total":-1,"completed":15,"skipped":280,"failed":1,"failures":["[k8s.io] InitContainer [NodeConformance] should invoke init containers on a RestartAlways pod [Conformance]"]} SS ------------------------------ [BeforeEach] [sig-storage] Projected downwardAPI /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:32:35.381: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename projected STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-storage] Projected downwardAPI /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/projected_downwardapi.go:42 [It] should provide container's memory request [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating a pod to test downward API volume plugin Aug 18 11:32:35.413: INFO: Waiting up to 5m0s for pod "downwardapi-volume-2c6bc940-6bad-4d98-9f23-6990874495be" in namespace "projected-3527" to be "Succeeded or Failed" Aug 18 11:32:35.415: INFO: Pod "downwardapi-volume-2c6bc940-6bad-4d98-9f23-6990874495be": Phase="Pending", Reason="", readiness=false. Elapsed: 2.311579ms Aug 18 11:32:37.419: INFO: Pod "downwardapi-volume-2c6bc940-6bad-4d98-9f23-6990874495be": Phase="Pending", Reason="", readiness=false. Elapsed: 2.006420279s Aug 18 11:32:39.423: INFO: Pod "downwardapi-volume-2c6bc940-6bad-4d98-9f23-6990874495be": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.009749723s STEP: Saw pod success Aug 18 11:32:39.423: INFO: Pod "downwardapi-volume-2c6bc940-6bad-4d98-9f23-6990874495be" satisfied condition "Succeeded or Failed" Aug 18 11:32:39.425: INFO: Trying to get logs from node node1 pod downwardapi-volume-2c6bc940-6bad-4d98-9f23-6990874495be container client-container: STEP: delete the pod Aug 18 11:32:39.442: INFO: Waiting for pod downwardapi-volume-2c6bc940-6bad-4d98-9f23-6990874495be to disappear Aug 18 11:32:39.443: INFO: Pod downwardapi-volume-2c6bc940-6bad-4d98-9f23-6990874495be no longer exists [AfterEach] [sig-storage] Projected downwardAPI /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:32:39.444: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "projected-3527" for this suite. • ------------------------------ {"msg":"PASSED [sig-storage] Projected downwardAPI should provide container's memory request [NodeConformance] [Conformance]","total":-1,"completed":4,"skipped":96,"failed":1,"failures":["[k8s.io] Variable Expansion should allow substituting values in a volume subpath [sig-storage] [Conformance]"]} SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-network] Service endpoints latency /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:32:28.577: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename svc-latency STEP: Waiting for a default service account to be provisioned in namespace [It] should not be very high [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:32:28.599: INFO: >>> kubeConfig: /root/.kube/config STEP: creating replication controller svc-latency-rc in namespace svc-latency-7461 I0818 11:32:28.620343 27 runners.go:190] Created replication controller with name: svc-latency-rc, namespace: svc-latency-7461, replica count: 1 I0818 11:32:29.671116 27 runners.go:190] svc-latency-rc Pods: 1 out of 1 created, 0 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0818 11:32:30.671489 27 runners.go:190] svc-latency-rc Pods: 1 out of 1 created, 0 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0818 11:32:31.671907 27 runners.go:190] svc-latency-rc Pods: 1 out of 1 created, 1 running, 0 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady Aug 18 11:32:31.779: INFO: Created: latency-svc-vmdrp Aug 18 11:32:31.784: INFO: Got endpoints: latency-svc-vmdrp [12.102799ms] Aug 18 11:32:31.789: INFO: Created: latency-svc-89dns Aug 18 11:32:31.791: INFO: Got endpoints: latency-svc-89dns [7.434017ms] Aug 18 11:32:31.792: INFO: Created: latency-svc-9lmcb Aug 18 11:32:31.794: INFO: Got endpoints: latency-svc-9lmcb [10.192121ms] Aug 18 11:32:31.796: INFO: Created: latency-svc-4wsv6 Aug 18 11:32:31.797: INFO: Got endpoints: latency-svc-4wsv6 [13.137714ms] Aug 18 11:32:31.798: INFO: Created: latency-svc-wkznd Aug 18 11:32:31.800: INFO: Got endpoints: latency-svc-wkznd [15.989182ms] Aug 18 11:32:31.802: INFO: Created: latency-svc-x92jz Aug 18 11:32:31.804: INFO: Got endpoints: latency-svc-x92jz [19.318505ms] Aug 18 11:32:31.804: INFO: Created: latency-svc-bd6bp Aug 18 11:32:31.806: INFO: Created: latency-svc-7dnrl Aug 18 11:32:31.807: INFO: Got endpoints: latency-svc-bd6bp [22.538097ms] Aug 18 11:32:31.808: INFO: Got endpoints: latency-svc-7dnrl [23.623225ms] Aug 18 11:32:31.809: INFO: Created: latency-svc-r8sl4 Aug 18 11:32:31.811: INFO: Got endpoints: latency-svc-r8sl4 [26.424962ms] Aug 18 11:32:31.811: INFO: Created: latency-svc-ll9wr Aug 18 11:32:31.813: INFO: Got endpoints: latency-svc-ll9wr [29.005502ms] Aug 18 11:32:31.813: INFO: Created: latency-svc-hqsnx Aug 18 11:32:31.816: INFO: Got endpoints: latency-svc-hqsnx [31.608357ms] Aug 18 11:32:31.817: INFO: Created: latency-svc-s2vd5 Aug 18 11:32:31.819: INFO: Got endpoints: latency-svc-s2vd5 [34.008503ms] Aug 18 11:32:31.819: INFO: Created: latency-svc-zqjmb Aug 18 11:32:31.821: INFO: Got endpoints: latency-svc-zqjmb [36.868145ms] Aug 18 11:32:31.822: INFO: Created: latency-svc-nqm5x Aug 18 11:32:31.824: INFO: Got endpoints: latency-svc-nqm5x [39.436701ms] Aug 18 11:32:31.825: INFO: Created: latency-svc-b7zfm Aug 18 11:32:31.827: INFO: Got endpoints: latency-svc-b7zfm [42.205061ms] Aug 18 11:32:31.828: INFO: Created: latency-svc-tg4rz Aug 18 11:32:31.830: INFO: Got endpoints: latency-svc-tg4rz [45.026343ms] Aug 18 11:32:31.830: INFO: Created: latency-svc-6ls6p Aug 18 11:32:31.832: INFO: Got endpoints: latency-svc-6ls6p [40.663459ms] Aug 18 11:32:31.833: INFO: Created: latency-svc-5zrwm Aug 18 11:32:31.835: INFO: Got endpoints: latency-svc-5zrwm [40.372923ms] Aug 18 11:32:31.836: INFO: Created: latency-svc-d8868 Aug 18 11:32:31.838: INFO: Got endpoints: latency-svc-d8868 [40.434461ms] Aug 18 11:32:31.838: INFO: Created: latency-svc-nbz8d Aug 18 11:32:31.840: INFO: Got endpoints: latency-svc-nbz8d [39.795177ms] Aug 18 11:32:31.841: INFO: Created: latency-svc-85s42 Aug 18 11:32:31.843: INFO: Got endpoints: latency-svc-85s42 [39.371741ms] Aug 18 11:32:31.844: INFO: Created: latency-svc-ckk4w Aug 18 11:32:31.846: INFO: Got endpoints: latency-svc-ckk4w [38.616545ms] Aug 18 11:32:31.847: INFO: Created: latency-svc-2qmfn Aug 18 11:32:31.849: INFO: Got endpoints: latency-svc-2qmfn [40.587427ms] Aug 18 11:32:31.850: INFO: Created: latency-svc-pfz24 Aug 18 11:32:31.852: INFO: Got endpoints: latency-svc-pfz24 [41.281161ms] Aug 18 11:32:31.853: INFO: Created: latency-svc-4qdzv Aug 18 11:32:31.854: INFO: Created: latency-svc-sqbht Aug 18 11:32:31.854: INFO: Got endpoints: latency-svc-4qdzv [40.987597ms] Aug 18 11:32:31.856: INFO: Got endpoints: latency-svc-sqbht [40.057788ms] Aug 18 11:32:31.857: INFO: Created: latency-svc-dhpdz Aug 18 11:32:31.859: INFO: Got endpoints: latency-svc-dhpdz [40.80226ms] Aug 18 11:32:31.860: INFO: Created: latency-svc-xkgf5 Aug 18 11:32:31.862: INFO: Got endpoints: latency-svc-xkgf5 [40.60962ms] Aug 18 11:32:31.862: INFO: Created: latency-svc-lx4mk Aug 18 11:32:31.864: INFO: Got endpoints: latency-svc-lx4mk [39.828408ms] Aug 18 11:32:31.865: INFO: Created: latency-svc-sclcl Aug 18 11:32:31.867: INFO: Got endpoints: latency-svc-sclcl [39.810382ms] Aug 18 11:32:31.868: INFO: Created: latency-svc-k8t55 Aug 18 11:32:31.870: INFO: Got endpoints: latency-svc-k8t55 [39.942722ms] Aug 18 11:32:31.870: INFO: Created: latency-svc-skcjt Aug 18 11:32:31.873: INFO: Created: latency-svc-2b7sk Aug 18 11:32:31.876: INFO: Created: latency-svc-gwmk9 Aug 18 11:32:31.878: INFO: Created: latency-svc-gxmhj Aug 18 11:32:31.882: INFO: Got endpoints: latency-svc-skcjt [49.574823ms] Aug 18 11:32:31.882: INFO: Created: latency-svc-zg6db Aug 18 11:32:31.884: INFO: Created: latency-svc-sngrn Aug 18 11:32:31.886: INFO: Created: latency-svc-qhkkd Aug 18 11:32:31.889: INFO: Created: latency-svc-tbxbp Aug 18 11:32:31.891: INFO: Created: latency-svc-wxnj2 Aug 18 11:32:31.894: INFO: Created: latency-svc-q2lfs Aug 18 11:32:31.897: INFO: Created: latency-svc-67x6w Aug 18 11:32:31.899: INFO: Created: latency-svc-tz2f2 Aug 18 11:32:31.901: INFO: Created: latency-svc-ksmcs Aug 18 11:32:31.904: INFO: Created: latency-svc-jgzfp Aug 18 11:32:31.907: INFO: Created: latency-svc-mdbkv Aug 18 11:32:31.909: INFO: Created: latency-svc-l8lwf Aug 18 11:32:31.932: INFO: Got endpoints: latency-svc-2b7sk [97.413398ms] Aug 18 11:32:31.937: INFO: Created: latency-svc-bt9t7 Aug 18 11:32:31.982: INFO: Got endpoints: latency-svc-gwmk9 [143.83759ms] Aug 18 11:32:31.987: INFO: Created: latency-svc-z4bdt Aug 18 11:32:32.032: INFO: Got endpoints: latency-svc-gxmhj [191.816706ms] Aug 18 11:32:32.038: INFO: Created: latency-svc-b84q6 Aug 18 11:32:32.081: INFO: Got endpoints: latency-svc-zg6db [238.263573ms] Aug 18 11:32:32.087: INFO: Created: latency-svc-4wqdg Aug 18 11:32:32.132: INFO: Got endpoints: latency-svc-sngrn [286.511702ms] Aug 18 11:32:32.137: INFO: Created: latency-svc-6mnnt Aug 18 11:32:32.182: INFO: Got endpoints: latency-svc-qhkkd [333.88288ms] Aug 18 11:32:32.187: INFO: Created: latency-svc-x2sj8 Aug 18 11:32:32.232: INFO: Got endpoints: latency-svc-tbxbp [380.035036ms] Aug 18 11:32:32.237: INFO: Created: latency-svc-r7vqq Aug 18 11:32:32.282: INFO: Got endpoints: latency-svc-wxnj2 [427.160541ms] Aug 18 11:32:32.287: INFO: Created: latency-svc-kgp2f Aug 18 11:32:32.332: INFO: Got endpoints: latency-svc-q2lfs [475.885589ms] Aug 18 11:32:32.338: INFO: Created: latency-svc-4bdn8 Aug 18 11:32:32.382: INFO: Got endpoints: latency-svc-67x6w [522.969375ms] Aug 18 11:32:32.390: INFO: Created: latency-svc-xpxfd Aug 18 11:32:32.431: INFO: Got endpoints: latency-svc-tz2f2 [569.360574ms] Aug 18 11:32:32.437: INFO: Created: latency-svc-n5269 Aug 18 11:32:32.482: INFO: Got endpoints: latency-svc-ksmcs [618.40443ms] Aug 18 11:32:32.488: INFO: Created: latency-svc-5dl5v Aug 18 11:32:32.532: INFO: Got endpoints: latency-svc-jgzfp [665.770836ms] Aug 18 11:32:32.539: INFO: Created: latency-svc-ldcwx Aug 18 11:32:32.583: INFO: Got endpoints: latency-svc-mdbkv [713.676235ms] Aug 18 11:32:32.589: INFO: Created: latency-svc-5rj7g Aug 18 11:32:32.632: INFO: Got endpoints: latency-svc-l8lwf [750.469493ms] Aug 18 11:32:32.638: INFO: Created: latency-svc-wdm7f Aug 18 11:32:32.682: INFO: Got endpoints: latency-svc-bt9t7 [749.259417ms] Aug 18 11:32:32.687: INFO: Created: latency-svc-56d7p Aug 18 11:32:32.732: INFO: Got endpoints: latency-svc-z4bdt [750.239866ms] Aug 18 11:32:32.738: INFO: Created: latency-svc-d8bw2 Aug 18 11:32:32.782: INFO: Got endpoints: latency-svc-b84q6 [749.746309ms] Aug 18 11:32:32.788: INFO: Created: latency-svc-qslg2 Aug 18 11:32:32.833: INFO: Got endpoints: latency-svc-4wqdg [751.101792ms] Aug 18 11:32:32.839: INFO: Created: latency-svc-8z2xk Aug 18 11:32:32.882: INFO: Got endpoints: latency-svc-6mnnt [750.072048ms] Aug 18 11:32:32.887: INFO: Created: latency-svc-6v5dq Aug 18 11:32:32.933: INFO: Got endpoints: latency-svc-x2sj8 [750.444505ms] Aug 18 11:32:32.938: INFO: Created: latency-svc-tlzbl Aug 18 11:32:32.982: INFO: Got endpoints: latency-svc-r7vqq [749.867349ms] Aug 18 11:32:32.987: INFO: Created: latency-svc-jpq4z Aug 18 11:32:33.032: INFO: Got endpoints: latency-svc-kgp2f [750.716726ms] Aug 18 11:32:33.038: INFO: Created: latency-svc-5ww2z Aug 18 11:32:33.082: INFO: Got endpoints: latency-svc-4bdn8 [749.683383ms] Aug 18 11:32:33.087: INFO: Created: latency-svc-msjjb Aug 18 11:32:33.132: INFO: Got endpoints: latency-svc-xpxfd [750.045434ms] Aug 18 11:32:33.138: INFO: Created: latency-svc-5tq72 Aug 18 11:32:33.181: INFO: Got endpoints: latency-svc-n5269 [749.881664ms] Aug 18 11:32:33.187: INFO: Created: latency-svc-mmltv Aug 18 11:32:33.232: INFO: Got endpoints: latency-svc-5dl5v [749.845765ms] Aug 18 11:32:33.237: INFO: Created: latency-svc-2tmxf Aug 18 11:32:33.282: INFO: Got endpoints: latency-svc-ldcwx [749.636838ms] Aug 18 11:32:33.288: INFO: Created: latency-svc-75lmn Aug 18 11:32:33.332: INFO: Got endpoints: latency-svc-5rj7g [748.85748ms] Aug 18 11:32:33.338: INFO: Created: latency-svc-5nb4c Aug 18 11:32:33.383: INFO: Got endpoints: latency-svc-wdm7f [750.754493ms] Aug 18 11:32:33.390: INFO: Created: latency-svc-f9p8l Aug 18 11:32:33.432: INFO: Got endpoints: latency-svc-56d7p [750.27771ms] Aug 18 11:32:33.438: INFO: Created: latency-svc-k7c5v Aug 18 11:32:33.482: INFO: Got endpoints: latency-svc-d8bw2 [749.646399ms] Aug 18 11:32:33.488: INFO: Created: latency-svc-6rf92 Aug 18 11:32:33.532: INFO: Got endpoints: latency-svc-qslg2 [750.549116ms] Aug 18 11:32:33.539: INFO: Created: latency-svc-kx4lh Aug 18 11:32:33.582: INFO: Got endpoints: latency-svc-8z2xk [749.104075ms] Aug 18 11:32:33.588: INFO: Created: latency-svc-2lpd8 Aug 18 11:32:33.632: INFO: Got endpoints: latency-svc-6v5dq [749.511546ms] Aug 18 11:32:33.638: INFO: Created: latency-svc-kl2jt Aug 18 11:32:33.683: INFO: Got endpoints: latency-svc-tlzbl [750.090349ms] Aug 18 11:32:33.689: INFO: Created: latency-svc-4b5z9 Aug 18 11:32:33.732: INFO: Got endpoints: latency-svc-jpq4z [749.476732ms] Aug 18 11:32:33.737: INFO: Created: latency-svc-7g5jb Aug 18 11:32:33.782: INFO: Got endpoints: latency-svc-5ww2z [749.178924ms] Aug 18 11:32:33.787: INFO: Created: latency-svc-5spdn Aug 18 11:32:33.832: INFO: Got endpoints: latency-svc-msjjb [749.989716ms] Aug 18 11:32:33.838: INFO: Created: latency-svc-kxln9 Aug 18 11:32:33.882: INFO: Got endpoints: latency-svc-5tq72 [749.588805ms] Aug 18 11:32:33.888: INFO: Created: latency-svc-xlbk4 Aug 18 11:32:33.932: INFO: Got endpoints: latency-svc-mmltv [750.485922ms] Aug 18 11:32:33.939: INFO: Created: latency-svc-pb4sf Aug 18 11:32:33.982: INFO: Got endpoints: latency-svc-2tmxf [749.611402ms] Aug 18 11:32:33.987: INFO: Created: latency-svc-rdzgx Aug 18 11:32:34.032: INFO: Got endpoints: latency-svc-75lmn [749.849904ms] Aug 18 11:32:34.040: INFO: Created: latency-svc-224q4 Aug 18 11:32:34.083: INFO: Got endpoints: latency-svc-5nb4c [750.351001ms] Aug 18 11:32:34.087: INFO: Created: latency-svc-wkv2m Aug 18 11:32:34.132: INFO: Got endpoints: latency-svc-f9p8l [749.283923ms] Aug 18 11:32:34.137: INFO: Created: latency-svc-qksm2 Aug 18 11:32:34.184: INFO: Got endpoints: latency-svc-k7c5v [752.399982ms] Aug 18 11:32:34.190: INFO: Created: latency-svc-vncst Aug 18 11:32:34.232: INFO: Got endpoints: latency-svc-6rf92 [750.550249ms] Aug 18 11:32:34.238: INFO: Created: latency-svc-bn6ss Aug 18 11:32:34.282: INFO: Got endpoints: latency-svc-kx4lh [749.86047ms] Aug 18 11:32:34.287: INFO: Created: latency-svc-v7qcp Aug 18 11:32:34.332: INFO: Got endpoints: latency-svc-2lpd8 [749.964521ms] Aug 18 11:32:34.337: INFO: Created: latency-svc-tn7fb Aug 18 11:32:34.382: INFO: Got endpoints: latency-svc-kl2jt [749.802333ms] Aug 18 11:32:34.387: INFO: Created: latency-svc-6x25s Aug 18 11:32:34.433: INFO: Got endpoints: latency-svc-4b5z9 [749.435974ms] Aug 18 11:32:34.438: INFO: Created: latency-svc-gf4qv Aug 18 11:32:34.482: INFO: Got endpoints: latency-svc-7g5jb [750.484227ms] Aug 18 11:32:34.488: INFO: Created: latency-svc-6mfp8 Aug 18 11:32:34.532: INFO: Got endpoints: latency-svc-5spdn [750.690353ms] Aug 18 11:32:34.537: INFO: Created: latency-svc-qx7x8 Aug 18 11:32:34.583: INFO: Got endpoints: latency-svc-kxln9 [750.775173ms] Aug 18 11:32:34.588: INFO: Created: latency-svc-zbd8h Aug 18 11:32:34.632: INFO: Got endpoints: latency-svc-xlbk4 [749.424529ms] Aug 18 11:32:34.637: INFO: Created: latency-svc-mdj98 Aug 18 11:32:34.682: INFO: Got endpoints: latency-svc-pb4sf [750.375308ms] Aug 18 11:32:34.688: INFO: Created: latency-svc-kwd7c Aug 18 11:32:34.732: INFO: Got endpoints: latency-svc-rdzgx [750.042026ms] Aug 18 11:32:34.737: INFO: Created: latency-svc-mz586 Aug 18 11:32:34.782: INFO: Got endpoints: latency-svc-224q4 [749.999744ms] Aug 18 11:32:34.788: INFO: Created: latency-svc-bl5jk Aug 18 11:32:34.832: INFO: Got endpoints: latency-svc-wkv2m [749.197542ms] Aug 18 11:32:34.839: INFO: Created: latency-svc-78p5r Aug 18 11:32:34.884: INFO: Got endpoints: latency-svc-qksm2 [752.008152ms] Aug 18 11:32:34.897: INFO: Created: latency-svc-bdtgz Aug 18 11:32:34.932: INFO: Got endpoints: latency-svc-vncst [747.688157ms] Aug 18 11:32:34.937: INFO: Created: latency-svc-29sxk Aug 18 11:32:34.983: INFO: Got endpoints: latency-svc-bn6ss [750.590776ms] Aug 18 11:32:34.989: INFO: Created: latency-svc-ghvnq Aug 18 11:32:35.032: INFO: Got endpoints: latency-svc-v7qcp [749.443447ms] Aug 18 11:32:35.037: INFO: Created: latency-svc-qsh7c Aug 18 11:32:35.083: INFO: Got endpoints: latency-svc-tn7fb [750.632325ms] Aug 18 11:32:35.088: INFO: Created: latency-svc-4jxzp Aug 18 11:32:35.132: INFO: Got endpoints: latency-svc-6x25s [750.193321ms] Aug 18 11:32:35.137: INFO: Created: latency-svc-kzhx4 Aug 18 11:32:35.182: INFO: Got endpoints: latency-svc-gf4qv [748.995691ms] Aug 18 11:32:35.188: INFO: Created: latency-svc-wr7v7 Aug 18 11:32:35.232: INFO: Got endpoints: latency-svc-6mfp8 [749.73486ms] Aug 18 11:32:35.239: INFO: Created: latency-svc-jcncs Aug 18 11:32:35.283: INFO: Got endpoints: latency-svc-qx7x8 [750.057158ms] Aug 18 11:32:35.287: INFO: Created: latency-svc-g7827 Aug 18 11:32:35.334: INFO: Got endpoints: latency-svc-zbd8h [751.090641ms] Aug 18 11:32:35.339: INFO: Created: latency-svc-bd7rk Aug 18 11:32:35.382: INFO: Got endpoints: latency-svc-mdj98 [750.483519ms] Aug 18 11:32:35.388: INFO: Created: latency-svc-8bpj5 Aug 18 11:32:35.432: INFO: Got endpoints: latency-svc-kwd7c [749.528393ms] Aug 18 11:32:35.438: INFO: Created: latency-svc-w2w8n Aug 18 11:32:35.482: INFO: Got endpoints: latency-svc-mz586 [750.145019ms] Aug 18 11:32:35.489: INFO: Created: latency-svc-mcwvn Aug 18 11:32:35.531: INFO: Got endpoints: latency-svc-bl5jk [749.337439ms] Aug 18 11:32:35.537: INFO: Created: latency-svc-6lqxm Aug 18 11:32:35.582: INFO: Got endpoints: latency-svc-78p5r [750.380123ms] Aug 18 11:32:35.587: INFO: Created: latency-svc-2cj99 Aug 18 11:32:35.632: INFO: Got endpoints: latency-svc-bdtgz [747.778787ms] Aug 18 11:32:35.637: INFO: Created: latency-svc-xtqzb Aug 18 11:32:35.682: INFO: Got endpoints: latency-svc-29sxk [749.822117ms] Aug 18 11:32:35.688: INFO: Created: latency-svc-5gddk Aug 18 11:32:35.732: INFO: Got endpoints: latency-svc-ghvnq [748.864614ms] Aug 18 11:32:35.737: INFO: Created: latency-svc-qp94b Aug 18 11:32:35.782: INFO: Got endpoints: latency-svc-qsh7c [750.301089ms] Aug 18 11:32:35.788: INFO: Created: latency-svc-62nlx Aug 18 11:32:35.832: INFO: Got endpoints: latency-svc-4jxzp [749.2415ms] Aug 18 11:32:35.838: INFO: Created: latency-svc-x9xrn Aug 18 11:32:35.882: INFO: Got endpoints: latency-svc-kzhx4 [750.395381ms] Aug 18 11:32:35.887: INFO: Created: latency-svc-28kbv Aug 18 11:32:35.932: INFO: Got endpoints: latency-svc-wr7v7 [750.262152ms] Aug 18 11:32:35.939: INFO: Created: latency-svc-jhmkb Aug 18 11:32:35.982: INFO: Got endpoints: latency-svc-jcncs [750.185875ms] Aug 18 11:32:35.988: INFO: Created: latency-svc-726fx Aug 18 11:32:36.032: INFO: Got endpoints: latency-svc-g7827 [749.446328ms] Aug 18 11:32:36.037: INFO: Created: latency-svc-6jdg7 Aug 18 11:32:36.082: INFO: Got endpoints: latency-svc-bd7rk [748.167003ms] Aug 18 11:32:36.089: INFO: Created: latency-svc-nnkbm Aug 18 11:32:36.132: INFO: Got endpoints: latency-svc-8bpj5 [749.87082ms] Aug 18 11:32:36.137: INFO: Created: latency-svc-mfsmw Aug 18 11:32:36.183: INFO: Got endpoints: latency-svc-w2w8n [751.134305ms] Aug 18 11:32:36.189: INFO: Created: latency-svc-9ws7p Aug 18 11:32:36.233: INFO: Got endpoints: latency-svc-mcwvn [750.610743ms] Aug 18 11:32:36.238: INFO: Created: latency-svc-88ssf Aug 18 11:32:36.282: INFO: Got endpoints: latency-svc-6lqxm [750.453703ms] Aug 18 11:32:36.288: INFO: Created: latency-svc-z9f9g Aug 18 11:32:36.333: INFO: Got endpoints: latency-svc-2cj99 [750.221521ms] Aug 18 11:32:36.338: INFO: Created: latency-svc-hx62c Aug 18 11:32:36.382: INFO: Got endpoints: latency-svc-xtqzb [749.413323ms] Aug 18 11:32:36.389: INFO: Created: latency-svc-8ck65 Aug 18 11:32:36.432: INFO: Got endpoints: latency-svc-5gddk [749.759693ms] Aug 18 11:32:36.439: INFO: Created: latency-svc-vmq9w Aug 18 11:32:36.483: INFO: Got endpoints: latency-svc-qp94b [751.170389ms] Aug 18 11:32:36.489: INFO: Created: latency-svc-kmhb5 Aug 18 11:32:36.532: INFO: Got endpoints: latency-svc-62nlx [750.078446ms] Aug 18 11:32:36.538: INFO: Created: latency-svc-765s4 Aug 18 11:32:36.582: INFO: Got endpoints: latency-svc-x9xrn [750.337158ms] Aug 18 11:32:36.588: INFO: Created: latency-svc-qlctl Aug 18 11:32:36.632: INFO: Got endpoints: latency-svc-28kbv [750.081287ms] Aug 18 11:32:36.637: INFO: Created: latency-svc-qqx26 Aug 18 11:32:36.682: INFO: Got endpoints: latency-svc-jhmkb [750.241806ms] Aug 18 11:32:36.689: INFO: Created: latency-svc-5wztp Aug 18 11:32:36.732: INFO: Got endpoints: latency-svc-726fx [749.625406ms] Aug 18 11:32:36.739: INFO: Created: latency-svc-zvr9j Aug 18 11:32:36.782: INFO: Got endpoints: latency-svc-6jdg7 [749.833761ms] Aug 18 11:32:36.787: INFO: Created: latency-svc-t2wk5 Aug 18 11:32:36.832: INFO: Got endpoints: latency-svc-nnkbm [749.854456ms] Aug 18 11:32:36.838: INFO: Created: latency-svc-6fcp2 Aug 18 11:32:36.882: INFO: Got endpoints: latency-svc-mfsmw [749.913395ms] Aug 18 11:32:36.890: INFO: Created: latency-svc-t98s6 Aug 18 11:32:36.932: INFO: Got endpoints: latency-svc-9ws7p [748.873478ms] Aug 18 11:32:36.938: INFO: Created: latency-svc-722wq Aug 18 11:32:36.983: INFO: Got endpoints: latency-svc-88ssf [749.722414ms] Aug 18 11:32:36.989: INFO: Created: latency-svc-q6s9g Aug 18 11:32:37.033: INFO: Got endpoints: latency-svc-z9f9g [750.790099ms] Aug 18 11:32:37.039: INFO: Created: latency-svc-kd6qq Aug 18 11:32:37.082: INFO: Got endpoints: latency-svc-hx62c [749.889173ms] Aug 18 11:32:37.088: INFO: Created: latency-svc-n2d88 Aug 18 11:32:37.132: INFO: Got endpoints: latency-svc-8ck65 [750.062908ms] Aug 18 11:32:37.137: INFO: Created: latency-svc-ndc8t Aug 18 11:32:37.182: INFO: Got endpoints: latency-svc-vmq9w [750.048242ms] Aug 18 11:32:37.187: INFO: Created: latency-svc-frggr Aug 18 11:32:37.232: INFO: Got endpoints: latency-svc-kmhb5 [749.260612ms] Aug 18 11:32:37.237: INFO: Created: latency-svc-rhxsh Aug 18 11:32:37.282: INFO: Got endpoints: latency-svc-765s4 [749.337719ms] Aug 18 11:32:37.287: INFO: Created: latency-svc-n2bnk Aug 18 11:32:37.332: INFO: Got endpoints: latency-svc-qlctl [749.549179ms] Aug 18 11:32:37.338: INFO: Created: latency-svc-xxnx9 Aug 18 11:32:37.383: INFO: Got endpoints: latency-svc-qqx26 [750.510767ms] Aug 18 11:32:37.388: INFO: Created: latency-svc-zdk4h Aug 18 11:32:37.433: INFO: Got endpoints: latency-svc-5wztp [750.149865ms] Aug 18 11:32:37.438: INFO: Created: latency-svc-2cgbs Aug 18 11:32:37.483: INFO: Got endpoints: latency-svc-zvr9j [750.75568ms] Aug 18 11:32:37.489: INFO: Created: latency-svc-8fq6x Aug 18 11:32:37.532: INFO: Got endpoints: latency-svc-t2wk5 [750.309647ms] Aug 18 11:32:37.538: INFO: Created: latency-svc-4xkhx Aug 18 11:32:37.582: INFO: Got endpoints: latency-svc-6fcp2 [750.285591ms] Aug 18 11:32:37.589: INFO: Created: latency-svc-hbpm4 Aug 18 11:32:37.632: INFO: Got endpoints: latency-svc-t98s6 [749.730327ms] Aug 18 11:32:37.638: INFO: Created: latency-svc-rqdx2 Aug 18 11:32:37.683: INFO: Got endpoints: latency-svc-722wq [750.636116ms] Aug 18 11:32:37.689: INFO: Created: latency-svc-bbvz9 Aug 18 11:32:37.733: INFO: Got endpoints: latency-svc-q6s9g [749.896044ms] Aug 18 11:32:37.738: INFO: Created: latency-svc-c7tqb Aug 18 11:32:37.782: INFO: Got endpoints: latency-svc-kd6qq [749.35017ms] Aug 18 11:32:37.787: INFO: Created: latency-svc-j666r Aug 18 11:32:37.833: INFO: Got endpoints: latency-svc-n2d88 [749.992871ms] Aug 18 11:32:37.839: INFO: Created: latency-svc-p9nnf Aug 18 11:32:37.882: INFO: Got endpoints: latency-svc-ndc8t [750.162938ms] Aug 18 11:32:37.887: INFO: Created: latency-svc-4f4qf Aug 18 11:32:37.932: INFO: Got endpoints: latency-svc-frggr [750.080697ms] Aug 18 11:32:37.939: INFO: Created: latency-svc-kg79v Aug 18 11:32:37.982: INFO: Got endpoints: latency-svc-rhxsh [749.92691ms] Aug 18 11:32:37.987: INFO: Created: latency-svc-vtz84 Aug 18 11:32:38.032: INFO: Got endpoints: latency-svc-n2bnk [750.271406ms] Aug 18 11:32:38.038: INFO: Created: latency-svc-gkqrj Aug 18 11:32:38.082: INFO: Got endpoints: latency-svc-xxnx9 [749.921547ms] Aug 18 11:32:38.087: INFO: Created: latency-svc-wt2cz Aug 18 11:32:38.132: INFO: Got endpoints: latency-svc-zdk4h [748.890664ms] Aug 18 11:32:38.137: INFO: Created: latency-svc-2gzrf Aug 18 11:32:38.182: INFO: Got endpoints: latency-svc-2cgbs [749.284627ms] Aug 18 11:32:38.190: INFO: Created: latency-svc-lb59f Aug 18 11:32:38.232: INFO: Got endpoints: latency-svc-8fq6x [749.182029ms] Aug 18 11:32:38.237: INFO: Created: latency-svc-6c2vp Aug 18 11:32:38.282: INFO: Got endpoints: latency-svc-4xkhx [749.336362ms] Aug 18 11:32:38.288: INFO: Created: latency-svc-464zx Aug 18 11:32:38.334: INFO: Got endpoints: latency-svc-hbpm4 [751.041833ms] Aug 18 11:32:38.342: INFO: Created: latency-svc-26qzv Aug 18 11:32:38.382: INFO: Got endpoints: latency-svc-rqdx2 [749.972003ms] Aug 18 11:32:38.387: INFO: Created: latency-svc-pb65m Aug 18 11:32:38.432: INFO: Got endpoints: latency-svc-bbvz9 [748.891538ms] Aug 18 11:32:38.437: INFO: Created: latency-svc-nlf8v Aug 18 11:32:38.484: INFO: Got endpoints: latency-svc-c7tqb [751.62339ms] Aug 18 11:32:38.496: INFO: Created: latency-svc-w29dm Aug 18 11:32:38.532: INFO: Got endpoints: latency-svc-j666r [749.760143ms] Aug 18 11:32:38.538: INFO: Created: latency-svc-bnmx7 Aug 18 11:32:38.583: INFO: Got endpoints: latency-svc-p9nnf [749.993957ms] Aug 18 11:32:38.588: INFO: Created: latency-svc-fskkw Aug 18 11:32:38.632: INFO: Got endpoints: latency-svc-4f4qf [750.07022ms] Aug 18 11:32:38.638: INFO: Created: latency-svc-d7k97 Aug 18 11:32:38.682: INFO: Got endpoints: latency-svc-kg79v [749.850867ms] Aug 18 11:32:38.688: INFO: Created: latency-svc-9bnrw Aug 18 11:32:38.732: INFO: Got endpoints: latency-svc-vtz84 [749.134075ms] Aug 18 11:32:38.737: INFO: Created: latency-svc-6dzc6 Aug 18 11:32:38.782: INFO: Got endpoints: latency-svc-gkqrj [749.603635ms] Aug 18 11:32:38.787: INFO: Created: latency-svc-2cprw Aug 18 11:32:38.832: INFO: Got endpoints: latency-svc-wt2cz [750.411312ms] Aug 18 11:32:38.837: INFO: Created: latency-svc-g9w2f Aug 18 11:32:38.882: INFO: Got endpoints: latency-svc-2gzrf [749.961779ms] Aug 18 11:32:38.888: INFO: Created: latency-svc-zpw76 Aug 18 11:32:38.933: INFO: Got endpoints: latency-svc-lb59f [750.621738ms] Aug 18 11:32:38.938: INFO: Created: latency-svc-c9bh5 Aug 18 11:32:38.983: INFO: Got endpoints: latency-svc-6c2vp [750.731698ms] Aug 18 11:32:38.989: INFO: Created: latency-svc-jxnc6 Aug 18 11:32:39.032: INFO: Got endpoints: latency-svc-464zx [750.555278ms] Aug 18 11:32:39.037: INFO: Created: latency-svc-zh8lp Aug 18 11:32:39.082: INFO: Got endpoints: latency-svc-26qzv [748.223449ms] Aug 18 11:32:39.088: INFO: Created: latency-svc-njhkc Aug 18 11:32:39.132: INFO: Got endpoints: latency-svc-pb65m [750.338834ms] Aug 18 11:32:39.139: INFO: Created: latency-svc-6d9dc Aug 18 11:32:39.182: INFO: Got endpoints: latency-svc-nlf8v [750.118437ms] Aug 18 11:32:39.187: INFO: Created: latency-svc-m952t Aug 18 11:32:39.232: INFO: Got endpoints: latency-svc-w29dm [747.670015ms] Aug 18 11:32:39.238: INFO: Created: latency-svc-dh4wc Aug 18 11:32:39.282: INFO: Got endpoints: latency-svc-bnmx7 [749.910534ms] Aug 18 11:32:39.288: INFO: Created: latency-svc-b5l5w Aug 18 11:32:39.332: INFO: Got endpoints: latency-svc-fskkw [748.845609ms] Aug 18 11:32:39.337: INFO: Created: latency-svc-tmgcz Aug 18 11:32:39.382: INFO: Got endpoints: latency-svc-d7k97 [749.572455ms] Aug 18 11:32:39.387: INFO: Created: latency-svc-dpchh Aug 18 11:32:39.434: INFO: Got endpoints: latency-svc-9bnrw [752.128177ms] Aug 18 11:32:39.441: INFO: Created: latency-svc-rl4nn Aug 18 11:32:39.482: INFO: Got endpoints: latency-svc-6dzc6 [750.646533ms] Aug 18 11:32:39.487: INFO: Created: latency-svc-2bc7l Aug 18 11:32:39.532: INFO: Got endpoints: latency-svc-2cprw [750.088923ms] Aug 18 11:32:39.538: INFO: Created: latency-svc-qwtgq Aug 18 11:32:39.582: INFO: Got endpoints: latency-svc-g9w2f [749.731356ms] Aug 18 11:32:39.588: INFO: Created: latency-svc-cfctt Aug 18 11:32:39.632: INFO: Got endpoints: latency-svc-zpw76 [749.746875ms] Aug 18 11:32:39.682: INFO: Got endpoints: latency-svc-c9bh5 [749.787016ms] Aug 18 11:32:39.732: INFO: Got endpoints: latency-svc-jxnc6 [749.212242ms] Aug 18 11:32:39.782: INFO: Got endpoints: latency-svc-zh8lp [749.452334ms] Aug 18 11:32:39.832: INFO: Got endpoints: latency-svc-njhkc [750.007398ms] Aug 18 11:32:39.883: INFO: Got endpoints: latency-svc-6d9dc [750.427943ms] Aug 18 11:32:39.932: INFO: Got endpoints: latency-svc-m952t [750.257687ms] Aug 18 11:32:39.983: INFO: Got endpoints: latency-svc-dh4wc [751.002416ms] Aug 18 11:32:40.032: INFO: Got endpoints: latency-svc-b5l5w [750.14205ms] Aug 18 11:32:40.082: INFO: Got endpoints: latency-svc-tmgcz [750.346055ms] Aug 18 11:32:40.132: INFO: Got endpoints: latency-svc-dpchh [749.96899ms] Aug 18 11:32:40.181: INFO: Got endpoints: latency-svc-rl4nn [747.199619ms] Aug 18 11:32:40.233: INFO: Got endpoints: latency-svc-2bc7l [750.516379ms] Aug 18 11:32:40.282: INFO: Got endpoints: latency-svc-qwtgq [749.952085ms] Aug 18 11:32:40.332: INFO: Got endpoints: latency-svc-cfctt [750.024493ms] Aug 18 11:32:40.332: INFO: Latencies: [7.434017ms 10.192121ms 13.137714ms 15.989182ms 19.318505ms 22.538097ms 23.623225ms 26.424962ms 29.005502ms 31.608357ms 34.008503ms 36.868145ms 38.616545ms 39.371741ms 39.436701ms 39.795177ms 39.810382ms 39.828408ms 39.942722ms 40.057788ms 40.372923ms 40.434461ms 40.587427ms 40.60962ms 40.663459ms 40.80226ms 40.987597ms 41.281161ms 42.205061ms 45.026343ms 49.574823ms 97.413398ms 143.83759ms 191.816706ms 238.263573ms 286.511702ms 333.88288ms 380.035036ms 427.160541ms 475.885589ms 522.969375ms 569.360574ms 618.40443ms 665.770836ms 713.676235ms 747.199619ms 747.670015ms 747.688157ms 747.778787ms 748.167003ms 748.223449ms 748.845609ms 748.85748ms 748.864614ms 748.873478ms 748.890664ms 748.891538ms 748.995691ms 749.104075ms 749.134075ms 749.178924ms 749.182029ms 749.197542ms 749.212242ms 749.2415ms 749.259417ms 749.260612ms 749.283923ms 749.284627ms 749.336362ms 749.337439ms 749.337719ms 749.35017ms 749.413323ms 749.424529ms 749.435974ms 749.443447ms 749.446328ms 749.452334ms 749.476732ms 749.511546ms 749.528393ms 749.549179ms 749.572455ms 749.588805ms 749.603635ms 749.611402ms 749.625406ms 749.636838ms 749.646399ms 749.683383ms 749.722414ms 749.730327ms 749.731356ms 749.73486ms 749.746309ms 749.746875ms 749.759693ms 749.760143ms 749.787016ms 749.802333ms 749.822117ms 749.833761ms 749.845765ms 749.849904ms 749.850867ms 749.854456ms 749.86047ms 749.867349ms 749.87082ms 749.881664ms 749.889173ms 749.896044ms 749.910534ms 749.913395ms 749.921547ms 749.92691ms 749.952085ms 749.961779ms 749.964521ms 749.96899ms 749.972003ms 749.989716ms 749.992871ms 749.993957ms 749.999744ms 750.007398ms 750.024493ms 750.042026ms 750.045434ms 750.048242ms 750.057158ms 750.062908ms 750.07022ms 750.072048ms 750.078446ms 750.080697ms 750.081287ms 750.088923ms 750.090349ms 750.118437ms 750.14205ms 750.145019ms 750.149865ms 750.162938ms 750.185875ms 750.193321ms 750.221521ms 750.239866ms 750.241806ms 750.257687ms 750.262152ms 750.271406ms 750.27771ms 750.285591ms 750.301089ms 750.309647ms 750.337158ms 750.338834ms 750.346055ms 750.351001ms 750.375308ms 750.380123ms 750.395381ms 750.411312ms 750.427943ms 750.444505ms 750.453703ms 750.469493ms 750.483519ms 750.484227ms 750.485922ms 750.510767ms 750.516379ms 750.549116ms 750.550249ms 750.555278ms 750.590776ms 750.610743ms 750.621738ms 750.632325ms 750.636116ms 750.646533ms 750.690353ms 750.716726ms 750.731698ms 750.754493ms 750.75568ms 750.775173ms 750.790099ms 751.002416ms 751.041833ms 751.090641ms 751.101792ms 751.134305ms 751.170389ms 751.62339ms 752.008152ms 752.128177ms 752.399982ms] Aug 18 11:32:40.332: INFO: 50 %ile: 749.802333ms Aug 18 11:32:40.332: INFO: 90 %ile: 750.632325ms Aug 18 11:32:40.332: INFO: 99 %ile: 752.128177ms Aug 18 11:32:40.332: INFO: Total sample count: 200 [AfterEach] [sig-network] Service endpoints latency /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:32:40.333: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "svc-latency-7461" for this suite. • [SLOW TEST:11.770 seconds] [sig-network] Service endpoints latency /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/framework.go:23 should not be very high [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-network] Service endpoints latency should not be very high [Conformance]","total":-1,"completed":10,"skipped":92,"failed":1,"failures":["[sig-node] Downward API should provide host IP as an env var [NodeConformance] [Conformance]"]} SSSSSSSS ------------------------------ {"msg":"PASSED [sig-api-machinery] Events should ensure that an event can be fetched, patched, deleted, and listed [Conformance]","total":-1,"completed":18,"skipped":412,"failed":1,"failures":["[k8s.io] Pods should be submitted and removed [NodeConformance] [Conformance]"]} [BeforeEach] [sig-api-machinery] ResourceQuota /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:32:29.741: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename resourcequota STEP: Waiting for a default service account to be provisioned in namespace [It] should create a ResourceQuota and capture the life of a replication controller. [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Counting existing ResourceQuota STEP: Creating a ResourceQuota STEP: Ensuring resource quota status is calculated STEP: Creating a ReplicationController STEP: Ensuring resource quota status captures replication controller creation STEP: Deleting a ReplicationController STEP: Ensuring resource quota status released usage [AfterEach] [sig-api-machinery] ResourceQuota /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:32:40.786: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "resourcequota-5802" for this suite. • [SLOW TEST:11.055 seconds] [sig-api-machinery] ResourceQuota /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23 should create a ResourceQuota and capture the life of a replication controller. [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-api-machinery] ResourceQuota should create a ResourceQuota and capture the life of a replication controller. [Conformance]","total":-1,"completed":19,"skipped":412,"failed":1,"failures":["[k8s.io] Pods should be submitted and removed [NodeConformance] [Conformance]"]} SSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-api-machinery] Secrets /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:32:40.866: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename secrets STEP: Waiting for a default service account to be provisioned in namespace [It] should fail to create secret due to empty secret key [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating projection with secret that has name secret-emptykey-test-0deafa5a-a236-4af6-8488-a07de82e8def [AfterEach] [sig-api-machinery] Secrets /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:32:40.887: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "secrets-1815" for this suite. • ------------------------------ {"msg":"PASSED [sig-api-machinery] Secrets should fail to create secret due to empty secret key [Conformance]","total":-1,"completed":20,"skipped":441,"failed":1,"failures":["[k8s.io] Pods should be submitted and removed [NodeConformance] [Conformance]"]} SSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:32:40.947: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename services STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:782 [It] should find a service from listing all namespaces [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: fetching services [AfterEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:32:40.974: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "services-5248" for this suite. [AfterEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:786 • ------------------------------ {"msg":"PASSED [sig-network] Services should find a service from listing all namespaces [Conformance]","total":-1,"completed":21,"skipped":466,"failed":1,"failures":["[k8s.io] Pods should be submitted and removed [NodeConformance] [Conformance]"]} SSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-network] DNS /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:32:39.533: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename dns STEP: Waiting for a default service account to be provisioned in namespace [It] should provide DNS for the cluster [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Running these commands on wheezy: for i in `seq 1 600`; do check="$$(dig +notcp +noall +answer +search kubernetes.default.svc.cluster.local A)" && test -n "$$check" && echo OK > /results/wheezy_udp@kubernetes.default.svc.cluster.local;check="$$(dig +tcp +noall +answer +search kubernetes.default.svc.cluster.local A)" && test -n "$$check" && echo OK > /results/wheezy_tcp@kubernetes.default.svc.cluster.local;podARec=$$(hostname -i| awk -F. '{print $$1"-"$$2"-"$$3"-"$$4".dns-3931.pod.cluster.local"}');check="$$(dig +notcp +noall +answer +search $${podARec} A)" && test -n "$$check" && echo OK > /results/wheezy_udp@PodARecord;check="$$(dig +tcp +noall +answer +search $${podARec} A)" && test -n "$$check" && echo OK > /results/wheezy_tcp@PodARecord;sleep 1; done STEP: Running these commands on jessie: for i in `seq 1 600`; do check="$$(dig +notcp +noall +answer +search kubernetes.default.svc.cluster.local A)" && test -n "$$check" && echo OK > /results/jessie_udp@kubernetes.default.svc.cluster.local;check="$$(dig +tcp +noall +answer +search kubernetes.default.svc.cluster.local A)" && test -n "$$check" && echo OK > /results/jessie_tcp@kubernetes.default.svc.cluster.local;podARec=$$(hostname -i| awk -F. '{print $$1"-"$$2"-"$$3"-"$$4".dns-3931.pod.cluster.local"}');check="$$(dig +notcp +noall +answer +search $${podARec} A)" && test -n "$$check" && echo OK > /results/jessie_udp@PodARecord;check="$$(dig +tcp +noall +answer +search $${podARec} A)" && test -n "$$check" && echo OK > /results/jessie_tcp@PodARecord;sleep 1; done STEP: creating a pod to probe DNS STEP: submitting the pod to kubernetes STEP: retrieving the pod STEP: looking for the results for each expected name from probers Aug 18 11:32:47.593: INFO: DNS probes using dns-3931/dns-test-ff4d475f-a8ae-42c7-bb41-8c6570acd2e6 succeeded STEP: deleting the pod [AfterEach] [sig-network] DNS /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:32:47.601: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "dns-3931" for this suite. • [SLOW TEST:8.076 seconds] [sig-network] DNS /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/framework.go:23 should provide DNS for the cluster [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-network] DNS should provide DNS for the cluster [Conformance]","total":-1,"completed":5,"skipped":135,"failed":1,"failures":["[k8s.io] Variable Expansion should allow substituting values in a volume subpath [sig-storage] [Conformance]"]} SSSSSSSSSSSS ------------------------------ [BeforeEach] [k8s.io] Variable Expansion /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:28:58.523: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename var-expansion STEP: Waiting for a default service account to be provisioned in namespace [It] should verify that a failing subpath expansion can be modified during the lifecycle of a container [sig-storage][Slow] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: creating the pod with failed condition STEP: updating the pod Aug 18 11:30:59.077: INFO: Successfully updated pod "var-expansion-cf1f3322-29ba-472a-9702-20756a20f986" STEP: waiting for pod running Aug 18 11:32:59.085: FAIL: while waiting for pod to be running Unexpected error: <*errors.errorString | 0xc0003001f0>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/common.glob..func9.7() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/expansion.go:270 +0x5d1 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc001a9de00) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc001a9de00) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc001a9de00, 0x4deb2c0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] Variable Expansion /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "var-expansion-7070". STEP: Found 7 events. Aug 18 11:32:59.089: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for var-expansion-cf1f3322-29ba-472a-9702-20756a20f986: { } Scheduled: Successfully assigned var-expansion-7070/var-expansion-cf1f3322-29ba-472a-9702-20756a20f986 to node2 Aug 18 11:32:59.089: INFO: At 2021-08-18 11:29:01 +0000 UTC - event for var-expansion-cf1f3322-29ba-472a-9702-20756a20f986: {multus } AddedInterface: Add eth0 [10.244.3.246/24] Aug 18 11:32:59.089: INFO: At 2021-08-18 11:29:01 +0000 UTC - event for var-expansion-cf1f3322-29ba-472a-9702-20756a20f986: {kubelet node2} Pulling: Pulling image "docker.io/library/busybox:1.29" Aug 18 11:32:59.089: INFO: At 2021-08-18 11:29:02 +0000 UTC - event for var-expansion-cf1f3322-29ba-472a-9702-20756a20f986: {kubelet node2} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit Aug 18 11:32:59.089: INFO: At 2021-08-18 11:29:02 +0000 UTC - event for var-expansion-cf1f3322-29ba-472a-9702-20756a20f986: {kubelet node2} Failed: Error: ErrImagePull Aug 18 11:32:59.089: INFO: At 2021-08-18 11:29:03 +0000 UTC - event for var-expansion-cf1f3322-29ba-472a-9702-20756a20f986: {kubelet node2} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" Aug 18 11:32:59.089: INFO: At 2021-08-18 11:29:03 +0000 UTC - event for var-expansion-cf1f3322-29ba-472a-9702-20756a20f986: {kubelet node2} Failed: Error: ImagePullBackOff Aug 18 11:32:59.092: INFO: POD NODE PHASE GRACE CONDITIONS Aug 18 11:32:59.092: INFO: var-expansion-cf1f3322-29ba-472a-9702-20756a20f986 node2 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:28:58 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:28:58 +0000 UTC ContainersNotReady containers with unready status: [dapi-container]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:28:58 +0000 UTC ContainersNotReady containers with unready status: [dapi-container]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:28:58 +0000 UTC }] Aug 18 11:32:59.092: INFO: Aug 18 11:32:59.096: INFO: Logging node info for node master1 Aug 18 11:32:59.098: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 ebb211fa-503f-4cfe-b1ed-c95d27a70e6e 62587 0 2021-08-18 08:20:52 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"3a:82:be:72:b5:15"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:20:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:20:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:25:59 +0000 UTC,LastTransitionTime:2021-08-18 08:25:59 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:53 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:53 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:53 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:32:53 +0000 UTC,LastTransitionTime:2021-08-18 08:25:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:58c3e57359b641ad92fa1959f2fecf5d,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:012cd796-2076-45d6-8b14-d3e0451b1e64,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[@ :],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:32:59.099: INFO: Logging kubelet events for node master1 Aug 18 11:32:59.102: INFO: Logging pods the kubelet thinks is on node master1 Aug 18 11:32:59.122: INFO: kube-multus-ds-amd64-kbcp6 started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:59.122: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:32:59.122: INFO: docker-registry-docker-registry-56cbc7bc58-49kl2 started at 2021-08-18 08:26:23 +0000 UTC (0+2 container statuses recorded) Aug 18 11:32:59.122: INFO: Container docker-registry ready: true, restart count 0 Aug 18 11:32:59.122: INFO: Container nginx ready: true, restart count 0 Aug 18 11:32:59.122: INFO: node-exporter-5hwz9 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:32:59.122: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:32:59.122: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:32:59.122: INFO: kube-controller-manager-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:59.122: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:32:59.122: INFO: kube-proxy-vqk4v started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:59.122: INFO: Container kube-proxy ready: true, restart count 1 Aug 18 11:32:59.122: INFO: kube-flannel-q64cq started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:32:59.122: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:32:59.122: INFO: Container kube-flannel ready: true, restart count 3 Aug 18 11:32:59.122: INFO: coredns-7677f9bb54-kn2qg started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:59.122: INFO: Container coredns ready: true, restart count 2 Aug 18 11:32:59.122: INFO: kube-scheduler-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:59.122: INFO: Container kube-scheduler ready: true, restart count 0 Aug 18 11:32:59.122: INFO: kube-apiserver-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:59.122: INFO: Container kube-apiserver ready: true, restart count 0 W0818 11:32:59.135967 34 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:32:59.169: INFO: Latency metrics for node master1 Aug 18 11:32:59.169: INFO: Logging node info for node master2 Aug 18 11:32:59.172: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 78946293-3abe-4442-84d4-8ed6b1d15ce0 62563 0 2021-08-18 08:21:31 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"7e:f5:c2:cc:3a:b4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:21:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:21:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-08-18 08:29:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:52 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:52 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:52 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:32:52 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0c44122c7a7248c18d8571e1cc667258,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:0cd329f2-48e0-4c8f-b8b9-fa3ae0ed8406,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:32:59.172: INFO: Logging kubelet events for node master2 Aug 18 11:32:59.174: INFO: Logging pods the kubelet thinks is on node master2 Aug 18 11:32:59.182: INFO: kube-flannel-pp56h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:32:59.182: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:32:59.182: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:32:59.182: INFO: kube-controller-manager-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:59.182: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:32:59.182: INFO: kube-proxy-kh2l9 started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:59.182: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:32:59.182: INFO: kube-multus-ds-amd64-mld8g started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:59.182: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:32:59.182: INFO: dns-autoscaler-5b7b5c9b6f-hh47r started at 2021-08-18 08:23:57 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:59.182: INFO: Container autoscaler ready: true, restart count 2 Aug 18 11:32:59.182: INFO: node-feature-discovery-controller-5bf5c49849-mq57c started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:59.182: INFO: Container nfd-controller ready: true, restart count 0 Aug 18 11:32:59.182: INFO: node-exporter-48nfx started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:32:59.182: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:32:59.182: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:32:59.182: INFO: kube-apiserver-master2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:59.182: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:32:59.182: INFO: kube-scheduler-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:59.182: INFO: Container kube-scheduler ready: true, restart count 2 W0818 11:32:59.193856 34 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:32:59.221: INFO: Latency metrics for node master2 Aug 18 11:32:59.221: INFO: Logging node info for node master3 Aug 18 11:32:59.224: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 44feac2b-9447-4be2-9fcd-62f836d67c72 62600 0 2021-08-18 08:21:41 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"86:e4:31:99:58:40"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {kubelet Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:57 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:57 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:57 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:32:57 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1fae19ae59884c44899bcd08aa243244,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:5db926c5-6530-4635-a0d5-806974a3b732,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:32:59.224: INFO: Logging kubelet events for node master3 Aug 18 11:32:59.227: INFO: Logging pods the kubelet thinks is on node master3 Aug 18 11:32:59.235: INFO: kube-flannel-x6tlr started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:32:59.235: INFO: Init container install-cni ready: true, restart count 1 Aug 18 11:32:59.235: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:32:59.235: INFO: kube-multus-ds-amd64-bkw6c started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:59.235: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:32:59.235: INFO: coredns-7677f9bb54-5hxfh started at 2021-08-18 08:23:54 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:59.235: INFO: Container coredns ready: true, restart count 1 Aug 18 11:32:59.235: INFO: node-exporter-vq7d8 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:32:59.235: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:32:59.235: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:32:59.235: INFO: kube-controller-manager-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:59.235: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:32:59.235: INFO: kube-scheduler-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:59.235: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:32:59.235: INFO: kube-apiserver-master3 started at 2021-08-18 08:29:12 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:59.235: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:32:59.235: INFO: kube-proxy-sd5lc started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:59.235: INFO: Container kube-proxy ready: true, restart count 2 W0818 11:32:59.249124 34 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:32:59.279: INFO: Latency metrics for node master3 Aug 18 11:32:59.279: INFO: Logging node info for node node1 Aug 18 11:32:59.282: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 84defabd-6ebf-43ec-a629-44c6713da9c9 62537 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"9a:87:55:36:7b:df"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:13 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:35 +0000 UTC,LastTransitionTime:2021-08-18 08:26:35 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:50 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:50 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:50 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:32:50 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:69946ff2b7bc462fa25eb7adb4703c23,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:736dc52f-f5e3-494e-86ca-01eedbea015c,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:a7cea43d9d2f67c38fbf0407786edbe660ee9072945f7bb272b55fd255e8eaca opnfv/barometer-collectd:stable],SizeBytes:1075746799,},ContainerImage{Names:[@ :],SizeBytes:1003788820,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[aquasec/kube-hunter@sha256:2be6820bc1d7e0f57193a9a27d5a3e16b2fd93c53747b03ce8ca48c6fc323781 aquasec/kube-hunter:0.3.1],SizeBytes:347611549,},ContainerImage{Names:[golang@sha256:db2475a1dbb2149508e5db31d7d77a75e6600d54be645f37681f03f2762169ba golang:alpine3.12],SizeBytes:301186719,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:de25c7fc6c4f3a27c7f0c2dff454e4671823a34d88abd533f210848d527e0fbb alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:32:59.283: INFO: Logging kubelet events for node node1 Aug 18 11:32:59.286: INFO: Logging pods the kubelet thinks is on node node1 Aug 18 11:32:59.301: INFO: nginx-proxy-node1 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:59.301: INFO: Container nginx-proxy ready: true, restart count 2 Aug 18 11:32:59.301: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-vsxvg started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:59.301: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:32:59.301: INFO: pod-subpath-test-downwardapi-b5dd started at 2021-08-18 11:32:41 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:59.301: INFO: Container test-container-subpath-downwardapi-b5dd ready: true, restart count 0 Aug 18 11:32:59.301: INFO: kube-flannel-q78nd started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:32:59.301: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:32:59.301: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:32:59.301: INFO: prometheus-k8s-0 started at 2021-08-18 08:34:03 +0000 UTC (0+5 container statuses recorded) Aug 18 11:32:59.301: INFO: Container custom-metrics-apiserver ready: true, restart count 0 Aug 18 11:32:59.301: INFO: Container grafana ready: true, restart count 0 Aug 18 11:32:59.301: INFO: Container prometheus ready: true, restart count 1 Aug 18 11:32:59.301: INFO: Container prometheus-config-reloader ready: true, restart count 0 Aug 18 11:32:59.301: INFO: Container rules-configmap-reloader ready: true, restart count 0 Aug 18 11:32:59.301: INFO: test-rolling-update-controller-wx48f started at 2021-08-18 11:29:47 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:59.301: INFO: Container httpd ready: false, restart count 0 Aug 18 11:32:59.301: INFO: ss2-1 started at 2021-08-18 11:26:31 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:59.301: INFO: Container webserver ready: true, restart count 0 Aug 18 11:32:59.301: INFO: kube-multus-ds-amd64-rrvmb started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:59.301: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:32:59.301: INFO: node-feature-discovery-worker-pflgw started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:59.301: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:32:59.301: INFO: node-exporter-kcwvn started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:32:59.301: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:32:59.301: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:32:59.301: INFO: ss2-0 started at 2021-08-18 11:32:47 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:59.301: INFO: Container webserver ready: false, restart count 0 Aug 18 11:32:59.301: INFO: pod-logs-websocket-d8642f34-1a3a-44bb-86fd-c0e2f884df31 started at 2021-08-18 11:32:11 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:59.301: INFO: Container main ready: false, restart count 0 Aug 18 11:32:59.301: INFO: affinity-nodeport-transition-w7b49 started at 2021-08-18 11:32:19 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:59.301: INFO: Container affinity-nodeport-transition ready: true, restart count 0 Aug 18 11:32:59.301: INFO: dns-test-862a8b9c-cbcc-47b0-abfc-5f2911bd0391 started at 2021-08-18 11:32:40 +0000 UTC (0+3 container statuses recorded) Aug 18 11:32:59.301: INFO: Container jessie-querier ready: true, restart count 0 Aug 18 11:32:59.301: INFO: Container querier ready: true, restart count 0 Aug 18 11:32:59.301: INFO: Container webserver ready: true, restart count 0 Aug 18 11:32:59.301: INFO: kube-proxy-p6jvp started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:59.301: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:32:59.301: INFO: kubernetes-metrics-scraper-678c97765c-9nsv5 started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:59.301: INFO: Container kubernetes-metrics-scraper ready: true, restart count 2 Aug 18 11:32:59.301: INFO: cmk-init-discover-node1-bxznx started at 2021-08-18 08:32:10 +0000 UTC (0+3 container statuses recorded) Aug 18 11:32:59.301: INFO: Container discover ready: false, restart count 0 Aug 18 11:32:59.301: INFO: Container init ready: false, restart count 0 Aug 18 11:32:59.301: INFO: Container install ready: false, restart count 0 Aug 18 11:32:59.301: INFO: cmk-d8r27 started at 2021-08-18 08:32:52 +0000 UTC (0+2 container statuses recorded) Aug 18 11:32:59.301: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:32:59.301: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:32:59.301: INFO: collectd-xdprr started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:32:59.301: INFO: Container collectd ready: true, restart count 0 Aug 18 11:32:59.301: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:32:59.301: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:32:59.301: INFO: affinity-nodeport-transition-7hhl7 started at 2021-08-18 11:32:19 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:59.302: INFO: Container affinity-nodeport-transition ready: true, restart count 0 Aug 18 11:32:59.302: INFO: ss2-0 started at 2021-08-18 11:26:45 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:59.302: INFO: Container webserver ready: true, restart count 0 W0818 11:32:59.314693 34 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:32:59.345: INFO: Latency metrics for node node1 Aug 18 11:32:59.345: INFO: Logging node info for node node2 Aug 18 11:32:59.349: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 1d01177e-3dbb-48a1-a0bc-d18af27ab7f8 62551 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:d1:47:f8:1d:22"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:36 +0000 UTC,LastTransitionTime:2021-08-18 08:26:36 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:51 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:51 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:32:51 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:32:51 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:dc1f286135c145349b8a016880b65a2f,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:037e7e2d-94e9-42f4-a719-896e5005ac70,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:32:59.350: INFO: Logging kubelet events for node node2 Aug 18 11:32:59.353: INFO: Logging pods the kubelet thinks is on node node2 Aug 18 11:32:59.368: INFO: cmk-748rz started at 2021-08-18 08:32:53 +0000 UTC (0+2 container statuses recorded) Aug 18 11:32:59.368: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:32:59.368: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:32:59.368: INFO: kube-proxy-qkj9c started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:59.368: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:32:59.368: INFO: node-feature-discovery-worker-hzpf5 started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:59.368: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:32:59.368: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-c82pt started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:59.368: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:32:59.368: INFO: prometheus-operator-5bb8cb9d8f-k97ws started at 2021-08-18 08:33:38 +0000 UTC (0+2 container statuses recorded) Aug 18 11:32:59.368: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:32:59.368: INFO: Container prometheus-operator ready: true, restart count 0 Aug 18 11:32:59.368: INFO: affinity-nodeport-transition-v84k6 started at 2021-08-18 11:32:19 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:59.368: INFO: Container affinity-nodeport-transition ready: true, restart count 0 Aug 18 11:32:59.368: INFO: pod-projected-secrets-93c08515-9404-4dc9-b2a7-9550af968e24 started at 2021-08-18 11:32:38 +0000 UTC (0+3 container statuses recorded) Aug 18 11:32:59.368: INFO: Container creates-volume-test ready: true, restart count 0 Aug 18 11:32:59.368: INFO: Container dels-volume-test ready: true, restart count 0 Aug 18 11:32:59.368: INFO: Container upds-volume-test ready: true, restart count 0 Aug 18 11:32:59.368: INFO: kube-multus-ds-amd64-rvzsg started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:59.368: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:32:59.368: INFO: collectd-67ntq started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:32:59.368: INFO: Container collectd ready: true, restart count 0 Aug 18 11:32:59.368: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:32:59.368: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:32:59.368: INFO: downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a started at 2021-08-18 11:31:01 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:59.368: INFO: Container dapi-container ready: false, restart count 0 Aug 18 11:32:59.368: INFO: var-expansion-cf1f3322-29ba-472a-9702-20756a20f986 started at 2021-08-18 11:28:58 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:59.368: INFO: Container dapi-container ready: false, restart count 0 Aug 18 11:32:59.368: INFO: cmk-webhook-6c9d5f8578-7cxjr started at 2021-08-18 08:32:53 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:59.368: INFO: Container cmk-webhook ready: true, restart count 0 Aug 18 11:32:59.368: INFO: kube-flannel-h7t5h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:32:59.368: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:32:59.368: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:32:59.368: INFO: node-exporter-lrrf2 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:32:59.368: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:32:59.368: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:32:59.368: INFO: execpod-affinityrr59g started at 2021-08-18 11:32:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:59.368: INFO: Container agnhost-container ready: true, restart count 0 Aug 18 11:32:59.368: INFO: nginx-proxy-node2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:59.368: INFO: Container nginx-proxy ready: true, restart count 1 Aug 18 11:32:59.368: INFO: cmk-init-discover-node2-6b2kz started at 2021-08-18 08:32:30 +0000 UTC (0+3 container statuses recorded) Aug 18 11:32:59.368: INFO: Container discover ready: false, restart count 0 Aug 18 11:32:59.368: INFO: Container init ready: false, restart count 0 Aug 18 11:32:59.368: INFO: Container install ready: false, restart count 0 Aug 18 11:32:59.368: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-7rn45 started at 2021-08-18 08:36:42 +0000 UTC (0+2 container statuses recorded) Aug 18 11:32:59.368: INFO: Container tas-controller ready: true, restart count 0 Aug 18 11:32:59.368: INFO: Container tas-extender ready: true, restart count 0 Aug 18 11:32:59.368: INFO: ss2-2 started at 2021-08-18 11:27:31 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:59.368: INFO: Container webserver ready: false, restart count 0 Aug 18 11:32:59.368: INFO: kubernetes-dashboard-86c6f9df5b-qrtdk started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:32:59.368: INFO: Container kubernetes-dashboard ready: true, restart count 2 W0818 11:32:59.378822 34 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:32:59.408: INFO: Latency metrics for node node2 Aug 18 11:32:59.408: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "var-expansion-7070" for this suite. • Failure [240.895 seconds] [k8s.io] Variable Expansion /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 should verify that a failing subpath expansion can be modified during the lifecycle of a container [sig-storage][Slow] [Conformance] [It] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:32:59.085: while waiting for pod to be running Unexpected error: <*errors.errorString | 0xc0003001f0>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/expansion.go:270 ------------------------------ {"msg":"FAILED [k8s.io] Variable Expansion should verify that a failing subpath expansion can be modified during the lifecycle of a container [sig-storage][Slow] [Conformance]","total":-1,"completed":8,"skipped":52,"failed":1,"failures":["[k8s.io] Variable Expansion should verify that a failing subpath expansion can be modified during the lifecycle of a container [sig-storage][Slow] [Conformance]"]} SSSSSSSS ------------------------------ [BeforeEach] [sig-network] DNS /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:32:40.366: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename dns STEP: Waiting for a default service account to be provisioned in namespace [It] should resolve DNS of partial qualified names for services [LinuxOnly] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating a test headless service STEP: Running these commands on wheezy: for i in `seq 1 600`; do check="$$(dig +notcp +noall +answer +search dns-test-service A)" && test -n "$$check" && echo OK > /results/wheezy_udp@dns-test-service;check="$$(dig +tcp +noall +answer +search dns-test-service A)" && test -n "$$check" && echo OK > /results/wheezy_tcp@dns-test-service;check="$$(dig +notcp +noall +answer +search dns-test-service.dns-11 A)" && test -n "$$check" && echo OK > /results/wheezy_udp@dns-test-service.dns-11;check="$$(dig +tcp +noall +answer +search dns-test-service.dns-11 A)" && test -n "$$check" && echo OK > /results/wheezy_tcp@dns-test-service.dns-11;check="$$(dig +notcp +noall +answer +search dns-test-service.dns-11.svc A)" && test -n "$$check" && echo OK > /results/wheezy_udp@dns-test-service.dns-11.svc;check="$$(dig +tcp +noall +answer +search dns-test-service.dns-11.svc A)" && test -n "$$check" && echo OK > /results/wheezy_tcp@dns-test-service.dns-11.svc;check="$$(dig +notcp +noall +answer +search _http._tcp.dns-test-service.dns-11.svc SRV)" && test -n "$$check" && echo OK > /results/wheezy_udp@_http._tcp.dns-test-service.dns-11.svc;check="$$(dig +tcp +noall +answer +search _http._tcp.dns-test-service.dns-11.svc SRV)" && test -n "$$check" && echo OK > /results/wheezy_tcp@_http._tcp.dns-test-service.dns-11.svc;check="$$(dig +notcp +noall +answer +search _http._tcp.test-service-2.dns-11.svc SRV)" && test -n "$$check" && echo OK > /results/wheezy_udp@_http._tcp.test-service-2.dns-11.svc;check="$$(dig +tcp +noall +answer +search _http._tcp.test-service-2.dns-11.svc SRV)" && test -n "$$check" && echo OK > /results/wheezy_tcp@_http._tcp.test-service-2.dns-11.svc;podARec=$$(hostname -i| awk -F. '{print $$1"-"$$2"-"$$3"-"$$4".dns-11.pod.cluster.local"}');check="$$(dig +notcp +noall +answer +search $${podARec} A)" && test -n "$$check" && echo OK > /results/wheezy_udp@PodARecord;check="$$(dig +tcp +noall +answer +search $${podARec} A)" && test -n "$$check" && echo OK > /results/wheezy_tcp@PodARecord;check="$$(dig +notcp +noall +answer +search 107.25.233.10.in-addr.arpa. PTR)" && test -n "$$check" && echo OK > /results/10.233.25.107_udp@PTR;check="$$(dig +tcp +noall +answer +search 107.25.233.10.in-addr.arpa. PTR)" && test -n "$$check" && echo OK > /results/10.233.25.107_tcp@PTR;sleep 1; done STEP: Running these commands on jessie: for i in `seq 1 600`; do check="$$(dig +notcp +noall +answer +search dns-test-service A)" && test -n "$$check" && echo OK > /results/jessie_udp@dns-test-service;check="$$(dig +tcp +noall +answer +search dns-test-service A)" && test -n "$$check" && echo OK > /results/jessie_tcp@dns-test-service;check="$$(dig +notcp +noall +answer +search dns-test-service.dns-11 A)" && test -n "$$check" && echo OK > /results/jessie_udp@dns-test-service.dns-11;check="$$(dig +tcp +noall +answer +search dns-test-service.dns-11 A)" && test -n "$$check" && echo OK > /results/jessie_tcp@dns-test-service.dns-11;check="$$(dig +notcp +noall +answer +search dns-test-service.dns-11.svc A)" && test -n "$$check" && echo OK > /results/jessie_udp@dns-test-service.dns-11.svc;check="$$(dig +tcp +noall +answer +search dns-test-service.dns-11.svc A)" && test -n "$$check" && echo OK > /results/jessie_tcp@dns-test-service.dns-11.svc;check="$$(dig +notcp +noall +answer +search _http._tcp.dns-test-service.dns-11.svc SRV)" && test -n "$$check" && echo OK > /results/jessie_udp@_http._tcp.dns-test-service.dns-11.svc;check="$$(dig +tcp +noall +answer +search _http._tcp.dns-test-service.dns-11.svc SRV)" && test -n "$$check" && echo OK > /results/jessie_tcp@_http._tcp.dns-test-service.dns-11.svc;check="$$(dig +notcp +noall +answer +search _http._tcp.test-service-2.dns-11.svc SRV)" && test -n "$$check" && echo OK > /results/jessie_udp@_http._tcp.test-service-2.dns-11.svc;check="$$(dig +tcp +noall +answer +search _http._tcp.test-service-2.dns-11.svc SRV)" && test -n "$$check" && echo OK > /results/jessie_tcp@_http._tcp.test-service-2.dns-11.svc;podARec=$$(hostname -i| awk -F. '{print $$1"-"$$2"-"$$3"-"$$4".dns-11.pod.cluster.local"}');check="$$(dig +notcp +noall +answer +search $${podARec} A)" && test -n "$$check" && echo OK > /results/jessie_udp@PodARecord;check="$$(dig +tcp +noall +answer +search $${podARec} A)" && test -n "$$check" && echo OK > /results/jessie_tcp@PodARecord;check="$$(dig +notcp +noall +answer +search 107.25.233.10.in-addr.arpa. PTR)" && test -n "$$check" && echo OK > /results/10.233.25.107_udp@PTR;check="$$(dig +tcp +noall +answer +search 107.25.233.10.in-addr.arpa. PTR)" && test -n "$$check" && echo OK > /results/10.233.25.107_tcp@PTR;sleep 1; done STEP: creating a pod to probe DNS STEP: submitting the pod to kubernetes STEP: retrieving the pod STEP: looking for the results for each expected name from probers Aug 18 11:32:52.424: INFO: Unable to read wheezy_udp@dns-test-service from pod dns-11/dns-test-862a8b9c-cbcc-47b0-abfc-5f2911bd0391: the server could not find the requested resource (get pods dns-test-862a8b9c-cbcc-47b0-abfc-5f2911bd0391) Aug 18 11:32:52.429: INFO: Unable to read wheezy_tcp@dns-test-service from pod dns-11/dns-test-862a8b9c-cbcc-47b0-abfc-5f2911bd0391: the server could not find the requested resource (get pods dns-test-862a8b9c-cbcc-47b0-abfc-5f2911bd0391) Aug 18 11:32:52.431: INFO: Unable to read wheezy_udp@dns-test-service.dns-11 from pod dns-11/dns-test-862a8b9c-cbcc-47b0-abfc-5f2911bd0391: the server could not find the requested resource (get pods dns-test-862a8b9c-cbcc-47b0-abfc-5f2911bd0391) Aug 18 11:32:52.434: INFO: Unable to read wheezy_tcp@dns-test-service.dns-11 from pod dns-11/dns-test-862a8b9c-cbcc-47b0-abfc-5f2911bd0391: the server could not find the requested resource (get pods dns-test-862a8b9c-cbcc-47b0-abfc-5f2911bd0391) Aug 18 11:32:52.436: INFO: Unable to read wheezy_udp@dns-test-service.dns-11.svc from pod dns-11/dns-test-862a8b9c-cbcc-47b0-abfc-5f2911bd0391: the server could not find the requested resource (get pods dns-test-862a8b9c-cbcc-47b0-abfc-5f2911bd0391) Aug 18 11:32:52.440: INFO: Unable to read wheezy_tcp@dns-test-service.dns-11.svc from pod dns-11/dns-test-862a8b9c-cbcc-47b0-abfc-5f2911bd0391: the server could not find the requested resource (get pods dns-test-862a8b9c-cbcc-47b0-abfc-5f2911bd0391) Aug 18 11:32:52.443: INFO: Unable to read wheezy_udp@_http._tcp.dns-test-service.dns-11.svc from pod dns-11/dns-test-862a8b9c-cbcc-47b0-abfc-5f2911bd0391: the server could not find the requested resource (get pods dns-test-862a8b9c-cbcc-47b0-abfc-5f2911bd0391) Aug 18 11:32:52.445: INFO: Unable to read wheezy_tcp@_http._tcp.dns-test-service.dns-11.svc from pod dns-11/dns-test-862a8b9c-cbcc-47b0-abfc-5f2911bd0391: the server could not find the requested resource (get pods dns-test-862a8b9c-cbcc-47b0-abfc-5f2911bd0391) Aug 18 11:32:52.462: INFO: Unable to read jessie_udp@dns-test-service from pod dns-11/dns-test-862a8b9c-cbcc-47b0-abfc-5f2911bd0391: the server could not find the requested resource (get pods dns-test-862a8b9c-cbcc-47b0-abfc-5f2911bd0391) Aug 18 11:32:52.464: INFO: Unable to read jessie_tcp@dns-test-service from pod dns-11/dns-test-862a8b9c-cbcc-47b0-abfc-5f2911bd0391: the server could not find the requested resource (get pods dns-test-862a8b9c-cbcc-47b0-abfc-5f2911bd0391) Aug 18 11:32:52.467: INFO: Unable to read jessie_udp@dns-test-service.dns-11 from pod dns-11/dns-test-862a8b9c-cbcc-47b0-abfc-5f2911bd0391: the server could not find the requested resource (get pods dns-test-862a8b9c-cbcc-47b0-abfc-5f2911bd0391) Aug 18 11:32:52.469: INFO: Unable to read jessie_tcp@dns-test-service.dns-11 from pod dns-11/dns-test-862a8b9c-cbcc-47b0-abfc-5f2911bd0391: the server could not find the requested resource (get pods dns-test-862a8b9c-cbcc-47b0-abfc-5f2911bd0391) Aug 18 11:32:52.471: INFO: Unable to read jessie_udp@dns-test-service.dns-11.svc from pod dns-11/dns-test-862a8b9c-cbcc-47b0-abfc-5f2911bd0391: the server could not find the requested resource (get pods dns-test-862a8b9c-cbcc-47b0-abfc-5f2911bd0391) Aug 18 11:32:52.474: INFO: Unable to read jessie_tcp@dns-test-service.dns-11.svc from pod dns-11/dns-test-862a8b9c-cbcc-47b0-abfc-5f2911bd0391: the server could not find the requested resource (get pods dns-test-862a8b9c-cbcc-47b0-abfc-5f2911bd0391) Aug 18 11:32:52.476: INFO: Unable to read jessie_udp@_http._tcp.dns-test-service.dns-11.svc from pod dns-11/dns-test-862a8b9c-cbcc-47b0-abfc-5f2911bd0391: the server could not find the requested resource (get pods dns-test-862a8b9c-cbcc-47b0-abfc-5f2911bd0391) Aug 18 11:32:52.479: INFO: Unable to read jessie_tcp@_http._tcp.dns-test-service.dns-11.svc from pod dns-11/dns-test-862a8b9c-cbcc-47b0-abfc-5f2911bd0391: the server could not find the requested resource (get pods dns-test-862a8b9c-cbcc-47b0-abfc-5f2911bd0391) Aug 18 11:32:52.494: INFO: Lookups using dns-11/dns-test-862a8b9c-cbcc-47b0-abfc-5f2911bd0391 failed for: [wheezy_udp@dns-test-service wheezy_tcp@dns-test-service wheezy_udp@dns-test-service.dns-11 wheezy_tcp@dns-test-service.dns-11 wheezy_udp@dns-test-service.dns-11.svc wheezy_tcp@dns-test-service.dns-11.svc wheezy_udp@_http._tcp.dns-test-service.dns-11.svc wheezy_tcp@_http._tcp.dns-test-service.dns-11.svc jessie_udp@dns-test-service jessie_tcp@dns-test-service jessie_udp@dns-test-service.dns-11 jessie_tcp@dns-test-service.dns-11 jessie_udp@dns-test-service.dns-11.svc jessie_tcp@dns-test-service.dns-11.svc jessie_udp@_http._tcp.dns-test-service.dns-11.svc jessie_tcp@_http._tcp.dns-test-service.dns-11.svc] Aug 18 11:32:57.498: INFO: Unable to read wheezy_udp@dns-test-service from pod dns-11/dns-test-862a8b9c-cbcc-47b0-abfc-5f2911bd0391: the server could not find the requested resource (get pods dns-test-862a8b9c-cbcc-47b0-abfc-5f2911bd0391) Aug 18 11:32:57.501: INFO: Unable to read wheezy_tcp@dns-test-service from pod dns-11/dns-test-862a8b9c-cbcc-47b0-abfc-5f2911bd0391: the server could not find the requested resource (get pods dns-test-862a8b9c-cbcc-47b0-abfc-5f2911bd0391) Aug 18 11:32:57.505: INFO: Unable to read wheezy_udp@dns-test-service.dns-11 from pod dns-11/dns-test-862a8b9c-cbcc-47b0-abfc-5f2911bd0391: the server could not find the requested resource (get pods dns-test-862a8b9c-cbcc-47b0-abfc-5f2911bd0391) Aug 18 11:32:57.507: INFO: Unable to read wheezy_tcp@dns-test-service.dns-11 from pod dns-11/dns-test-862a8b9c-cbcc-47b0-abfc-5f2911bd0391: the server could not find the requested resource (get pods dns-test-862a8b9c-cbcc-47b0-abfc-5f2911bd0391) Aug 18 11:32:57.510: INFO: Unable to read wheezy_udp@dns-test-service.dns-11.svc from pod dns-11/dns-test-862a8b9c-cbcc-47b0-abfc-5f2911bd0391: the server could not find the requested resource (get pods dns-test-862a8b9c-cbcc-47b0-abfc-5f2911bd0391) Aug 18 11:32:57.512: INFO: Unable to read wheezy_tcp@dns-test-service.dns-11.svc from pod dns-11/dns-test-862a8b9c-cbcc-47b0-abfc-5f2911bd0391: the server could not find the requested resource (get pods dns-test-862a8b9c-cbcc-47b0-abfc-5f2911bd0391) Aug 18 11:32:57.515: INFO: Unable to read wheezy_udp@_http._tcp.dns-test-service.dns-11.svc from pod dns-11/dns-test-862a8b9c-cbcc-47b0-abfc-5f2911bd0391: the server could not find the requested resource (get pods dns-test-862a8b9c-cbcc-47b0-abfc-5f2911bd0391) Aug 18 11:32:57.518: INFO: Unable to read wheezy_tcp@_http._tcp.dns-test-service.dns-11.svc from pod dns-11/dns-test-862a8b9c-cbcc-47b0-abfc-5f2911bd0391: the server could not find the requested resource (get pods dns-test-862a8b9c-cbcc-47b0-abfc-5f2911bd0391) Aug 18 11:32:57.536: INFO: Unable to read jessie_udp@dns-test-service from pod dns-11/dns-test-862a8b9c-cbcc-47b0-abfc-5f2911bd0391: the server could not find the requested resource (get pods dns-test-862a8b9c-cbcc-47b0-abfc-5f2911bd0391) Aug 18 11:32:57.538: INFO: Unable to read jessie_tcp@dns-test-service from pod dns-11/dns-test-862a8b9c-cbcc-47b0-abfc-5f2911bd0391: the server could not find the requested resource (get pods dns-test-862a8b9c-cbcc-47b0-abfc-5f2911bd0391) Aug 18 11:32:57.541: INFO: Unable to read jessie_udp@dns-test-service.dns-11 from pod dns-11/dns-test-862a8b9c-cbcc-47b0-abfc-5f2911bd0391: the server could not find the requested resource (get pods dns-test-862a8b9c-cbcc-47b0-abfc-5f2911bd0391) Aug 18 11:32:57.543: INFO: Unable to read jessie_tcp@dns-test-service.dns-11 from pod dns-11/dns-test-862a8b9c-cbcc-47b0-abfc-5f2911bd0391: the server could not find the requested resource (get pods dns-test-862a8b9c-cbcc-47b0-abfc-5f2911bd0391) Aug 18 11:32:57.546: INFO: Unable to read jessie_udp@dns-test-service.dns-11.svc from pod dns-11/dns-test-862a8b9c-cbcc-47b0-abfc-5f2911bd0391: the server could not find the requested resource (get pods dns-test-862a8b9c-cbcc-47b0-abfc-5f2911bd0391) Aug 18 11:32:57.548: INFO: Unable to read jessie_tcp@dns-test-service.dns-11.svc from pod dns-11/dns-test-862a8b9c-cbcc-47b0-abfc-5f2911bd0391: the server could not find the requested resource (get pods dns-test-862a8b9c-cbcc-47b0-abfc-5f2911bd0391) Aug 18 11:32:57.551: INFO: Unable to read jessie_udp@_http._tcp.dns-test-service.dns-11.svc from pod dns-11/dns-test-862a8b9c-cbcc-47b0-abfc-5f2911bd0391: the server could not find the requested resource (get pods dns-test-862a8b9c-cbcc-47b0-abfc-5f2911bd0391) Aug 18 11:32:57.553: INFO: Unable to read jessie_tcp@_http._tcp.dns-test-service.dns-11.svc from pod dns-11/dns-test-862a8b9c-cbcc-47b0-abfc-5f2911bd0391: the server could not find the requested resource (get pods dns-test-862a8b9c-cbcc-47b0-abfc-5f2911bd0391) Aug 18 11:32:57.571: INFO: Lookups using dns-11/dns-test-862a8b9c-cbcc-47b0-abfc-5f2911bd0391 failed for: [wheezy_udp@dns-test-service wheezy_tcp@dns-test-service wheezy_udp@dns-test-service.dns-11 wheezy_tcp@dns-test-service.dns-11 wheezy_udp@dns-test-service.dns-11.svc wheezy_tcp@dns-test-service.dns-11.svc wheezy_udp@_http._tcp.dns-test-service.dns-11.svc wheezy_tcp@_http._tcp.dns-test-service.dns-11.svc jessie_udp@dns-test-service jessie_tcp@dns-test-service jessie_udp@dns-test-service.dns-11 jessie_tcp@dns-test-service.dns-11 jessie_udp@dns-test-service.dns-11.svc jessie_tcp@dns-test-service.dns-11.svc jessie_udp@_http._tcp.dns-test-service.dns-11.svc jessie_tcp@_http._tcp.dns-test-service.dns-11.svc] Aug 18 11:33:02.566: INFO: DNS probes using dns-11/dns-test-862a8b9c-cbcc-47b0-abfc-5f2911bd0391 succeeded STEP: deleting the pod STEP: deleting the test service STEP: deleting the test headless service [AfterEach] [sig-network] DNS /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:33:02.592: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "dns-11" for this suite. • [SLOW TEST:22.239 seconds] [sig-network] DNS /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/framework.go:23 should resolve DNS of partial qualified names for services [LinuxOnly] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-network] DNS should resolve DNS of partial qualified names for services [LinuxOnly] [Conformance]","total":-1,"completed":11,"skipped":100,"failed":1,"failures":["[sig-node] Downward API should provide host IP as an env var [NodeConformance] [Conformance]"]} SSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-storage] EmptyDir volumes /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:33:02.648: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename emptydir STEP: Waiting for a default service account to be provisioned in namespace [It] should support (root,0644,default) [LinuxOnly] [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating a pod to test emptydir 0644 on node default medium Aug 18 11:33:02.684: INFO: Waiting up to 5m0s for pod "pod-61402e59-5026-4cb1-b573-c45adf83edd2" in namespace "emptydir-3992" to be "Succeeded or Failed" Aug 18 11:33:02.686: INFO: Pod "pod-61402e59-5026-4cb1-b573-c45adf83edd2": Phase="Pending", Reason="", readiness=false. Elapsed: 1.875828ms Aug 18 11:33:04.690: INFO: Pod "pod-61402e59-5026-4cb1-b573-c45adf83edd2": Phase="Pending", Reason="", readiness=false. Elapsed: 2.005175237s Aug 18 11:33:06.693: INFO: Pod "pod-61402e59-5026-4cb1-b573-c45adf83edd2": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.008444291s STEP: Saw pod success Aug 18 11:33:06.693: INFO: Pod "pod-61402e59-5026-4cb1-b573-c45adf83edd2" satisfied condition "Succeeded or Failed" Aug 18 11:33:06.695: INFO: Trying to get logs from node node2 pod pod-61402e59-5026-4cb1-b573-c45adf83edd2 container test-container: STEP: delete the pod Aug 18 11:33:06.712: INFO: Waiting for pod pod-61402e59-5026-4cb1-b573-c45adf83edd2 to disappear Aug 18 11:33:06.714: INFO: Pod pod-61402e59-5026-4cb1-b573-c45adf83edd2 no longer exists [AfterEach] [sig-storage] EmptyDir volumes /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:33:06.714: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "emptydir-3992" for this suite. • ------------------------------ {"msg":"PASSED [sig-storage] EmptyDir volumes should support (root,0644,default) [LinuxOnly] [NodeConformance] [Conformance]","total":-1,"completed":12,"skipped":118,"failed":1,"failures":["[sig-node] Downward API should provide host IP as an env var [NodeConformance] [Conformance]"]} SSSSSSS ------------------------------ [BeforeEach] [sig-storage] Subpath /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:32:41.012: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename subpath STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] Atomic writer volumes /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/subpath.go:38 STEP: Setting up data [It] should support subpaths with downward pod [LinuxOnly] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating pod pod-subpath-test-downwardapi-b5dd STEP: Creating a pod to test atomic-volume-subpath Aug 18 11:32:41.133: INFO: Waiting up to 5m0s for pod "pod-subpath-test-downwardapi-b5dd" in namespace "subpath-3957" to be "Succeeded or Failed" Aug 18 11:32:41.135: INFO: Pod "pod-subpath-test-downwardapi-b5dd": Phase="Pending", Reason="", readiness=false. Elapsed: 1.963318ms Aug 18 11:32:43.138: INFO: Pod "pod-subpath-test-downwardapi-b5dd": Phase="Pending", Reason="", readiness=false. Elapsed: 2.004947718s Aug 18 11:32:45.142: INFO: Pod "pod-subpath-test-downwardapi-b5dd": Phase="Pending", Reason="", readiness=false. Elapsed: 4.008726455s Aug 18 11:32:47.145: INFO: Pod "pod-subpath-test-downwardapi-b5dd": Phase="Running", Reason="", readiness=true. Elapsed: 6.011525889s Aug 18 11:32:49.148: INFO: Pod "pod-subpath-test-downwardapi-b5dd": Phase="Running", Reason="", readiness=true. Elapsed: 8.014300067s Aug 18 11:32:51.153: INFO: Pod "pod-subpath-test-downwardapi-b5dd": Phase="Running", Reason="", readiness=true. Elapsed: 10.019344218s Aug 18 11:32:53.156: INFO: Pod "pod-subpath-test-downwardapi-b5dd": Phase="Running", Reason="", readiness=true. Elapsed: 12.022804965s Aug 18 11:32:55.160: INFO: Pod "pod-subpath-test-downwardapi-b5dd": Phase="Running", Reason="", readiness=true. Elapsed: 14.026696338s Aug 18 11:32:57.165: INFO: Pod "pod-subpath-test-downwardapi-b5dd": Phase="Running", Reason="", readiness=true. Elapsed: 16.031886011s Aug 18 11:32:59.168: INFO: Pod "pod-subpath-test-downwardapi-b5dd": Phase="Running", Reason="", readiness=true. Elapsed: 18.034135729s Aug 18 11:33:01.170: INFO: Pod "pod-subpath-test-downwardapi-b5dd": Phase="Running", Reason="", readiness=true. Elapsed: 20.036957959s Aug 18 11:33:03.174: INFO: Pod "pod-subpath-test-downwardapi-b5dd": Phase="Running", Reason="", readiness=true. Elapsed: 22.040134944s Aug 18 11:33:05.177: INFO: Pod "pod-subpath-test-downwardapi-b5dd": Phase="Running", Reason="", readiness=true. Elapsed: 24.043124607s Aug 18 11:33:07.181: INFO: Pod "pod-subpath-test-downwardapi-b5dd": Phase="Succeeded", Reason="", readiness=false. Elapsed: 26.047310424s STEP: Saw pod success Aug 18 11:33:07.181: INFO: Pod "pod-subpath-test-downwardapi-b5dd" satisfied condition "Succeeded or Failed" Aug 18 11:33:07.184: INFO: Trying to get logs from node node1 pod pod-subpath-test-downwardapi-b5dd container test-container-subpath-downwardapi-b5dd: STEP: delete the pod Aug 18 11:33:07.208: INFO: Waiting for pod pod-subpath-test-downwardapi-b5dd to disappear Aug 18 11:33:07.210: INFO: Pod pod-subpath-test-downwardapi-b5dd no longer exists STEP: Deleting pod pod-subpath-test-downwardapi-b5dd Aug 18 11:33:07.210: INFO: Deleting pod "pod-subpath-test-downwardapi-b5dd" in namespace "subpath-3957" [AfterEach] [sig-storage] Subpath /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:33:07.212: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "subpath-3957" for this suite. • [SLOW TEST:26.209 seconds] [sig-storage] Subpath /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/framework.go:23 Atomic writer volumes /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/subpath.go:34 should support subpaths with downward pod [LinuxOnly] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-storage] Subpath Atomic writer volumes should support subpaths with downward pod [LinuxOnly] [Conformance]","total":-1,"completed":22,"skipped":480,"failed":1,"failures":["[k8s.io] Pods should be submitted and removed [NodeConformance] [Conformance]"]} SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-network] DNS /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:33:06.739: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename dns STEP: Waiting for a default service account to be provisioned in namespace [It] should provide DNS for services [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating a test headless service STEP: Running these commands on wheezy: for i in `seq 1 600`; do check="$$(dig +notcp +noall +answer +search dns-test-service.dns-1918.svc.cluster.local A)" && test -n "$$check" && echo OK > /results/wheezy_udp@dns-test-service.dns-1918.svc.cluster.local;check="$$(dig +tcp +noall +answer +search dns-test-service.dns-1918.svc.cluster.local A)" && test -n "$$check" && echo OK > /results/wheezy_tcp@dns-test-service.dns-1918.svc.cluster.local;check="$$(dig +notcp +noall +answer +search _http._tcp.dns-test-service.dns-1918.svc.cluster.local SRV)" && test -n "$$check" && echo OK > /results/wheezy_udp@_http._tcp.dns-test-service.dns-1918.svc.cluster.local;check="$$(dig +tcp +noall +answer +search _http._tcp.dns-test-service.dns-1918.svc.cluster.local SRV)" && test -n "$$check" && echo OK > /results/wheezy_tcp@_http._tcp.dns-test-service.dns-1918.svc.cluster.local;check="$$(dig +notcp +noall +answer +search _http._tcp.test-service-2.dns-1918.svc.cluster.local SRV)" && test -n "$$check" && echo OK > /results/wheezy_udp@_http._tcp.test-service-2.dns-1918.svc.cluster.local;check="$$(dig +tcp +noall +answer +search _http._tcp.test-service-2.dns-1918.svc.cluster.local SRV)" && test -n "$$check" && echo OK > /results/wheezy_tcp@_http._tcp.test-service-2.dns-1918.svc.cluster.local;podARec=$$(hostname -i| awk -F. '{print $$1"-"$$2"-"$$3"-"$$4".dns-1918.pod.cluster.local"}');check="$$(dig +notcp +noall +answer +search $${podARec} A)" && test -n "$$check" && echo OK > /results/wheezy_udp@PodARecord;check="$$(dig +tcp +noall +answer +search $${podARec} A)" && test -n "$$check" && echo OK > /results/wheezy_tcp@PodARecord;check="$$(dig +notcp +noall +answer +search 176.49.233.10.in-addr.arpa. PTR)" && test -n "$$check" && echo OK > /results/10.233.49.176_udp@PTR;check="$$(dig +tcp +noall +answer +search 176.49.233.10.in-addr.arpa. PTR)" && test -n "$$check" && echo OK > /results/10.233.49.176_tcp@PTR;sleep 1; done STEP: Running these commands on jessie: for i in `seq 1 600`; do check="$$(dig +notcp +noall +answer +search dns-test-service.dns-1918.svc.cluster.local A)" && test -n "$$check" && echo OK > /results/jessie_udp@dns-test-service.dns-1918.svc.cluster.local;check="$$(dig +tcp +noall +answer +search dns-test-service.dns-1918.svc.cluster.local A)" && test -n "$$check" && echo OK > /results/jessie_tcp@dns-test-service.dns-1918.svc.cluster.local;check="$$(dig +notcp +noall +answer +search _http._tcp.dns-test-service.dns-1918.svc.cluster.local SRV)" && test -n "$$check" && echo OK > /results/jessie_udp@_http._tcp.dns-test-service.dns-1918.svc.cluster.local;check="$$(dig +tcp +noall +answer +search _http._tcp.dns-test-service.dns-1918.svc.cluster.local SRV)" && test -n "$$check" && echo OK > /results/jessie_tcp@_http._tcp.dns-test-service.dns-1918.svc.cluster.local;check="$$(dig +notcp +noall +answer +search _http._tcp.test-service-2.dns-1918.svc.cluster.local SRV)" && test -n "$$check" && echo OK > /results/jessie_udp@_http._tcp.test-service-2.dns-1918.svc.cluster.local;check="$$(dig +tcp +noall +answer +search _http._tcp.test-service-2.dns-1918.svc.cluster.local SRV)" && test -n "$$check" && echo OK > /results/jessie_tcp@_http._tcp.test-service-2.dns-1918.svc.cluster.local;podARec=$$(hostname -i| awk -F. '{print $$1"-"$$2"-"$$3"-"$$4".dns-1918.pod.cluster.local"}');check="$$(dig +notcp +noall +answer +search $${podARec} A)" && test -n "$$check" && echo OK > /results/jessie_udp@PodARecord;check="$$(dig +tcp +noall +answer +search $${podARec} A)" && test -n "$$check" && echo OK > /results/jessie_tcp@PodARecord;check="$$(dig +notcp +noall +answer +search 176.49.233.10.in-addr.arpa. PTR)" && test -n "$$check" && echo OK > /results/10.233.49.176_udp@PTR;check="$$(dig +tcp +noall +answer +search 176.49.233.10.in-addr.arpa. PTR)" && test -n "$$check" && echo OK > /results/10.233.49.176_tcp@PTR;sleep 1; done STEP: creating a pod to probe DNS STEP: submitting the pod to kubernetes STEP: retrieving the pod STEP: looking for the results for each expected name from probers Aug 18 11:33:12.800: INFO: Unable to read wheezy_udp@dns-test-service.dns-1918.svc.cluster.local from pod dns-1918/dns-test-80d48b33-ceb2-4bed-9664-629825b487c6: the server could not find the requested resource (get pods dns-test-80d48b33-ceb2-4bed-9664-629825b487c6) Aug 18 11:33:12.802: INFO: Unable to read wheezy_tcp@dns-test-service.dns-1918.svc.cluster.local from pod dns-1918/dns-test-80d48b33-ceb2-4bed-9664-629825b487c6: the server could not find the requested resource (get pods dns-test-80d48b33-ceb2-4bed-9664-629825b487c6) Aug 18 11:33:12.805: INFO: Unable to read wheezy_udp@_http._tcp.dns-test-service.dns-1918.svc.cluster.local from pod dns-1918/dns-test-80d48b33-ceb2-4bed-9664-629825b487c6: the server could not find the requested resource (get pods dns-test-80d48b33-ceb2-4bed-9664-629825b487c6) Aug 18 11:33:12.808: INFO: Unable to read wheezy_tcp@_http._tcp.dns-test-service.dns-1918.svc.cluster.local from pod dns-1918/dns-test-80d48b33-ceb2-4bed-9664-629825b487c6: the server could not find the requested resource (get pods dns-test-80d48b33-ceb2-4bed-9664-629825b487c6) Aug 18 11:33:12.827: INFO: Unable to read jessie_udp@dns-test-service.dns-1918.svc.cluster.local from pod dns-1918/dns-test-80d48b33-ceb2-4bed-9664-629825b487c6: the server could not find the requested resource (get pods dns-test-80d48b33-ceb2-4bed-9664-629825b487c6) Aug 18 11:33:12.830: INFO: Unable to read jessie_tcp@dns-test-service.dns-1918.svc.cluster.local from pod dns-1918/dns-test-80d48b33-ceb2-4bed-9664-629825b487c6: the server could not find the requested resource (get pods dns-test-80d48b33-ceb2-4bed-9664-629825b487c6) Aug 18 11:33:12.832: INFO: Unable to read jessie_udp@_http._tcp.dns-test-service.dns-1918.svc.cluster.local from pod dns-1918/dns-test-80d48b33-ceb2-4bed-9664-629825b487c6: the server could not find the requested resource (get pods dns-test-80d48b33-ceb2-4bed-9664-629825b487c6) Aug 18 11:33:12.835: INFO: Unable to read jessie_tcp@_http._tcp.dns-test-service.dns-1918.svc.cluster.local from pod dns-1918/dns-test-80d48b33-ceb2-4bed-9664-629825b487c6: the server could not find the requested resource (get pods dns-test-80d48b33-ceb2-4bed-9664-629825b487c6) Aug 18 11:33:12.851: INFO: Lookups using dns-1918/dns-test-80d48b33-ceb2-4bed-9664-629825b487c6 failed for: [wheezy_udp@dns-test-service.dns-1918.svc.cluster.local wheezy_tcp@dns-test-service.dns-1918.svc.cluster.local wheezy_udp@_http._tcp.dns-test-service.dns-1918.svc.cluster.local wheezy_tcp@_http._tcp.dns-test-service.dns-1918.svc.cluster.local jessie_udp@dns-test-service.dns-1918.svc.cluster.local jessie_tcp@dns-test-service.dns-1918.svc.cluster.local jessie_udp@_http._tcp.dns-test-service.dns-1918.svc.cluster.local jessie_tcp@_http._tcp.dns-test-service.dns-1918.svc.cluster.local] Aug 18 11:33:17.898: INFO: DNS probes using dns-1918/dns-test-80d48b33-ceb2-4bed-9664-629825b487c6 succeeded STEP: deleting the pod STEP: deleting the test service STEP: deleting the test headless service [AfterEach] [sig-network] DNS /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:33:17.943: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "dns-1918" for this suite. • [SLOW TEST:11.211 seconds] [sig-network] DNS /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/framework.go:23 should provide DNS for services [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-network] DNS should provide DNS for services [Conformance]","total":-1,"completed":13,"skipped":125,"failed":1,"failures":["[sig-node] Downward API should provide host IP as an env var [NodeConformance] [Conformance]"]} SSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-api-machinery] CustomResourceDefinition resources [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:33:07.334: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename custom-resource-definition STEP: Waiting for a default service account to be provisioned in namespace [It] listing custom resource definition objects works [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:33:07.355: INFO: >>> kubeConfig: /root/.kube/config [AfterEach] [sig-api-machinery] CustomResourceDefinition resources [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:34:08.621: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "custom-resource-definition-8418" for this suite. • [SLOW TEST:61.295 seconds] [sig-api-machinery] CustomResourceDefinition resources [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23 Simple CustomResourceDefinition /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/custom_resource_definition.go:48 listing custom resource definition objects works [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-api-machinery] CustomResourceDefinition resources [Privileged:ClusterAdmin] Simple CustomResourceDefinition listing custom resource definition objects works [Conformance]","total":-1,"completed":23,"skipped":536,"failed":1,"failures":["[k8s.io] Pods should be submitted and removed [NodeConformance] [Conformance]"]} SSSS ------------------------------ [BeforeEach] [sig-api-machinery] CustomResourceDefinition resources [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:34:08.642: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename custom-resource-definition STEP: Waiting for a default service account to be provisioned in namespace [It] getting/updating/patching custom resource definition status sub-resource works [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:34:08.662: INFO: >>> kubeConfig: /root/.kube/config [AfterEach] [sig-api-machinery] CustomResourceDefinition resources [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:34:14.188: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "custom-resource-definition-3654" for this suite. • [SLOW TEST:5.554 seconds] [sig-api-machinery] CustomResourceDefinition resources [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23 Simple CustomResourceDefinition /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/custom_resource_definition.go:48 getting/updating/patching custom resource definition status sub-resource works [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-api-machinery] CustomResourceDefinition resources [Privileged:ClusterAdmin] Simple CustomResourceDefinition getting/updating/patching custom resource definition status sub-resource works [Conformance]","total":-1,"completed":24,"skipped":540,"failed":1,"failures":["[k8s.io] Pods should be submitted and removed [NodeConformance] [Conformance]"]} SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-storage] Projected secret /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:32:38.282: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename projected STEP: Waiting for a default service account to be provisioned in namespace [It] optional updates should be reflected in volume [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating secret with name s-test-opt-del-279a1d02-675b-4d6b-85ef-6f621a3a68be STEP: Creating secret with name s-test-opt-upd-b799446f-13fd-454a-bf11-c5dab7604bdb STEP: Creating the pod STEP: Deleting secret s-test-opt-del-279a1d02-675b-4d6b-85ef-6f621a3a68be STEP: Updating secret s-test-opt-upd-b799446f-13fd-454a-bf11-c5dab7604bdb STEP: Creating secret with name s-test-opt-create-f6ab50c2-1002-4b97-a94a-c03fb2486e7f STEP: waiting to observe update in volume [AfterEach] [sig-storage] Projected secret /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:34:16.875: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "projected-8898" for this suite. • [SLOW TEST:98.601 seconds] [sig-storage] Projected secret /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/projected_secret.go:35 optional updates should be reflected in volume [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-storage] Projected secret optional updates should be reflected in volume [NodeConformance] [Conformance]","total":-1,"completed":16,"skipped":282,"failed":1,"failures":["[k8s.io] InitContainer [NodeConformance] should invoke init containers on a RestartAlways pod [Conformance]"]} SSSSSSSSSSS ------------------------------ [BeforeEach] [sig-storage] Secrets /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:34:16.910: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename secrets STEP: Waiting for a default service account to be provisioned in namespace [It] should be able to mount in a volume regardless of a different secret existing with same name in different namespace [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating secret with name secret-test-084239df-20b4-48ac-b343-f8fedbbba139 STEP: Creating a pod to test consume secrets Aug 18 11:34:16.973: INFO: Waiting up to 5m0s for pod "pod-secrets-feb25cb3-4223-4483-96e5-ea7f2db94de2" in namespace "secrets-2848" to be "Succeeded or Failed" Aug 18 11:34:16.976: INFO: Pod "pod-secrets-feb25cb3-4223-4483-96e5-ea7f2db94de2": Phase="Pending", Reason="", readiness=false. Elapsed: 2.196433ms Aug 18 11:34:18.979: INFO: Pod "pod-secrets-feb25cb3-4223-4483-96e5-ea7f2db94de2": Phase="Pending", Reason="", readiness=false. Elapsed: 2.0050695s Aug 18 11:34:20.982: INFO: Pod "pod-secrets-feb25cb3-4223-4483-96e5-ea7f2db94de2": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.008607506s STEP: Saw pod success Aug 18 11:34:20.982: INFO: Pod "pod-secrets-feb25cb3-4223-4483-96e5-ea7f2db94de2" satisfied condition "Succeeded or Failed" Aug 18 11:34:20.984: INFO: Trying to get logs from node node1 pod pod-secrets-feb25cb3-4223-4483-96e5-ea7f2db94de2 container secret-volume-test: STEP: delete the pod Aug 18 11:34:20.997: INFO: Waiting for pod pod-secrets-feb25cb3-4223-4483-96e5-ea7f2db94de2 to disappear Aug 18 11:34:20.999: INFO: Pod pod-secrets-feb25cb3-4223-4483-96e5-ea7f2db94de2 no longer exists [AfterEach] [sig-storage] Secrets /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:34:20.999: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "secrets-2848" for this suite. STEP: Destroying namespace "secret-namespace-9751" for this suite. • ------------------------------ {"msg":"PASSED [sig-storage] Secrets should be able to mount in a volume regardless of a different secret existing with same name in different namespace [NodeConformance] [Conformance]","total":-1,"completed":17,"skipped":293,"failed":1,"failures":["[k8s.io] InitContainer [NodeConformance] should invoke init containers on a RestartAlways pod [Conformance]"]} SSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-node] ConfigMap /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:34:21.072: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename configmap STEP: Waiting for a default service account to be provisioned in namespace [It] should run through a ConfigMap lifecycle [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: creating a ConfigMap STEP: fetching the ConfigMap STEP: patching the ConfigMap STEP: listing all ConfigMaps in all namespaces with a label selector STEP: deleting the ConfigMap by collection with a label selector STEP: listing all ConfigMaps in test namespace [AfterEach] [sig-node] ConfigMap /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:34:21.146: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "configmap-1931" for this suite. • ------------------------------ {"msg":"PASSED [sig-node] ConfigMap should run through a ConfigMap lifecycle [Conformance]","total":-1,"completed":18,"skipped":322,"failed":1,"failures":["[k8s.io] InitContainer [NodeConformance] should invoke init containers on a RestartAlways pod [Conformance]"]} SSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-storage] Projected configMap /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:33:17.982: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename projected STEP: Waiting for a default service account to be provisioned in namespace [It] optional updates should be reflected in volume [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating configMap with name cm-test-opt-del-896b0af0-3ae4-4f60-a099-a077fe350a9d STEP: Creating configMap with name cm-test-opt-upd-cb1a13c8-98d9-4001-884a-7bcace8e0ba9 STEP: Creating the pod STEP: Deleting configmap cm-test-opt-del-896b0af0-3ae4-4f60-a099-a077fe350a9d STEP: Updating configmap cm-test-opt-upd-cb1a13c8-98d9-4001-884a-7bcace8e0ba9 STEP: Creating configMap with name cm-test-opt-create-8ca451b4-50e9-4b77-8432-75c625de7fe9 STEP: waiting to observe update in volume [AfterEach] [sig-storage] Projected configMap /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:34:32.418: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "projected-3788" for this suite. • [SLOW TEST:74.444 seconds] [sig-storage] Projected configMap /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/projected_configmap.go:36 optional updates should be reflected in volume [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-storage] Projected configMap optional updates should be reflected in volume [NodeConformance] [Conformance]","total":-1,"completed":14,"skipped":137,"failed":1,"failures":["[sig-node] Downward API should provide host IP as an env var [NodeConformance] [Conformance]"]} SSSSSS ------------------------------ [BeforeEach] [sig-api-machinery] Watchers /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:34:32.443: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename watch STEP: Waiting for a default service account to be provisioned in namespace [It] should receive events on concurrent watches in same order [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: getting a starting resourceVersion STEP: starting a background goroutine to produce watch events STEP: creating watches starting from each resource version of the events produced and verifying they all receive resource versions in the same order [AfterEach] [sig-api-machinery] Watchers /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:34:38.199: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "watch-1425" for this suite. • [SLOW TEST:5.856 seconds] [sig-api-machinery] Watchers /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23 should receive events on concurrent watches in same order [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-api-machinery] Watchers should receive events on concurrent watches in same order [Conformance]","total":-1,"completed":15,"skipped":143,"failed":1,"failures":["[sig-node] Downward API should provide host IP as an env var [NodeConformance] [Conformance]"]} S ------------------------------ [BeforeEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:32:19.370: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename services STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:782 [It] should be able to switch session affinity for NodePort service [LinuxOnly] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: creating service in namespace services-2642 STEP: creating service affinity-nodeport-transition in namespace services-2642 STEP: creating replication controller affinity-nodeport-transition in namespace services-2642 I0818 11:32:19.405257 26 runners.go:190] Created replication controller with name: affinity-nodeport-transition, namespace: services-2642, replica count: 3 I0818 11:32:22.455731 26 runners.go:190] affinity-nodeport-transition Pods: 3 out of 3 created, 0 running, 3 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0818 11:32:25.456253 26 runners.go:190] affinity-nodeport-transition Pods: 3 out of 3 created, 3 running, 0 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady Aug 18 11:32:25.464: INFO: Creating new exec pod Aug 18 11:32:30.487: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 affinity-nodeport-transition 80' Aug 18 11:32:30.778: INFO: stderr: "+ nc -zv -t -w 2 affinity-nodeport-transition 80\nConnection to affinity-nodeport-transition 80 port [tcp/http] succeeded!\n" Aug 18 11:32:30.778: INFO: stdout: "" Aug 18 11:32:30.779: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.233.38.163 80' Aug 18 11:32:31.020: INFO: stderr: "+ nc -zv -t -w 2 10.233.38.163 80\nConnection to 10.233.38.163 80 port [tcp/http] succeeded!\n" Aug 18 11:32:31.020: INFO: stdout: "" Aug 18 11:32:31.020: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:32:31.284: INFO: rc: 1 Aug 18 11:32:31.284: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:32:32.284: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:32:32.546: INFO: rc: 1 Aug 18 11:32:32.546: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:32:33.284: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:32:33.580: INFO: rc: 1 Aug 18 11:32:33.580: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:32:34.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:32:34.542: INFO: rc: 1 Aug 18 11:32:34.542: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:32:35.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:32:35.587: INFO: rc: 1 Aug 18 11:32:35.587: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:32:36.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:32:36.557: INFO: rc: 1 Aug 18 11:32:36.557: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:32:37.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:32:37.530: INFO: rc: 1 Aug 18 11:32:37.530: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:32:38.286: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:32:38.620: INFO: rc: 1 Aug 18 11:32:38.620: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:32:39.284: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:32:39.802: INFO: rc: 1 Aug 18 11:32:39.802: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:32:40.284: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:32:40.561: INFO: rc: 1 Aug 18 11:32:40.561: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:32:41.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:32:41.535: INFO: rc: 1 Aug 18 11:32:41.535: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:32:42.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:32:42.556: INFO: rc: 1 Aug 18 11:32:42.556: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:32:43.286: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:32:43.592: INFO: rc: 1 Aug 18 11:32:43.592: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:32:44.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:32:44.584: INFO: rc: 1 Aug 18 11:32:44.584: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:32:45.284: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:32:45.569: INFO: rc: 1 Aug 18 11:32:45.569: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:32:46.286: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:32:46.557: INFO: rc: 1 Aug 18 11:32:46.557: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:32:47.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:32:47.535: INFO: rc: 1 Aug 18 11:32:47.536: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:32:48.286: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:32:48.558: INFO: rc: 1 Aug 18 11:32:48.558: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:32:49.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:32:49.569: INFO: rc: 1 Aug 18 11:32:49.569: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:32:50.286: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:32:50.525: INFO: rc: 1 Aug 18 11:32:50.525: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:32:51.286: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:32:51.526: INFO: rc: 1 Aug 18 11:32:51.526: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:32:52.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:32:52.553: INFO: rc: 1 Aug 18 11:32:52.553: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:32:53.286: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:32:53.551: INFO: rc: 1 Aug 18 11:32:53.551: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:32:54.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:32:54.564: INFO: rc: 1 Aug 18 11:32:54.564: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:32:55.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:32:55.545: INFO: rc: 1 Aug 18 11:32:55.545: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:32:56.284: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:32:56.520: INFO: rc: 1 Aug 18 11:32:56.520: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:32:57.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:32:57.553: INFO: rc: 1 Aug 18 11:32:57.553: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:32:58.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:32:58.546: INFO: rc: 1 Aug 18 11:32:58.546: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:32:59.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:32:59.541: INFO: rc: 1 Aug 18 11:32:59.541: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:33:00.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:33:00.952: INFO: rc: 1 Aug 18 11:33:00.952: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:33:01.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:33:01.554: INFO: rc: 1 Aug 18 11:33:01.554: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:33:02.286: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:33:02.761: INFO: rc: 1 Aug 18 11:33:02.761: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:33:03.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:33:03.738: INFO: rc: 1 Aug 18 11:33:03.738: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:33:04.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:33:04.540: INFO: rc: 1 Aug 18 11:33:04.540: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:33:05.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:33:05.578: INFO: rc: 1 Aug 18 11:33:05.578: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:33:06.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:33:06.553: INFO: rc: 1 Aug 18 11:33:06.553: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:33:07.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:33:07.567: INFO: rc: 1 Aug 18 11:33:07.567: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:33:08.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:33:08.565: INFO: rc: 1 Aug 18 11:33:08.565: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:33:09.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:33:09.566: INFO: rc: 1 Aug 18 11:33:09.566: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:33:10.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:33:10.539: INFO: rc: 1 Aug 18 11:33:10.539: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:33:11.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:33:11.559: INFO: rc: 1 Aug 18 11:33:11.559: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:33:12.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:33:12.548: INFO: rc: 1 Aug 18 11:33:12.548: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:33:13.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:33:14.590: INFO: rc: 1 Aug 18 11:33:14.590: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:33:15.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:33:15.545: INFO: rc: 1 Aug 18 11:33:15.545: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:33:16.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:33:16.580: INFO: rc: 1 Aug 18 11:33:16.580: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:33:17.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:33:17.563: INFO: rc: 1 Aug 18 11:33:17.564: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:33:18.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:33:18.558: INFO: rc: 1 Aug 18 11:33:18.558: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:33:19.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:33:19.550: INFO: rc: 1 Aug 18 11:33:19.550: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:33:20.286: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:33:20.563: INFO: rc: 1 Aug 18 11:33:20.563: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:33:21.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:33:21.561: INFO: rc: 1 Aug 18 11:33:21.561: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:33:22.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:33:22.539: INFO: rc: 1 Aug 18 11:33:22.539: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:33:23.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:33:23.550: INFO: rc: 1 Aug 18 11:33:23.550: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:33:24.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:33:24.553: INFO: rc: 1 Aug 18 11:33:24.553: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:33:25.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:33:25.536: INFO: rc: 1 Aug 18 11:33:25.536: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:33:26.286: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:33:26.615: INFO: rc: 1 Aug 18 11:33:26.615: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:33:27.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:33:27.529: INFO: rc: 1 Aug 18 11:33:27.529: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:33:28.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:33:28.540: INFO: rc: 1 Aug 18 11:33:28.540: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:33:29.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:33:29.548: INFO: rc: 1 Aug 18 11:33:29.548: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:33:30.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:33:30.558: INFO: rc: 1 Aug 18 11:33:30.558: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:33:31.284: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:33:31.552: INFO: rc: 1 Aug 18 11:33:31.552: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:33:32.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:33:32.543: INFO: rc: 1 Aug 18 11:33:32.543: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:33:33.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:33:33.553: INFO: rc: 1 Aug 18 11:33:33.553: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:33:34.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:33:34.536: INFO: rc: 1 Aug 18 11:33:34.536: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:33:35.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:33:35.535: INFO: rc: 1 Aug 18 11:33:35.535: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:33:36.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:33:36.559: INFO: rc: 1 Aug 18 11:33:36.559: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:33:37.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:33:37.546: INFO: rc: 1 Aug 18 11:33:37.546: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:33:38.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:33:38.550: INFO: rc: 1 Aug 18 11:33:38.550: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:33:39.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:33:39.528: INFO: rc: 1 Aug 18 11:33:39.528: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:33:40.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:33:40.558: INFO: rc: 1 Aug 18 11:33:40.558: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:33:41.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:33:41.532: INFO: rc: 1 Aug 18 11:33:41.533: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:33:42.284: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:33:42.538: INFO: rc: 1 Aug 18 11:33:42.538: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:33:43.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:33:43.809: INFO: rc: 1 Aug 18 11:33:43.809: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:33:44.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:33:44.695: INFO: rc: 1 Aug 18 11:33:44.695: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:33:45.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:33:45.539: INFO: rc: 1 Aug 18 11:33:45.539: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:33:46.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:33:46.546: INFO: rc: 1 Aug 18 11:33:46.546: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:33:47.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:33:47.569: INFO: rc: 1 Aug 18 11:33:47.569: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:33:48.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:33:48.556: INFO: rc: 1 Aug 18 11:33:48.556: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:33:49.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:33:49.566: INFO: rc: 1 Aug 18 11:33:49.566: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:33:50.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:33:50.585: INFO: rc: 1 Aug 18 11:33:50.585: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:33:51.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:33:51.558: INFO: rc: 1 Aug 18 11:33:51.558: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:33:52.284: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:33:52.564: INFO: rc: 1 Aug 18 11:33:52.564: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:33:53.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:33:53.569: INFO: rc: 1 Aug 18 11:33:53.569: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:33:54.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:33:54.548: INFO: rc: 1 Aug 18 11:33:54.548: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:33:55.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:33:55.557: INFO: rc: 1 Aug 18 11:33:55.557: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:33:56.286: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:33:56.554: INFO: rc: 1 Aug 18 11:33:56.555: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:33:57.284: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:33:57.559: INFO: rc: 1 Aug 18 11:33:57.559: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:33:58.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:33:58.557: INFO: rc: 1 Aug 18 11:33:58.557: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:33:59.284: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:33:59.550: INFO: rc: 1 Aug 18 11:33:59.550: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:34:00.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:34:00.558: INFO: rc: 1 Aug 18 11:34:00.558: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:34:01.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:34:01.564: INFO: rc: 1 Aug 18 11:34:01.564: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:34:02.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:34:02.575: INFO: rc: 1 Aug 18 11:34:02.575: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:34:03.286: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:34:03.594: INFO: rc: 1 Aug 18 11:34:03.595: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:34:04.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:34:04.556: INFO: rc: 1 Aug 18 11:34:04.557: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:34:05.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:34:05.555: INFO: rc: 1 Aug 18 11:34:05.555: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:34:06.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:34:06.557: INFO: rc: 1 Aug 18 11:34:06.557: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:34:07.284: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:34:07.585: INFO: rc: 1 Aug 18 11:34:07.585: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:34:08.284: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:34:08.561: INFO: rc: 1 Aug 18 11:34:08.561: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:34:09.284: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:34:09.565: INFO: rc: 1 Aug 18 11:34:09.565: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:34:10.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:34:10.552: INFO: rc: 1 Aug 18 11:34:10.552: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:34:11.286: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:34:11.555: INFO: rc: 1 Aug 18 11:34:11.555: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:34:12.286: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:34:12.549: INFO: rc: 1 Aug 18 11:34:12.549: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:34:13.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:34:13.801: INFO: rc: 1 Aug 18 11:34:13.802: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:34:14.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:34:14.574: INFO: rc: 1 Aug 18 11:34:14.574: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:34:15.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:34:15.916: INFO: rc: 1 Aug 18 11:34:15.916: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:34:16.284: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:34:16.546: INFO: rc: 1 Aug 18 11:34:16.546: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:34:17.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:34:17.557: INFO: rc: 1 Aug 18 11:34:17.557: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:34:18.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:34:18.650: INFO: rc: 1 Aug 18 11:34:18.650: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:34:19.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:34:19.595: INFO: rc: 1 Aug 18 11:34:19.595: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:34:20.286: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:34:20.571: INFO: rc: 1 Aug 18 11:34:20.571: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:34:21.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:34:21.533: INFO: rc: 1 Aug 18 11:34:21.533: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:34:22.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:34:22.667: INFO: rc: 1 Aug 18 11:34:22.667: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:34:23.286: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:34:23.541: INFO: rc: 1 Aug 18 11:34:23.541: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:34:24.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:34:24.533: INFO: rc: 1 Aug 18 11:34:24.533: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:34:25.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:34:25.538: INFO: rc: 1 Aug 18 11:34:25.538: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:34:26.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:34:26.572: INFO: rc: 1 Aug 18 11:34:26.572: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:34:27.286: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:34:27.582: INFO: rc: 1 Aug 18 11:34:27.582: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:34:28.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:34:28.544: INFO: rc: 1 Aug 18 11:34:28.544: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:34:29.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:34:29.537: INFO: rc: 1 Aug 18 11:34:29.537: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:34:30.286: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:34:30.550: INFO: rc: 1 Aug 18 11:34:30.550: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:34:31.286: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:34:31.562: INFO: rc: 1 Aug 18 11:34:31.562: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:34:31.562: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555' Aug 18 11:34:31.828: INFO: rc: 1 Aug 18 11:34:31.828: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2642 exec execpod-affinityrr59g -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32555: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32555 nc: connect to 10.10.190.207 port 32555 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:34:31.829: FAIL: Unexpected error: <*errors.errorString | 0xc005eb4dd0>: { s: "service is not reachable within 2m0s timeout on endpoint 10.10.190.207:32555 over TCP protocol", } service is not reachable within 2m0s timeout on endpoint 10.10.190.207:32555 over TCP protocol occurred Full Stack Trace k8s.io/kubernetes/test/e2e/network.execAffinityTestForNonLBServiceWithOptionalTransition(0xc001a91ce0, 0x5410260, 0xc0011bf080, 0xc001029200, 0x1) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:3511 +0x62e k8s.io/kubernetes/test/e2e/network.execAffinityTestForNonLBServiceWithTransition(...) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:3466 k8s.io/kubernetes/test/e2e/network.glob..func24.30() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:2541 +0xa5 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc001880c00) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc001880c00) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc001880c00, 0x4deb2c0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 Aug 18 11:34:31.830: INFO: Cleaning up the exec pod STEP: deleting ReplicationController affinity-nodeport-transition in namespace services-2642, will wait for the garbage collector to delete the pods Aug 18 11:34:31.897: INFO: Deleting ReplicationController affinity-nodeport-transition took: 5.155372ms Aug 18 11:34:32.598: INFO: Terminating ReplicationController affinity-nodeport-transition pods took: 700.392219ms [AfterEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "services-2642". STEP: Found 32 events. Aug 18 11:34:41.216: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for affinity-nodeport-transition-7hhl7: { } Scheduled: Successfully assigned services-2642/affinity-nodeport-transition-7hhl7 to node1 Aug 18 11:34:41.216: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for affinity-nodeport-transition-v84k6: { } Scheduled: Successfully assigned services-2642/affinity-nodeport-transition-v84k6 to node2 Aug 18 11:34:41.216: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for affinity-nodeport-transition-w7b49: { } Scheduled: Successfully assigned services-2642/affinity-nodeport-transition-w7b49 to node1 Aug 18 11:34:41.216: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for execpod-affinityrr59g: { } Scheduled: Successfully assigned services-2642/execpod-affinityrr59g to node2 Aug 18 11:34:41.216: INFO: At 2021-08-18 11:32:19 +0000 UTC - event for affinity-nodeport-transition: {replication-controller } SuccessfulCreate: Created pod: affinity-nodeport-transition-w7b49 Aug 18 11:34:41.216: INFO: At 2021-08-18 11:32:19 +0000 UTC - event for affinity-nodeport-transition: {replication-controller } SuccessfulCreate: Created pod: affinity-nodeport-transition-7hhl7 Aug 18 11:34:41.216: INFO: At 2021-08-18 11:32:19 +0000 UTC - event for affinity-nodeport-transition: {replication-controller } SuccessfulCreate: Created pod: affinity-nodeport-transition-v84k6 Aug 18 11:34:41.216: INFO: At 2021-08-18 11:32:20 +0000 UTC - event for affinity-nodeport-transition-v84k6: {kubelet node2} Pulling: Pulling image "k8s.gcr.io/e2e-test-images/agnhost:2.20" Aug 18 11:34:41.216: INFO: At 2021-08-18 11:32:20 +0000 UTC - event for affinity-nodeport-transition-v84k6: {multus } AddedInterface: Add eth0 [10.244.3.10/24] Aug 18 11:34:41.216: INFO: At 2021-08-18 11:32:21 +0000 UTC - event for affinity-nodeport-transition-v84k6: {kubelet node2} Started: Started container affinity-nodeport-transition Aug 18 11:34:41.216: INFO: At 2021-08-18 11:32:21 +0000 UTC - event for affinity-nodeport-transition-v84k6: {kubelet node2} Pulled: Successfully pulled image "k8s.gcr.io/e2e-test-images/agnhost:2.20" in 546.01981ms Aug 18 11:34:41.216: INFO: At 2021-08-18 11:32:21 +0000 UTC - event for affinity-nodeport-transition-v84k6: {kubelet node2} Created: Created container affinity-nodeport-transition Aug 18 11:34:41.216: INFO: At 2021-08-18 11:32:21 +0000 UTC - event for affinity-nodeport-transition-w7b49: {multus } AddedInterface: Add eth0 [10.244.4.15/24] Aug 18 11:34:41.216: INFO: At 2021-08-18 11:32:21 +0000 UTC - event for affinity-nodeport-transition-w7b49: {kubelet node1} Pulling: Pulling image "k8s.gcr.io/e2e-test-images/agnhost:2.20" Aug 18 11:34:41.216: INFO: At 2021-08-18 11:32:22 +0000 UTC - event for affinity-nodeport-transition-7hhl7: {kubelet node1} Pulled: Successfully pulled image "k8s.gcr.io/e2e-test-images/agnhost:2.20" in 864.37287ms Aug 18 11:34:41.216: INFO: At 2021-08-18 11:32:22 +0000 UTC - event for affinity-nodeport-transition-7hhl7: {multus } AddedInterface: Add eth0 [10.244.4.16/24] Aug 18 11:34:41.216: INFO: At 2021-08-18 11:32:22 +0000 UTC - event for affinity-nodeport-transition-7hhl7: {kubelet node1} Pulling: Pulling image "k8s.gcr.io/e2e-test-images/agnhost:2.20" Aug 18 11:34:41.216: INFO: At 2021-08-18 11:32:22 +0000 UTC - event for affinity-nodeport-transition-w7b49: {kubelet node1} Pulled: Successfully pulled image "k8s.gcr.io/e2e-test-images/agnhost:2.20" in 918.018397ms Aug 18 11:34:41.216: INFO: At 2021-08-18 11:32:22 +0000 UTC - event for affinity-nodeport-transition-w7b49: {kubelet node1} Created: Created container affinity-nodeport-transition Aug 18 11:34:41.216: INFO: At 2021-08-18 11:32:22 +0000 UTC - event for affinity-nodeport-transition-w7b49: {kubelet node1} Started: Started container affinity-nodeport-transition Aug 18 11:34:41.216: INFO: At 2021-08-18 11:32:23 +0000 UTC - event for affinity-nodeport-transition-7hhl7: {kubelet node1} Started: Started container affinity-nodeport-transition Aug 18 11:34:41.216: INFO: At 2021-08-18 11:32:23 +0000 UTC - event for affinity-nodeport-transition-7hhl7: {kubelet node1} Created: Created container affinity-nodeport-transition Aug 18 11:34:41.216: INFO: At 2021-08-18 11:32:27 +0000 UTC - event for execpod-affinityrr59g: {multus } AddedInterface: Add eth0 [10.244.3.13/24] Aug 18 11:34:41.216: INFO: At 2021-08-18 11:32:27 +0000 UTC - event for execpod-affinityrr59g: {kubelet node2} Pulling: Pulling image "k8s.gcr.io/e2e-test-images/agnhost:2.20" Aug 18 11:34:41.216: INFO: At 2021-08-18 11:32:28 +0000 UTC - event for execpod-affinityrr59g: {kubelet node2} Pulled: Successfully pulled image "k8s.gcr.io/e2e-test-images/agnhost:2.20" in 528.850314ms Aug 18 11:34:41.216: INFO: At 2021-08-18 11:32:28 +0000 UTC - event for execpod-affinityrr59g: {kubelet node2} Started: Started container agnhost-container Aug 18 11:34:41.216: INFO: At 2021-08-18 11:32:28 +0000 UTC - event for execpod-affinityrr59g: {kubelet node2} Created: Created container agnhost-container Aug 18 11:34:41.216: INFO: At 2021-08-18 11:34:31 +0000 UTC - event for execpod-affinityrr59g: {kubelet node2} Killing: Stopping container agnhost-container Aug 18 11:34:41.216: INFO: At 2021-08-18 11:34:32 +0000 UTC - event for affinity-nodeport-transition: {endpoint-controller } FailedToUpdateEndpoint: Failed to update endpoint services-2642/affinity-nodeport-transition: Operation cannot be fulfilled on endpoints "affinity-nodeport-transition": the object has been modified; please apply your changes to the latest version and try again Aug 18 11:34:41.216: INFO: At 2021-08-18 11:34:32 +0000 UTC - event for affinity-nodeport-transition-7hhl7: {kubelet node1} Killing: Stopping container affinity-nodeport-transition Aug 18 11:34:41.216: INFO: At 2021-08-18 11:34:32 +0000 UTC - event for affinity-nodeport-transition-v84k6: {kubelet node2} Killing: Stopping container affinity-nodeport-transition Aug 18 11:34:41.216: INFO: At 2021-08-18 11:34:32 +0000 UTC - event for affinity-nodeport-transition-w7b49: {kubelet node1} Killing: Stopping container affinity-nodeport-transition Aug 18 11:34:41.218: INFO: POD NODE PHASE GRACE CONDITIONS Aug 18 11:34:41.218: INFO: Aug 18 11:34:41.222: INFO: Logging node info for node master1 Aug 18 11:34:41.224: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 ebb211fa-503f-4cfe-b1ed-c95d27a70e6e 63539 0 2021-08-18 08:20:52 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"3a:82:be:72:b5:15"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:20:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:20:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:25:59 +0000 UTC,LastTransitionTime:2021-08-18 08:25:59 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:34:34 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:34:34 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:34:34 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:34:34 +0000 UTC,LastTransitionTime:2021-08-18 08:25:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:58c3e57359b641ad92fa1959f2fecf5d,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:012cd796-2076-45d6-8b14-d3e0451b1e64,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[@ :],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:34:41.225: INFO: Logging kubelet events for node master1 Aug 18 11:34:41.227: INFO: Logging pods the kubelet thinks is on node master1 Aug 18 11:34:41.240: INFO: kube-controller-manager-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:41.240: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:34:41.240: INFO: kube-multus-ds-amd64-kbcp6 started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:41.240: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:34:41.240: INFO: docker-registry-docker-registry-56cbc7bc58-49kl2 started at 2021-08-18 08:26:23 +0000 UTC (0+2 container statuses recorded) Aug 18 11:34:41.240: INFO: Container docker-registry ready: true, restart count 0 Aug 18 11:34:41.240: INFO: Container nginx ready: true, restart count 0 Aug 18 11:34:41.240: INFO: node-exporter-5hwz9 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:34:41.240: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:34:41.240: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:34:41.240: INFO: kube-apiserver-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:41.240: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:34:41.240: INFO: kube-proxy-vqk4v started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:41.240: INFO: Container kube-proxy ready: true, restart count 1 Aug 18 11:34:41.240: INFO: kube-flannel-q64cq started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:34:41.240: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:34:41.240: INFO: Container kube-flannel ready: true, restart count 3 Aug 18 11:34:41.240: INFO: coredns-7677f9bb54-kn2qg started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:41.240: INFO: Container coredns ready: true, restart count 2 Aug 18 11:34:41.240: INFO: kube-scheduler-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:41.240: INFO: Container kube-scheduler ready: true, restart count 0 W0818 11:34:41.251877 26 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:34:41.284: INFO: Latency metrics for node master1 Aug 18 11:34:41.284: INFO: Logging node info for node master2 Aug 18 11:34:41.287: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 78946293-3abe-4442-84d4-8ed6b1d15ce0 63517 0 2021-08-18 08:21:31 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"7e:f5:c2:cc:3a:b4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:21:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:21:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-08-18 08:29:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:34:32 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:34:32 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:34:32 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:34:32 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0c44122c7a7248c18d8571e1cc667258,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:0cd329f2-48e0-4c8f-b8b9-fa3ae0ed8406,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:34:41.287: INFO: Logging kubelet events for node master2 Aug 18 11:34:41.289: INFO: Logging pods the kubelet thinks is on node master2 Aug 18 11:34:41.303: INFO: kube-apiserver-master2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:41.303: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:34:41.303: INFO: kube-scheduler-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:41.303: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:34:41.303: INFO: kube-multus-ds-amd64-mld8g started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:41.303: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:34:41.303: INFO: dns-autoscaler-5b7b5c9b6f-hh47r started at 2021-08-18 08:23:57 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:41.303: INFO: Container autoscaler ready: true, restart count 2 Aug 18 11:34:41.303: INFO: node-feature-discovery-controller-5bf5c49849-mq57c started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:41.303: INFO: Container nfd-controller ready: true, restart count 0 Aug 18 11:34:41.303: INFO: node-exporter-48nfx started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:34:41.303: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:34:41.303: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:34:41.303: INFO: kube-controller-manager-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:41.303: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:34:41.303: INFO: kube-proxy-kh2l9 started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:41.303: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:34:41.303: INFO: kube-flannel-pp56h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:34:41.303: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:34:41.303: INFO: Container kube-flannel ready: true, restart count 1 W0818 11:34:41.316450 26 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:34:41.347: INFO: Latency metrics for node master2 Aug 18 11:34:41.347: INFO: Logging node info for node master3 Aug 18 11:34:41.350: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 44feac2b-9447-4be2-9fcd-62f836d67c72 63639 0 2021-08-18 08:21:41 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"86:e4:31:99:58:40"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {kubelet Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:34:38 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:34:38 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:34:38 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:34:38 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1fae19ae59884c44899bcd08aa243244,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:5db926c5-6530-4635-a0d5-806974a3b732,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:34:41.350: INFO: Logging kubelet events for node master3 Aug 18 11:34:41.352: INFO: Logging pods the kubelet thinks is on node master3 Aug 18 11:34:41.365: INFO: kube-controller-manager-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:41.366: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:34:41.366: INFO: kube-scheduler-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:41.366: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:34:41.366: INFO: kube-apiserver-master3 started at 2021-08-18 08:29:12 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:41.366: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:34:41.366: INFO: kube-proxy-sd5lc started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:41.366: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:34:41.366: INFO: kube-flannel-x6tlr started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:34:41.366: INFO: Init container install-cni ready: true, restart count 1 Aug 18 11:34:41.366: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:34:41.366: INFO: kube-multus-ds-amd64-bkw6c started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:41.366: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:34:41.366: INFO: coredns-7677f9bb54-5hxfh started at 2021-08-18 08:23:54 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:41.366: INFO: Container coredns ready: true, restart count 1 Aug 18 11:34:41.366: INFO: node-exporter-vq7d8 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:34:41.366: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:34:41.366: INFO: Container node-exporter ready: true, restart count 0 W0818 11:34:41.385789 26 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:34:41.416: INFO: Latency metrics for node master3 Aug 18 11:34:41.416: INFO: Logging node info for node node1 Aug 18 11:34:41.419: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 84defabd-6ebf-43ec-a629-44c6713da9c9 63452 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"9a:87:55:36:7b:df"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:13 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:35 +0000 UTC,LastTransitionTime:2021-08-18 08:26:35 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:34:31 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:34:31 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:34:31 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:34:31 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:69946ff2b7bc462fa25eb7adb4703c23,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:736dc52f-f5e3-494e-86ca-01eedbea015c,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:a7cea43d9d2f67c38fbf0407786edbe660ee9072945f7bb272b55fd255e8eaca opnfv/barometer-collectd:stable],SizeBytes:1075746799,},ContainerImage{Names:[@ :],SizeBytes:1003788820,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[aquasec/kube-hunter@sha256:2be6820bc1d7e0f57193a9a27d5a3e16b2fd93c53747b03ce8ca48c6fc323781 aquasec/kube-hunter:0.3.1],SizeBytes:347611549,},ContainerImage{Names:[golang@sha256:db2475a1dbb2149508e5db31d7d77a75e6600d54be645f37681f03f2762169ba golang:alpine3.12],SizeBytes:301186719,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:de25c7fc6c4f3a27c7f0c2dff454e4671823a34d88abd533f210848d527e0fbb alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:34:41.420: INFO: Logging kubelet events for node node1 Aug 18 11:34:41.423: INFO: Logging pods the kubelet thinks is on node node1 Aug 18 11:34:41.440: INFO: ss2-0 started at 2021-08-18 11:26:45 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:41.440: INFO: Container webserver ready: true, restart count 0 Aug 18 11:34:41.440: INFO: kube-proxy-p6jvp started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:41.440: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:34:41.440: INFO: kubernetes-metrics-scraper-678c97765c-9nsv5 started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:41.440: INFO: Container kubernetes-metrics-scraper ready: true, restart count 2 Aug 18 11:34:41.440: INFO: cmk-init-discover-node1-bxznx started at 2021-08-18 08:32:10 +0000 UTC (0+3 container statuses recorded) Aug 18 11:34:41.440: INFO: Container discover ready: false, restart count 0 Aug 18 11:34:41.440: INFO: Container init ready: false, restart count 0 Aug 18 11:34:41.440: INFO: Container install ready: false, restart count 0 Aug 18 11:34:41.440: INFO: cmk-d8r27 started at 2021-08-18 08:32:52 +0000 UTC (0+2 container statuses recorded) Aug 18 11:34:41.440: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:34:41.440: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:34:41.440: INFO: collectd-xdprr started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:34:41.440: INFO: Container collectd ready: true, restart count 0 Aug 18 11:34:41.440: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:34:41.440: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:34:41.440: INFO: nginx-proxy-node1 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:41.440: INFO: Container nginx-proxy ready: true, restart count 2 Aug 18 11:34:41.440: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-vsxvg started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:41.440: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:34:41.440: INFO: fail-once-local-8rxnh started at 2021-08-18 11:34:14 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:41.440: INFO: Container c ready: false, restart count 0 Aug 18 11:34:41.440: INFO: pod-update-activedeadlineseconds-2e72b8c4-086d-4288-89a4-b11d1b093416 started at 2021-08-18 11:34:21 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:41.440: INFO: Container nginx ready: false, restart count 0 Aug 18 11:34:41.440: INFO: kube-flannel-q78nd started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:34:41.440: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:34:41.440: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:34:41.440: INFO: prometheus-k8s-0 started at 2021-08-18 08:34:03 +0000 UTC (0+5 container statuses recorded) Aug 18 11:34:41.440: INFO: Container custom-metrics-apiserver ready: true, restart count 0 Aug 18 11:34:41.440: INFO: Container grafana ready: true, restart count 0 Aug 18 11:34:41.440: INFO: Container prometheus ready: true, restart count 1 Aug 18 11:34:41.440: INFO: Container prometheus-config-reloader ready: true, restart count 0 Aug 18 11:34:41.440: INFO: Container rules-configmap-reloader ready: true, restart count 0 Aug 18 11:34:41.440: INFO: test-rolling-update-controller-wx48f started at 2021-08-18 11:29:47 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:41.440: INFO: Container httpd ready: false, restart count 0 Aug 18 11:34:41.440: INFO: ss2-1 started at 2021-08-18 11:26:31 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:41.440: INFO: Container webserver ready: true, restart count 0 Aug 18 11:34:41.440: INFO: netserver-0 started at 2021-08-18 11:34:38 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:41.440: INFO: Container webserver ready: false, restart count 0 Aug 18 11:34:41.440: INFO: kube-multus-ds-amd64-rrvmb started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:41.440: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:34:41.440: INFO: node-feature-discovery-worker-pflgw started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:41.440: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:34:41.440: INFO: node-exporter-kcwvn started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:34:41.440: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:34:41.440: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:34:41.440: INFO: ss2-0 started at 2021-08-18 11:32:47 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:41.440: INFO: Container webserver ready: false, restart count 0 Aug 18 11:34:41.440: INFO: pod-logs-websocket-d8642f34-1a3a-44bb-86fd-c0e2f884df31 started at 2021-08-18 11:32:11 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:41.440: INFO: Container main ready: false, restart count 0 W0818 11:34:41.453126 26 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:34:41.506: INFO: Latency metrics for node node1 Aug 18 11:34:41.506: INFO: Logging node info for node node2 Aug 18 11:34:41.508: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 1d01177e-3dbb-48a1-a0bc-d18af27ab7f8 63457 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:d1:47:f8:1d:22"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:36 +0000 UTC,LastTransitionTime:2021-08-18 08:26:36 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:34:31 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:34:31 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:34:31 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:34:31 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:dc1f286135c145349b8a016880b65a2f,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:037e7e2d-94e9-42f4-a719-896e5005ac70,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:34:41.510: INFO: Logging kubelet events for node node2 Aug 18 11:34:41.512: INFO: Logging pods the kubelet thinks is on node node2 Aug 18 11:34:41.526: INFO: test-cleanup-controller-vzf4r started at 2021-08-18 11:32:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:41.526: INFO: Container httpd ready: false, restart count 0 Aug 18 11:34:41.526: INFO: nginx-proxy-node2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:41.526: INFO: Container nginx-proxy ready: true, restart count 1 Aug 18 11:34:41.526: INFO: cmk-init-discover-node2-6b2kz started at 2021-08-18 08:32:30 +0000 UTC (0+3 container statuses recorded) Aug 18 11:34:41.526: INFO: Container discover ready: false, restart count 0 Aug 18 11:34:41.526: INFO: Container init ready: false, restart count 0 Aug 18 11:34:41.526: INFO: Container install ready: false, restart count 0 Aug 18 11:34:41.526: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-7rn45 started at 2021-08-18 08:36:42 +0000 UTC (0+2 container statuses recorded) Aug 18 11:34:41.526: INFO: Container tas-controller ready: true, restart count 0 Aug 18 11:34:41.526: INFO: Container tas-extender ready: true, restart count 0 Aug 18 11:34:41.526: INFO: ss2-2 started at 2021-08-18 11:27:31 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:41.526: INFO: Container webserver ready: false, restart count 0 Aug 18 11:34:41.526: INFO: fail-once-local-pk5cs started at 2021-08-18 11:34:14 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:41.526: INFO: Container c ready: false, restart count 0 Aug 18 11:34:41.526: INFO: kubernetes-dashboard-86c6f9df5b-qrtdk started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:41.526: INFO: Container kubernetes-dashboard ready: true, restart count 2 Aug 18 11:34:41.526: INFO: cmk-748rz started at 2021-08-18 08:32:53 +0000 UTC (0+2 container statuses recorded) Aug 18 11:34:41.526: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:34:41.526: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:34:41.526: INFO: kube-proxy-qkj9c started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:41.526: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:34:41.526: INFO: node-feature-discovery-worker-hzpf5 started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:41.526: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:34:41.526: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-c82pt started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:41.526: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:34:41.526: INFO: prometheus-operator-5bb8cb9d8f-k97ws started at 2021-08-18 08:33:38 +0000 UTC (0+2 container statuses recorded) Aug 18 11:34:41.526: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:34:41.526: INFO: Container prometheus-operator ready: true, restart count 0 Aug 18 11:34:41.526: INFO: netserver-1 started at 2021-08-18 11:34:38 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:41.526: INFO: Container webserver ready: false, restart count 0 Aug 18 11:34:41.526: INFO: kube-multus-ds-amd64-rvzsg started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:41.526: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:34:41.526: INFO: collectd-67ntq started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:34:41.526: INFO: Container collectd ready: true, restart count 0 Aug 18 11:34:41.526: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:34:41.526: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:34:41.526: INFO: downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a started at 2021-08-18 11:31:01 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:41.526: INFO: Container dapi-container ready: false, restart count 0 Aug 18 11:34:41.526: INFO: cmk-webhook-6c9d5f8578-7cxjr started at 2021-08-18 08:32:53 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:41.526: INFO: Container cmk-webhook ready: true, restart count 0 Aug 18 11:34:41.526: INFO: kube-flannel-h7t5h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:34:41.526: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:34:41.526: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:34:41.526: INFO: node-exporter-lrrf2 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:34:41.526: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:34:41.526: INFO: Container node-exporter ready: true, restart count 0 W0818 11:34:41.540928 26 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:34:41.573: INFO: Latency metrics for node node2 Aug 18 11:34:41.573: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "services-2642" for this suite. [AfterEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:786 • Failure [142.211 seconds] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/framework.go:23 should be able to switch session affinity for NodePort service [LinuxOnly] [Conformance] [It] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:34:31.829: Unexpected error: <*errors.errorString | 0xc005eb4dd0>: { s: "service is not reachable within 2m0s timeout on endpoint 10.10.190.207:32555 over TCP protocol", } service is not reachable within 2m0s timeout on endpoint 10.10.190.207:32555 over TCP protocol occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:3511 ------------------------------ {"msg":"FAILED [sig-network] Services should be able to switch session affinity for NodePort service [LinuxOnly] [Conformance]","total":-1,"completed":11,"skipped":189,"failed":2,"failures":["[sig-apps] Deployment deployment should support rollover [Conformance]","[sig-network] Services should be able to switch session affinity for NodePort service [LinuxOnly] [Conformance]"]} [BeforeEach] [sig-storage] Projected configMap /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:34:41.592: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename projected STEP: Waiting for a default service account to be provisioned in namespace [It] should be consumable from pods in volume with mappings as non-root [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating configMap with name projected-configmap-test-volume-map-c31ca54d-e17f-47c4-ba5f-547d5f533dea STEP: Creating a pod to test consume configMaps Aug 18 11:34:41.626: INFO: Waiting up to 5m0s for pod "pod-projected-configmaps-5218a7f3-4b58-45be-8434-7f4a662f8968" in namespace "projected-202" to be "Succeeded or Failed" Aug 18 11:34:41.629: INFO: Pod "pod-projected-configmaps-5218a7f3-4b58-45be-8434-7f4a662f8968": Phase="Pending", Reason="", readiness=false. Elapsed: 2.628191ms Aug 18 11:34:43.633: INFO: Pod "pod-projected-configmaps-5218a7f3-4b58-45be-8434-7f4a662f8968": Phase="Pending", Reason="", readiness=false. Elapsed: 2.006675576s Aug 18 11:34:45.636: INFO: Pod "pod-projected-configmaps-5218a7f3-4b58-45be-8434-7f4a662f8968": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.010190744s STEP: Saw pod success Aug 18 11:34:45.636: INFO: Pod "pod-projected-configmaps-5218a7f3-4b58-45be-8434-7f4a662f8968" satisfied condition "Succeeded or Failed" Aug 18 11:34:45.639: INFO: Trying to get logs from node node2 pod pod-projected-configmaps-5218a7f3-4b58-45be-8434-7f4a662f8968 container projected-configmap-volume-test: STEP: delete the pod Aug 18 11:34:45.653: INFO: Waiting for pod pod-projected-configmaps-5218a7f3-4b58-45be-8434-7f4a662f8968 to disappear Aug 18 11:34:45.655: INFO: Pod pod-projected-configmaps-5218a7f3-4b58-45be-8434-7f4a662f8968 no longer exists [AfterEach] [sig-storage] Projected configMap /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:34:45.655: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "projected-202" for this suite. • ------------------------------ {"msg":"PASSED [sig-storage] Projected configMap should be consumable from pods in volume with mappings as non-root [NodeConformance] [Conformance]","total":-1,"completed":12,"skipped":189,"failed":2,"failures":["[sig-apps] Deployment deployment should support rollover [Conformance]","[sig-network] Services should be able to switch session affinity for NodePort service [LinuxOnly] [Conformance]"]} S ------------------------------ [BeforeEach] [sig-apps] Deployment /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:29:47.114: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename deployment STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-apps] Deployment /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/deployment.go:78 [It] RollingUpdateDeployment should delete old pods and create new ones [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:29:47.135: INFO: Creating replica set "test-rolling-update-controller" (going to be adopted) Aug 18 11:29:47.142: INFO: Pod name sample-pod: Found 0 pods out of 1 Aug 18 11:29:52.147: INFO: Pod name sample-pod: Found 1 pods out of 1 STEP: ensuring each pod is running Aug 18 11:34:52.155: FAIL: error in waiting for pods to come up: failed to wait for pods running: [timed out waiting for the condition] Unexpected error: <*errors.errorString | 0xc002ec8c50>: { s: "failed to wait for pods running: [timed out waiting for the condition]", } failed to wait for pods running: [timed out waiting for the condition] occurred Full Stack Trace k8s.io/kubernetes/test/e2e/apps.testRollingUpdateDeployment(0xc000bc6dc0) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/deployment.go:289 +0x608 k8s.io/kubernetes/test/e2e/apps.glob..func4.4() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/deployment.go:92 +0x2a k8s.io/kubernetes/test/e2e.RunE2ETests(0xc003602780) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc003602780) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc003602780, 0x4deb2c0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [sig-apps] Deployment /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/deployment.go:72 Aug 18 11:34:52.160: INFO: Log out all the ReplicaSets if there is no deployment created Aug 18 11:34:52.163: INFO: ReplicaSet "test-rolling-update-controller": &ReplicaSet{ObjectMeta:{test-rolling-update-controller deployment-3143 /apis/apps/v1/namespaces/deployment-3143/replicasets/test-rolling-update-controller 03ff4c42-9d34-47a3-955b-80940eb5ec7e 59141 1 2021-08-18 11:29:47 +0000 UTC map[name:sample-pod pod:httpd] map[deployment.kubernetes.io/revision:3546343826724305832] [] [] [{e2e.test Update apps/v1 2021-08-18 11:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:deployment.kubernetes.io/revision":{}},"f:labels":{".":{},"f:name":{},"f:pod":{}}},"f:spec":{"f:replicas":{},"f:selector":{"f:matchLabels":{".":{},"f:name":{},"f:pod":{}}},"f:template":{"f:metadata":{"f:labels":{".":{},"f:name":{},"f:pod":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"httpd\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}}}} {kube-controller-manager Update apps/v1 2021-08-18 11:29:47 +0000 UTC FieldsV1 {"f:status":{"f:fullyLabeledReplicas":{},"f:observedGeneration":{},"f:replicas":{}}}}]},Spec:ReplicaSetSpec{Replicas:*1,Selector:&v1.LabelSelector{MatchLabels:map[string]string{name: sample-pod,pod: httpd,},MatchExpressions:[]LabelSelectorRequirement{},},Template:{{ 0 0001-01-01 00:00:00 +0000 UTC map[name:sample-pod pod:httpd] map[] [] [] []} {[] [] [{httpd docker.io/library/httpd:2.4.38-alpine [] [] [] [] [] {map[] map[]} [] [] nil nil nil nil /dev/termination-log File IfNotPresent nil false false false}] [] Always 0xc00410c9f8 ClusterFirst map[] false false false PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,} [] nil default-scheduler [] [] nil [] map[] [] }},MinReadySeconds:0,},Status:ReplicaSetStatus{Replicas:1,FullyLabeledReplicas:1,ObservedGeneration:1,ReadyReplicas:0,AvailableReplicas:0,Conditions:[]ReplicaSetCondition{},},} Aug 18 11:34:52.167: INFO: pod: "test-rolling-update-controller-wx48f": &Pod{ObjectMeta:{test-rolling-update-controller-wx48f test-rolling-update-controller- deployment-3143 /api/v1/namespaces/deployment-3143/pods/test-rolling-update-controller-wx48f c093a820-ed68-4131-9e11-55f67a752f71 62914 0 2021-08-18 11:29:47 +0000 UTC map[name:sample-pod pod:httpd] map[k8s.v1.cni.cncf.io/network-status:[{ "name": "default-cni-network", "interface": "eth0", "ips": [ "10.244.4.3" ], "mac": "4a:af:37:d9:5c:97", "default": true, "dns": {} }] k8s.v1.cni.cncf.io/networks-status:[{ "name": "default-cni-network", "interface": "eth0", "ips": [ "10.244.4.3" ], "mac": "4a:af:37:d9:5c:97", "default": true, "dns": {} }] kubernetes.io/psp:collectd] [{apps/v1 ReplicaSet test-rolling-update-controller 03ff4c42-9d34-47a3-955b-80940eb5ec7e 0xc00410cd57 0xc00410cd58}] [] [{kube-controller-manager Update v1 2021-08-18 11:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:name":{},"f:pod":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"03ff4c42-9d34-47a3-955b-80940eb5ec7e\"}":{".":{},"f:apiVersion":{},"f:blockOwnerDeletion":{},"f:controller":{},"f:kind":{},"f:name":{},"f:uid":{}}}},"f:spec":{"f:containers":{"k:{\"name\":\"httpd\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}} {multus Update v1 2021-08-18 11:29:48 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:k8s.v1.cni.cncf.io/network-status":{},"f:k8s.v1.cni.cncf.io/networks-status":{}}}}} {kubelet Update v1 2021-08-18 11:29:50 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:podIP":{},"f:podIPs":{".":{},"k:{\"ip\":\"10.244.4.3\"}":{".":{},"f:ip":{}}},"f:startTime":{}}}}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:default-token-kvrdz,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:&SecretVolumeSource{SecretName:default-token-kvrdz,Items:[]KeyToPath{},DefaultMode:*420,Optional:nil,},NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:httpd,Image:docker.io/library/httpd:2.4.38-alpine,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:default-token-kvrdz,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:Always,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*0,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:node1,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,},Status:PodStatus{Phase:Pending,Conditions:[]PodCondition{PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-08-18 11:29:47 +0000 UTC,Reason:,Message:,},PodCondition{Type:Ready,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-08-18 11:29:47 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:ContainersReady,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-08-18 11:29:47 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-08-18 11:29:47 +0000 UTC,Reason:,Message:,},},Message:,Reason:,HostIP:10.10.190.207,PodIP:10.244.4.3,StartTime:2021-08-18 11:29:47 +0000 UTC,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:httpd,State:ContainerState{Waiting:&ContainerStateWaiting{Reason:ImagePullBackOff,Message:Back-off pulling image "docker.io/library/httpd:2.4.38-alpine",},Running:nil,Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:false,RestartCount:0,Image:docker.io/library/httpd:2.4.38-alpine,ImageID:,ContainerID:,Started:*false,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{PodIP{IP:10.244.4.3,},},EphemeralContainerStatuses:[]ContainerStatus{},},} [AfterEach] [sig-apps] Deployment /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "deployment-3143". STEP: Found 8 events. Aug 18 11:34:52.169: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for test-rolling-update-controller-wx48f: { } Scheduled: Successfully assigned deployment-3143/test-rolling-update-controller-wx48f to node1 Aug 18 11:34:52.169: INFO: At 2021-08-18 11:29:47 +0000 UTC - event for test-rolling-update-controller: {replicaset-controller } SuccessfulCreate: Created pod: test-rolling-update-controller-wx48f Aug 18 11:34:52.169: INFO: At 2021-08-18 11:29:48 +0000 UTC - event for test-rolling-update-controller-wx48f: {kubelet node1} Pulling: Pulling image "docker.io/library/httpd:2.4.38-alpine" Aug 18 11:34:52.169: INFO: At 2021-08-18 11:29:48 +0000 UTC - event for test-rolling-update-controller-wx48f: {multus } AddedInterface: Add eth0 [10.244.4.3/24] Aug 18 11:34:52.169: INFO: At 2021-08-18 11:29:49 +0000 UTC - event for test-rolling-update-controller-wx48f: {kubelet node1} Failed: Failed to pull image "docker.io/library/httpd:2.4.38-alpine": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit Aug 18 11:34:52.169: INFO: At 2021-08-18 11:29:49 +0000 UTC - event for test-rolling-update-controller-wx48f: {kubelet node1} Failed: Error: ErrImagePull Aug 18 11:34:52.169: INFO: At 2021-08-18 11:29:50 +0000 UTC - event for test-rolling-update-controller-wx48f: {kubelet node1} BackOff: Back-off pulling image "docker.io/library/httpd:2.4.38-alpine" Aug 18 11:34:52.169: INFO: At 2021-08-18 11:29:50 +0000 UTC - event for test-rolling-update-controller-wx48f: {kubelet node1} Failed: Error: ImagePullBackOff Aug 18 11:34:52.172: INFO: POD NODE PHASE GRACE CONDITIONS Aug 18 11:34:52.172: INFO: test-rolling-update-controller-wx48f node1 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:29:47 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:29:47 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:29:47 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:29:47 +0000 UTC }] Aug 18 11:34:52.172: INFO: Aug 18 11:34:52.178: INFO: Logging node info for node master1 Aug 18 11:34:52.180: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 ebb211fa-503f-4cfe-b1ed-c95d27a70e6e 63722 0 2021-08-18 08:20:52 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"3a:82:be:72:b5:15"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:20:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:20:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:25:59 +0000 UTC,LastTransitionTime:2021-08-18 08:25:59 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:34:44 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:34:44 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:34:44 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:34:44 +0000 UTC,LastTransitionTime:2021-08-18 08:25:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:58c3e57359b641ad92fa1959f2fecf5d,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:012cd796-2076-45d6-8b14-d3e0451b1e64,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[@ :],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:34:52.181: INFO: Logging kubelet events for node master1 Aug 18 11:34:52.184: INFO: Logging pods the kubelet thinks is on node master1 Aug 18 11:34:52.207: INFO: kube-apiserver-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:52.207: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:34:52.207: INFO: kube-proxy-vqk4v started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:52.207: INFO: Container kube-proxy ready: true, restart count 1 Aug 18 11:34:52.207: INFO: kube-flannel-q64cq started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:34:52.207: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:34:52.207: INFO: Container kube-flannel ready: true, restart count 3 Aug 18 11:34:52.207: INFO: coredns-7677f9bb54-kn2qg started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:52.207: INFO: Container coredns ready: true, restart count 2 Aug 18 11:34:52.207: INFO: kube-scheduler-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:52.207: INFO: Container kube-scheduler ready: true, restart count 0 Aug 18 11:34:52.207: INFO: kube-controller-manager-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:52.207: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:34:52.207: INFO: kube-multus-ds-amd64-kbcp6 started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:52.207: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:34:52.207: INFO: docker-registry-docker-registry-56cbc7bc58-49kl2 started at 2021-08-18 08:26:23 +0000 UTC (0+2 container statuses recorded) Aug 18 11:34:52.207: INFO: Container docker-registry ready: true, restart count 0 Aug 18 11:34:52.207: INFO: Container nginx ready: true, restart count 0 Aug 18 11:34:52.207: INFO: node-exporter-5hwz9 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:34:52.207: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:34:52.207: INFO: Container node-exporter ready: true, restart count 0 W0818 11:34:52.224511 30 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:34:52.249: INFO: Latency metrics for node master1 Aug 18 11:34:52.249: INFO: Logging node info for node master2 Aug 18 11:34:52.252: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 78946293-3abe-4442-84d4-8ed6b1d15ce0 63708 0 2021-08-18 08:21:31 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"7e:f5:c2:cc:3a:b4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:21:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:21:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-08-18 08:29:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:34:42 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:34:42 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:34:42 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:34:42 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0c44122c7a7248c18d8571e1cc667258,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:0cd329f2-48e0-4c8f-b8b9-fa3ae0ed8406,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:34:52.252: INFO: Logging kubelet events for node master2 Aug 18 11:34:52.254: INFO: Logging pods the kubelet thinks is on node master2 Aug 18 11:34:52.265: INFO: kube-apiserver-master2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:52.265: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:34:52.265: INFO: kube-scheduler-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:52.265: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:34:52.265: INFO: kube-multus-ds-amd64-mld8g started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:52.265: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:34:52.265: INFO: dns-autoscaler-5b7b5c9b6f-hh47r started at 2021-08-18 08:23:57 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:52.265: INFO: Container autoscaler ready: true, restart count 2 Aug 18 11:34:52.265: INFO: node-feature-discovery-controller-5bf5c49849-mq57c started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:52.265: INFO: Container nfd-controller ready: true, restart count 0 Aug 18 11:34:52.265: INFO: node-exporter-48nfx started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:34:52.265: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:34:52.265: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:34:52.265: INFO: kube-controller-manager-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:52.265: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:34:52.265: INFO: kube-proxy-kh2l9 started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:52.265: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:34:52.265: INFO: kube-flannel-pp56h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:34:52.265: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:34:52.265: INFO: Container kube-flannel ready: true, restart count 1 W0818 11:34:52.278375 30 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:34:52.309: INFO: Latency metrics for node master2 Aug 18 11:34:52.309: INFO: Logging node info for node master3 Aug 18 11:34:52.313: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 44feac2b-9447-4be2-9fcd-62f836d67c72 63800 0 2021-08-18 08:21:41 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"86:e4:31:99:58:40"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {kubelet Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:34:48 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:34:48 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:34:48 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:34:48 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1fae19ae59884c44899bcd08aa243244,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:5db926c5-6530-4635-a0d5-806974a3b732,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:34:52.314: INFO: Logging kubelet events for node master3 Aug 18 11:34:52.316: INFO: Logging pods the kubelet thinks is on node master3 Aug 18 11:34:52.324: INFO: coredns-7677f9bb54-5hxfh started at 2021-08-18 08:23:54 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:52.324: INFO: Container coredns ready: true, restart count 1 Aug 18 11:34:52.324: INFO: node-exporter-vq7d8 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:34:52.324: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:34:52.324: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:34:52.324: INFO: kube-controller-manager-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:52.324: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:34:52.325: INFO: kube-scheduler-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:52.325: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:34:52.325: INFO: kube-apiserver-master3 started at 2021-08-18 08:29:12 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:52.325: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:34:52.325: INFO: kube-proxy-sd5lc started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:52.325: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:34:52.325: INFO: kube-flannel-x6tlr started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:34:52.325: INFO: Init container install-cni ready: true, restart count 1 Aug 18 11:34:52.325: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:34:52.325: INFO: kube-multus-ds-amd64-bkw6c started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:52.325: INFO: Container kube-multus ready: true, restart count 1 W0818 11:34:52.340950 30 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:34:52.367: INFO: Latency metrics for node master3 Aug 18 11:34:52.367: INFO: Logging node info for node node1 Aug 18 11:34:52.370: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 84defabd-6ebf-43ec-a629-44c6713da9c9 63830 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"9a:87:55:36:7b:df"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:13 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:35 +0000 UTC,LastTransitionTime:2021-08-18 08:26:35 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:34:51 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:34:51 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:34:51 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:34:51 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:69946ff2b7bc462fa25eb7adb4703c23,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:736dc52f-f5e3-494e-86ca-01eedbea015c,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:a7cea43d9d2f67c38fbf0407786edbe660ee9072945f7bb272b55fd255e8eaca opnfv/barometer-collectd:stable],SizeBytes:1075746799,},ContainerImage{Names:[@ :],SizeBytes:1003788820,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[aquasec/kube-hunter@sha256:2be6820bc1d7e0f57193a9a27d5a3e16b2fd93c53747b03ce8ca48c6fc323781 aquasec/kube-hunter:0.3.1],SizeBytes:347611549,},ContainerImage{Names:[golang@sha256:db2475a1dbb2149508e5db31d7d77a75e6600d54be645f37681f03f2762169ba golang:alpine3.12],SizeBytes:301186719,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:de25c7fc6c4f3a27c7f0c2dff454e4671823a34d88abd533f210848d527e0fbb alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:34:52.371: INFO: Logging kubelet events for node node1 Aug 18 11:34:52.374: INFO: Logging pods the kubelet thinks is on node node1 Aug 18 11:34:52.391: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-vsxvg started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:52.391: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:34:52.391: INFO: fail-once-local-8rxnh started at 2021-08-18 11:34:14 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:52.391: INFO: Container c ready: false, restart count 0 Aug 18 11:34:52.391: INFO: pod-update-activedeadlineseconds-2e72b8c4-086d-4288-89a4-b11d1b093416 started at 2021-08-18 11:34:21 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:52.391: INFO: Container nginx ready: false, restart count 0 Aug 18 11:34:52.391: INFO: nginx-proxy-node1 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:52.391: INFO: Container nginx-proxy ready: true, restart count 2 Aug 18 11:34:52.391: INFO: prometheus-k8s-0 started at 2021-08-18 08:34:03 +0000 UTC (0+5 container statuses recorded) Aug 18 11:34:52.391: INFO: Container custom-metrics-apiserver ready: true, restart count 0 Aug 18 11:34:52.391: INFO: Container grafana ready: true, restart count 0 Aug 18 11:34:52.391: INFO: Container prometheus ready: true, restart count 1 Aug 18 11:34:52.391: INFO: Container prometheus-config-reloader ready: true, restart count 0 Aug 18 11:34:52.391: INFO: Container rules-configmap-reloader ready: true, restart count 0 Aug 18 11:34:52.391: INFO: test-rolling-update-controller-wx48f started at 2021-08-18 11:29:47 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:52.391: INFO: Container httpd ready: false, restart count 0 Aug 18 11:34:52.391: INFO: ss2-1 started at 2021-08-18 11:26:31 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:52.391: INFO: Container webserver ready: true, restart count 0 Aug 18 11:34:52.391: INFO: kube-flannel-q78nd started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:34:52.391: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:34:52.391: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:34:52.391: INFO: node-feature-discovery-worker-pflgw started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:52.391: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:34:52.391: INFO: node-exporter-kcwvn started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:34:52.391: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:34:52.391: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:34:52.391: INFO: ss2-0 started at 2021-08-18 11:32:47 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:52.391: INFO: Container webserver ready: false, restart count 0 Aug 18 11:34:52.391: INFO: pod-logs-websocket-d8642f34-1a3a-44bb-86fd-c0e2f884df31 started at 2021-08-18 11:32:11 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:52.391: INFO: Container main ready: false, restart count 0 Aug 18 11:34:52.391: INFO: netserver-0 started at 2021-08-18 11:34:38 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:52.392: INFO: Container webserver ready: false, restart count 0 Aug 18 11:34:52.392: INFO: kube-multus-ds-amd64-rrvmb started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:52.392: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:34:52.392: INFO: kubernetes-metrics-scraper-678c97765c-9nsv5 started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:52.392: INFO: Container kubernetes-metrics-scraper ready: true, restart count 2 Aug 18 11:34:52.392: INFO: cmk-init-discover-node1-bxznx started at 2021-08-18 08:32:10 +0000 UTC (0+3 container statuses recorded) Aug 18 11:34:52.392: INFO: Container discover ready: false, restart count 0 Aug 18 11:34:52.392: INFO: Container init ready: false, restart count 0 Aug 18 11:34:52.392: INFO: Container install ready: false, restart count 0 Aug 18 11:34:52.392: INFO: cmk-d8r27 started at 2021-08-18 08:32:52 +0000 UTC (0+2 container statuses recorded) Aug 18 11:34:52.392: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:34:52.392: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:34:52.392: INFO: collectd-xdprr started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:34:52.392: INFO: Container collectd ready: true, restart count 0 Aug 18 11:34:52.392: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:34:52.392: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:34:52.392: INFO: ss2-0 started at 2021-08-18 11:26:45 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:52.392: INFO: Container webserver ready: true, restart count 0 Aug 18 11:34:52.392: INFO: kube-proxy-p6jvp started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:52.392: INFO: Container kube-proxy ready: true, restart count 2 W0818 11:34:52.404881 30 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:34:52.461: INFO: Latency metrics for node node1 Aug 18 11:34:52.461: INFO: Logging node info for node node2 Aug 18 11:34:52.464: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 1d01177e-3dbb-48a1-a0bc-d18af27ab7f8 63831 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:d1:47:f8:1d:22"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:36 +0000 UTC,LastTransitionTime:2021-08-18 08:26:36 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:34:51 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:34:51 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:34:51 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:34:51 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:dc1f286135c145349b8a016880b65a2f,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:037e7e2d-94e9-42f4-a719-896e5005ac70,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:34:52.466: INFO: Logging kubelet events for node node2 Aug 18 11:34:52.468: INFO: Logging pods the kubelet thinks is on node node2 Aug 18 11:34:52.482: INFO: test-cleanup-controller-vzf4r started at 2021-08-18 11:32:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:52.482: INFO: Container httpd ready: false, restart count 0 Aug 18 11:34:52.482: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-7rn45 started at 2021-08-18 08:36:42 +0000 UTC (0+2 container statuses recorded) Aug 18 11:34:52.482: INFO: Container tas-controller ready: true, restart count 0 Aug 18 11:34:52.482: INFO: Container tas-extender ready: true, restart count 0 Aug 18 11:34:52.482: INFO: ss2-2 started at 2021-08-18 11:27:31 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:52.482: INFO: Container webserver ready: false, restart count 0 Aug 18 11:34:52.482: INFO: fail-once-local-pk5cs started at 2021-08-18 11:34:14 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:52.482: INFO: Container c ready: false, restart count 0 Aug 18 11:34:52.482: INFO: nginx-proxy-node2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:52.482: INFO: Container nginx-proxy ready: true, restart count 1 Aug 18 11:34:52.482: INFO: cmk-init-discover-node2-6b2kz started at 2021-08-18 08:32:30 +0000 UTC (0+3 container statuses recorded) Aug 18 11:34:52.482: INFO: Container discover ready: false, restart count 0 Aug 18 11:34:52.482: INFO: Container init ready: false, restart count 0 Aug 18 11:34:52.482: INFO: Container install ready: false, restart count 0 Aug 18 11:34:52.482: INFO: kubernetes-dashboard-86c6f9df5b-qrtdk started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:52.482: INFO: Container kubernetes-dashboard ready: true, restart count 2 Aug 18 11:34:52.482: INFO: liveness-d2835d64-2674-44b0-8016-a182b2556b33 started at 2021-08-18 11:34:45 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:52.482: INFO: Container liveness ready: true, restart count 0 Aug 18 11:34:52.482: INFO: cmk-748rz started at 2021-08-18 08:32:53 +0000 UTC (0+2 container statuses recorded) Aug 18 11:34:52.482: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:34:52.482: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:34:52.482: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-c82pt started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:52.482: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:34:52.482: INFO: prometheus-operator-5bb8cb9d8f-k97ws started at 2021-08-18 08:33:38 +0000 UTC (0+2 container statuses recorded) Aug 18 11:34:52.482: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:34:52.482: INFO: Container prometheus-operator ready: true, restart count 0 Aug 18 11:34:52.482: INFO: netserver-1 started at 2021-08-18 11:34:38 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:52.482: INFO: Container webserver ready: false, restart count 0 Aug 18 11:34:52.482: INFO: kube-proxy-qkj9c started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:52.482: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:34:52.482: INFO: node-feature-discovery-worker-hzpf5 started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:52.482: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:34:52.482: INFO: downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a started at 2021-08-18 11:31:01 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:52.482: INFO: Container dapi-container ready: false, restart count 0 Aug 18 11:34:52.482: INFO: kube-multus-ds-amd64-rvzsg started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:52.482: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:34:52.482: INFO: collectd-67ntq started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:34:52.482: INFO: Container collectd ready: true, restart count 0 Aug 18 11:34:52.482: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:34:52.482: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:34:52.482: INFO: cmk-webhook-6c9d5f8578-7cxjr started at 2021-08-18 08:32:53 +0000 UTC (0+1 container statuses recorded) Aug 18 11:34:52.482: INFO: Container cmk-webhook ready: true, restart count 0 Aug 18 11:34:52.482: INFO: kube-flannel-h7t5h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:34:52.482: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:34:52.482: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:34:52.482: INFO: node-exporter-lrrf2 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:34:52.482: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:34:52.482: INFO: Container node-exporter ready: true, restart count 0 W0818 11:34:52.497426 30 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:34:52.543: INFO: Latency metrics for node node2 Aug 18 11:34:52.543: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "deployment-3143" for this suite. • Failure [305.452 seconds] [sig-apps] Deployment /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/framework.go:23 RollingUpdateDeployment should delete old pods and create new ones [Conformance] [It] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:34:52.155: error in waiting for pods to come up: failed to wait for pods running: [timed out waiting for the condition] Unexpected error: <*errors.errorString | 0xc002ec8c50>: { s: "failed to wait for pods running: [timed out waiting for the condition]", } failed to wait for pods running: [timed out waiting for the condition] occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/deployment.go:289 ------------------------------ {"msg":"FAILED [sig-apps] Deployment RollingUpdateDeployment should delete old pods and create new ones [Conformance]","total":-1,"completed":14,"skipped":240,"failed":1,"failures":["[sig-apps] Deployment RollingUpdateDeployment should delete old pods and create new ones [Conformance]"]} SSSSSSSS ------------------------------ [BeforeEach] [sig-storage] Projected downwardAPI /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:34:52.586: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename projected STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-storage] Projected downwardAPI /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/projected_downwardapi.go:42 [It] should set DefaultMode on files [LinuxOnly] [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating a pod to test downward API volume plugin Aug 18 11:34:52.623: INFO: Waiting up to 5m0s for pod "downwardapi-volume-08743a3b-777d-4ac9-9d6e-46c2f801fb3b" in namespace "projected-2771" to be "Succeeded or Failed" Aug 18 11:34:52.626: INFO: Pod "downwardapi-volume-08743a3b-777d-4ac9-9d6e-46c2f801fb3b": Phase="Pending", Reason="", readiness=false. Elapsed: 2.063181ms Aug 18 11:34:54.628: INFO: Pod "downwardapi-volume-08743a3b-777d-4ac9-9d6e-46c2f801fb3b": Phase="Pending", Reason="", readiness=false. Elapsed: 2.004922031s Aug 18 11:34:56.632: INFO: Pod "downwardapi-volume-08743a3b-777d-4ac9-9d6e-46c2f801fb3b": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.008240342s STEP: Saw pod success Aug 18 11:34:56.632: INFO: Pod "downwardapi-volume-08743a3b-777d-4ac9-9d6e-46c2f801fb3b" satisfied condition "Succeeded or Failed" Aug 18 11:34:56.635: INFO: Trying to get logs from node node2 pod downwardapi-volume-08743a3b-777d-4ac9-9d6e-46c2f801fb3b container client-container: STEP: delete the pod Aug 18 11:34:56.649: INFO: Waiting for pod downwardapi-volume-08743a3b-777d-4ac9-9d6e-46c2f801fb3b to disappear Aug 18 11:34:56.651: INFO: Pod downwardapi-volume-08743a3b-777d-4ac9-9d6e-46c2f801fb3b no longer exists [AfterEach] [sig-storage] Projected downwardAPI /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:34:56.652: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "projected-2771" for this suite. • ------------------------------ {"msg":"PASSED [sig-storage] Projected downwardAPI should set DefaultMode on files [LinuxOnly] [NodeConformance] [Conformance]","total":-1,"completed":15,"skipped":248,"failed":1,"failures":["[sig-apps] Deployment RollingUpdateDeployment should delete old pods and create new ones [Conformance]"]} SSSS ------------------------------ [BeforeEach] [sig-storage] EmptyDir volumes /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:34:56.673: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename emptydir STEP: Waiting for a default service account to be provisioned in namespace [It] should support (non-root,0644,default) [LinuxOnly] [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating a pod to test emptydir 0644 on node default medium Aug 18 11:34:56.707: INFO: Waiting up to 5m0s for pod "pod-051a2746-186a-4ab6-a644-9514640e5c34" in namespace "emptydir-164" to be "Succeeded or Failed" Aug 18 11:34:56.709: INFO: Pod "pod-051a2746-186a-4ab6-a644-9514640e5c34": Phase="Pending", Reason="", readiness=false. Elapsed: 1.850952ms Aug 18 11:34:58.713: INFO: Pod "pod-051a2746-186a-4ab6-a644-9514640e5c34": Phase="Pending", Reason="", readiness=false. Elapsed: 2.005132063s Aug 18 11:35:00.716: INFO: Pod "pod-051a2746-186a-4ab6-a644-9514640e5c34": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.008183681s STEP: Saw pod success Aug 18 11:35:00.716: INFO: Pod "pod-051a2746-186a-4ab6-a644-9514640e5c34" satisfied condition "Succeeded or Failed" Aug 18 11:35:00.718: INFO: Trying to get logs from node node1 pod pod-051a2746-186a-4ab6-a644-9514640e5c34 container test-container: STEP: delete the pod Aug 18 11:35:00.744: INFO: Waiting for pod pod-051a2746-186a-4ab6-a644-9514640e5c34 to disappear Aug 18 11:35:00.748: INFO: Pod pod-051a2746-186a-4ab6-a644-9514640e5c34 no longer exists [AfterEach] [sig-storage] EmptyDir volumes /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:35:00.748: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "emptydir-164" for this suite. • ------------------------------ {"msg":"PASSED [sig-storage] EmptyDir volumes should support (non-root,0644,default) [LinuxOnly] [NodeConformance] [Conformance]","total":-1,"completed":16,"skipped":252,"failed":1,"failures":["[sig-apps] Deployment RollingUpdateDeployment should delete old pods and create new ones [Conformance]"]} SSSSSSS ------------------------------ [BeforeEach] [sig-network] Networking /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:34:38.305: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename pod-network-test STEP: Waiting for a default service account to be provisioned in namespace [It] should function for node-pod communication: udp [LinuxOnly] [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Performing setup for networking test in namespace pod-network-test-3814 STEP: creating a selector STEP: Creating the service pods in kubernetes Aug 18 11:34:38.325: INFO: Waiting up to 10m0s for all (but 0) nodes to be schedulable Aug 18 11:34:38.359: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Aug 18 11:34:40.363: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Aug 18 11:34:42.362: INFO: The status of Pod netserver-0 is Running (Ready = false) Aug 18 11:34:44.362: INFO: The status of Pod netserver-0 is Running (Ready = false) Aug 18 11:34:46.362: INFO: The status of Pod netserver-0 is Running (Ready = false) Aug 18 11:34:48.363: INFO: The status of Pod netserver-0 is Running (Ready = false) Aug 18 11:34:50.362: INFO: The status of Pod netserver-0 is Running (Ready = false) Aug 18 11:34:52.363: INFO: The status of Pod netserver-0 is Running (Ready = false) Aug 18 11:34:54.361: INFO: The status of Pod netserver-0 is Running (Ready = false) Aug 18 11:34:56.362: INFO: The status of Pod netserver-0 is Running (Ready = false) Aug 18 11:34:58.362: INFO: The status of Pod netserver-0 is Running (Ready = false) Aug 18 11:35:00.362: INFO: The status of Pod netserver-0 is Running (Ready = true) Aug 18 11:35:00.366: INFO: The status of Pod netserver-1 is Running (Ready = true) STEP: Creating test pods Aug 18 11:35:04.407: INFO: ExecWithOptions {Command:[/bin/sh -c echo hostName | nc -w 1 -u 10.244.4.27 8081 | grep -v '^\s*$'] Namespace:pod-network-test-3814 PodName:host-test-container-pod ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:false} Aug 18 11:35:04.407: INFO: >>> kubeConfig: /root/.kube/config Aug 18 11:35:05.512: INFO: Found all expected endpoints: [netserver-0] Aug 18 11:35:05.515: INFO: ExecWithOptions {Command:[/bin/sh -c echo hostName | nc -w 1 -u 10.244.3.22 8081 | grep -v '^\s*$'] Namespace:pod-network-test-3814 PodName:host-test-container-pod ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:false} Aug 18 11:35:05.515: INFO: >>> kubeConfig: /root/.kube/config Aug 18 11:35:06.620: INFO: Found all expected endpoints: [netserver-1] [AfterEach] [sig-network] Networking /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:35:06.620: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "pod-network-test-3814" for this suite. • [SLOW TEST:28.324 seconds] [sig-network] Networking /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/networking.go:26 Granular Checks: Pods /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/networking.go:29 should function for node-pod communication: udp [LinuxOnly] [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-network] Networking Granular Checks: Pods should function for node-pod communication: udp [LinuxOnly] [NodeConformance] [Conformance]","total":-1,"completed":16,"skipped":144,"failed":1,"failures":["[sig-node] Downward API should provide host IP as an env var [NodeConformance] [Conformance]"]} SSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-api-machinery] CustomResourceDefinition resources [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:35:00.777: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename custom-resource-definition STEP: Waiting for a default service account to be provisioned in namespace [It] custom resource defaulting for requests and from storage works [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:35:00.797: INFO: >>> kubeConfig: /root/.kube/config [AfterEach] [sig-api-machinery] CustomResourceDefinition resources [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:35:06.894: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "custom-resource-definition-4823" for this suite. • [SLOW TEST:6.126 seconds] [sig-api-machinery] CustomResourceDefinition resources [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23 custom resource defaulting for requests and from storage works [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-api-machinery] CustomResourceDefinition resources [Privileged:ClusterAdmin] custom resource defaulting for requests and from storage works [Conformance]","total":-1,"completed":17,"skipped":259,"failed":1,"failures":["[sig-apps] Deployment RollingUpdateDeployment should delete old pods and create new ones [Conformance]"]} SSSSSSSSSSS ------------------------------ [BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:35:06.933: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename webhook STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:87 STEP: Setting up server cert STEP: Create role binding to let webhook read extension-apiserver-authentication STEP: Deploying the webhook pod STEP: Wait for the deployment to be ready Aug 18 11:35:07.288: INFO: deployment "sample-webhook-deployment" doesn't have the required revision set Aug 18 11:35:09.296: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764883307, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764883307, loc:(*time.Location)(0x77169a0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764883307, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764883307, loc:(*time.Location)(0x77169a0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-cbccbf6bb\" is progressing."}}, CollisionCount:(*int32)(nil)} STEP: Deploying the webhook service STEP: Verifying the service has paired with the endpoint Aug 18 11:35:12.308: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1 [It] should unconditionally reject operations on fail closed webhook [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Registering a webhook that server cannot talk to, with fail closed policy, via the AdmissionRegistration API STEP: create a namespace for the webhook STEP: create a configmap should be unconditionally rejected by the webhook [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:35:12.357: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "webhook-6593" for this suite. STEP: Destroying namespace "webhook-6593-markers" for this suite. [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:102 • [SLOW TEST:5.466 seconds] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23 should unconditionally reject operations on fail closed webhook [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should unconditionally reject operations on fail closed webhook [Conformance]","total":-1,"completed":18,"skipped":270,"failed":1,"failures":["[sig-apps] Deployment RollingUpdateDeployment should delete old pods and create new ones [Conformance]"]} SSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-node] Downward API /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:31:01.496: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename downward-api STEP: Waiting for a default service account to be provisioned in namespace [It] should provide pod UID as env vars [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating a pod to test downward api env vars Aug 18 11:31:01.529: INFO: Waiting up to 5m0s for pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a" in namespace "downward-api-3670" to be "Succeeded or Failed" Aug 18 11:31:01.531: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 2.027436ms Aug 18 11:31:03.535: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 2.00634673s Aug 18 11:31:05.538: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 4.009522855s Aug 18 11:31:07.542: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 6.013004583s Aug 18 11:31:09.545: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 8.015858108s Aug 18 11:31:11.547: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 10.018711018s Aug 18 11:31:13.551: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 12.022195109s Aug 18 11:31:15.556: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 14.027301942s Aug 18 11:31:17.559: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 16.030595696s Aug 18 11:31:19.563: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 18.033782147s Aug 18 11:31:21.566: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 20.03720568s Aug 18 11:31:23.569: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 22.040546047s Aug 18 11:31:25.572: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 24.043455186s Aug 18 11:31:27.576: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 26.047475574s Aug 18 11:31:29.580: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 28.050733587s Aug 18 11:31:31.583: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 30.05394492s Aug 18 11:31:33.586: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 32.056875428s Aug 18 11:31:35.591: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 34.062525464s Aug 18 11:31:37.595: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 36.066042123s Aug 18 11:31:39.600: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 38.070756264s Aug 18 11:31:41.604: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 40.074745374s Aug 18 11:31:43.608: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 42.078729123s Aug 18 11:31:45.611: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 44.082096966s Aug 18 11:31:47.614: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 46.085502361s Aug 18 11:31:49.618: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 48.089122813s Aug 18 11:31:51.622: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 50.092797392s Aug 18 11:31:53.625: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 52.096457348s Aug 18 11:31:55.629: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 54.100330561s Aug 18 11:31:57.633: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 56.103773807s Aug 18 11:31:59.636: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 58.106733287s Aug 18 11:32:01.639: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.109834078s Aug 18 11:32:03.642: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.11361307s Aug 18 11:32:05.646: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.117368655s Aug 18 11:32:07.649: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.120090919s Aug 18 11:32:09.652: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.12308704s Aug 18 11:32:11.656: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.126845669s Aug 18 11:32:13.660: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.130883036s Aug 18 11:32:15.664: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.135242659s Aug 18 11:32:17.667: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.138514288s Aug 18 11:32:19.671: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.14261133s Aug 18 11:32:21.675: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.146184434s Aug 18 11:32:23.678: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.149209379s Aug 18 11:32:25.681: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.152693829s Aug 18 11:32:27.684: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.155595319s Aug 18 11:32:29.687: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.158357668s Aug 18 11:32:31.690: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.161558745s Aug 18 11:32:33.693: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.164101746s Aug 18 11:32:35.695: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.166576656s Aug 18 11:32:37.698: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.169452892s Aug 18 11:32:39.701: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.172361959s Aug 18 11:32:41.705: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.175723941s Aug 18 11:32:43.709: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.180040675s Aug 18 11:32:45.712: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.183586886s Aug 18 11:32:47.715: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.186480909s Aug 18 11:32:49.720: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.190795718s Aug 18 11:32:51.724: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.195066974s Aug 18 11:32:53.726: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.197642793s Aug 18 11:32:55.729: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.200712048s Aug 18 11:32:57.733: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.204468284s Aug 18 11:32:59.738: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.208882773s Aug 18 11:33:01.741: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.212587201s Aug 18 11:33:03.745: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.215723623s Aug 18 11:33:05.747: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.218321882s Aug 18 11:33:07.751: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.221751635s Aug 18 11:33:09.753: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.224689886s Aug 18 11:33:11.757: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.227777772s Aug 18 11:33:13.760: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.23152891s Aug 18 11:33:15.764: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.235034522s Aug 18 11:33:17.767: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.238380795s Aug 18 11:33:19.771: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.242678083s Aug 18 11:33:21.776: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.247143725s Aug 18 11:33:23.779: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.249771247s Aug 18 11:33:25.782: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.25314017s Aug 18 11:33:27.785: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.255761739s Aug 18 11:33:29.788: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.259002196s Aug 18 11:33:31.791: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.262352386s Aug 18 11:33:33.794: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.265211439s Aug 18 11:33:35.797: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.268094162s Aug 18 11:33:37.800: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.271694661s Aug 18 11:33:39.803: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.274426839s Aug 18 11:33:41.806: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.277620105s Aug 18 11:33:43.810: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.280992869s Aug 18 11:33:45.814: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.285335094s Aug 18 11:33:47.817: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.287857575s Aug 18 11:33:49.820: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.291066265s Aug 18 11:33:51.823: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.294313985s Aug 18 11:33:53.826: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.297609116s Aug 18 11:33:55.829: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.300116585s Aug 18 11:33:57.832: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.303009602s Aug 18 11:33:59.835: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.306639014s Aug 18 11:34:01.839: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.310436182s Aug 18 11:34:03.842: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.313315774s Aug 18 11:34:05.846: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.317316208s Aug 18 11:34:07.850: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.320789119s Aug 18 11:34:09.853: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.323943578s Aug 18 11:34:11.856: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.32677911s Aug 18 11:34:13.858: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.32961435s Aug 18 11:34:15.862: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.333181299s Aug 18 11:34:17.865: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.336348255s Aug 18 11:34:19.869: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.33988861s Aug 18 11:34:21.873: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.34434068s Aug 18 11:34:23.877: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.348647754s Aug 18 11:34:25.882: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.352732636s Aug 18 11:34:27.885: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.356102888s Aug 18 11:34:29.888: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.359654157s Aug 18 11:34:31.891: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.362706076s Aug 18 11:34:33.895: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.365744457s Aug 18 11:34:35.898: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.368900489s Aug 18 11:34:37.901: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.371947207s Aug 18 11:34:39.904: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.375055797s Aug 18 11:34:41.907: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.378003305s Aug 18 11:34:43.911: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.381970776s Aug 18 11:34:45.913: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.384679096s Aug 18 11:34:47.917: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.387771804s Aug 18 11:34:49.920: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.391420734s Aug 18 11:34:51.923: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.394085372s Aug 18 11:34:53.926: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.397567936s Aug 18 11:34:55.931: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.402153172s Aug 18 11:34:57.935: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.406510949s Aug 18 11:34:59.939: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.410594607s Aug 18 11:35:01.943: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.413780298s Aug 18 11:35:03.946: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.416987917s Aug 18 11:35:05.948: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.419563078s Aug 18 11:35:07.952: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.422750107s Aug 18 11:35:09.954: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.425683445s Aug 18 11:35:11.957: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.428087232s Aug 18 11:35:13.961: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.432509978s Aug 18 11:35:15.965: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.436565557s Aug 18 11:35:17.969: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.44062337s Aug 18 11:35:19.973: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.444681325s Aug 18 11:35:21.977: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.448050686s Aug 18 11:35:23.981: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.451985853s Aug 18 11:35:25.985: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.456455536s Aug 18 11:35:27.988: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.459665647s Aug 18 11:35:29.992: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.463670022s Aug 18 11:35:31.997: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.467798954s Aug 18 11:35:34.000: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.471132809s Aug 18 11:35:36.004: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.474931246s Aug 18 11:35:38.008: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.478930841s Aug 18 11:35:40.011: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.481870477s Aug 18 11:35:42.013: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.4846703s Aug 18 11:35:44.017: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.487985842s Aug 18 11:35:46.020: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.490749145s Aug 18 11:35:48.023: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.493919037s Aug 18 11:35:50.025: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.496713998s Aug 18 11:35:52.029: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.500693026s Aug 18 11:35:54.032: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.503587053s Aug 18 11:35:56.037: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.507780431s Aug 18 11:35:58.039: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.510564712s Aug 18 11:36:00.044: INFO: Pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.515387815s Aug 18 11:36:02.052: INFO: Failed to get logs from node "node2" pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a" container "dapi-container": the server rejected our request for an unknown reason (get pods downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a) STEP: delete the pod Aug 18 11:36:02.060: INFO: Waiting for pod downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a to disappear Aug 18 11:36:02.062: INFO: Pod downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a still exists Aug 18 11:36:04.063: INFO: Waiting for pod downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a to disappear Aug 18 11:36:04.065: INFO: Pod downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a no longer exists Aug 18 11:36:04.066: FAIL: Unexpected error: <*errors.errorString | 0xc002455140>: { s: "expected pod \"downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a\" success: Gave up after waiting 5m0s for pod \"downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a\" to be \"Succeeded or Failed\"", } expected pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a" success: Gave up after waiting 5m0s for pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a" to be "Succeeded or Failed" occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).testContainerOutputMatcher(0xc00004e420, 0x4c3168b, 0x15, 0xc001f70000, 0x0, 0xc001a091c8, 0x1, 0x1, 0x4deefb0) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 +0x1ee k8s.io/kubernetes/test/e2e/framework.(*Framework).TestContainerOutputRegexp(...) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:532 k8s.io/kubernetes/test/e2e/common.testDownwardAPIUsingPod(...) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/downward_api.go:425 k8s.io/kubernetes/test/e2e/common.testDownwardAPI(0xc00004e420, 0xc004ebfbc0, 0x31, 0xc0008f71d0, 0x1, 0x1, 0xc001a091c8, 0x1, 0x1) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/downward_api.go:391 +0x75c k8s.io/kubernetes/test/e2e/common.glob..func5.6() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/downward_api.go:283 +0x199 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc00359cc00) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc00359cc00) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc00359cc00, 0x4deb2c0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [sig-node] Downward API /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "downward-api-3670". STEP: Found 7 events. Aug 18 11:36:04.071: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a: { } Scheduled: Successfully assigned downward-api-3670/downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a to node2 Aug 18 11:36:04.071: INFO: At 2021-08-18 11:31:02 +0000 UTC - event for downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a: {multus } AddedInterface: Add eth0 [10.244.3.253/24] Aug 18 11:36:04.071: INFO: At 2021-08-18 11:31:02 +0000 UTC - event for downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a: {kubelet node2} Pulling: Pulling image "docker.io/library/busybox:1.29" Aug 18 11:36:04.071: INFO: At 2021-08-18 11:31:03 +0000 UTC - event for downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a: {kubelet node2} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit Aug 18 11:36:04.071: INFO: At 2021-08-18 11:31:03 +0000 UTC - event for downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a: {kubelet node2} Failed: Error: ErrImagePull Aug 18 11:36:04.071: INFO: At 2021-08-18 11:31:04 +0000 UTC - event for downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a: {kubelet node2} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" Aug 18 11:36:04.071: INFO: At 2021-08-18 11:31:04 +0000 UTC - event for downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a: {kubelet node2} Failed: Error: ImagePullBackOff Aug 18 11:36:04.073: INFO: POD NODE PHASE GRACE CONDITIONS Aug 18 11:36:04.073: INFO: Aug 18 11:36:04.077: INFO: Logging node info for node master1 Aug 18 11:36:04.079: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 ebb211fa-503f-4cfe-b1ed-c95d27a70e6e 64397 0 2021-08-18 08:20:52 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"3a:82:be:72:b5:15"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:20:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:20:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:25:59 +0000 UTC,LastTransitionTime:2021-08-18 08:25:59 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:35:54 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:35:54 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:35:54 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:35:54 +0000 UTC,LastTransitionTime:2021-08-18 08:25:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:58c3e57359b641ad92fa1959f2fecf5d,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:012cd796-2076-45d6-8b14-d3e0451b1e64,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[@ :],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:36:04.080: INFO: Logging kubelet events for node master1 Aug 18 11:36:04.082: INFO: Logging pods the kubelet thinks is on node master1 Aug 18 11:36:04.091: INFO: kube-apiserver-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:36:04.091: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:36:04.091: INFO: kube-proxy-vqk4v started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:36:04.091: INFO: Container kube-proxy ready: true, restart count 1 Aug 18 11:36:04.091: INFO: kube-flannel-q64cq started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:36:04.091: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:36:04.091: INFO: Container kube-flannel ready: true, restart count 3 Aug 18 11:36:04.091: INFO: coredns-7677f9bb54-kn2qg started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:36:04.091: INFO: Container coredns ready: true, restart count 2 Aug 18 11:36:04.091: INFO: kube-scheduler-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:36:04.091: INFO: Container kube-scheduler ready: true, restart count 0 Aug 18 11:36:04.091: INFO: kube-controller-manager-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:36:04.091: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:36:04.091: INFO: kube-multus-ds-amd64-kbcp6 started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:36:04.091: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:36:04.091: INFO: docker-registry-docker-registry-56cbc7bc58-49kl2 started at 2021-08-18 08:26:23 +0000 UTC (0+2 container statuses recorded) Aug 18 11:36:04.091: INFO: Container docker-registry ready: true, restart count 0 Aug 18 11:36:04.091: INFO: Container nginx ready: true, restart count 0 Aug 18 11:36:04.091: INFO: node-exporter-5hwz9 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:36:04.091: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:36:04.091: INFO: Container node-exporter ready: true, restart count 0 W0818 11:36:04.105832 23 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:36:04.132: INFO: Latency metrics for node master1 Aug 18 11:36:04.132: INFO: Logging node info for node master2 Aug 18 11:36:04.136: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 78946293-3abe-4442-84d4-8ed6b1d15ce0 64431 0 2021-08-18 08:21:31 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"7e:f5:c2:cc:3a:b4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:21:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:21:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-08-18 08:29:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:36:03 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:36:03 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:36:03 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:36:03 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0c44122c7a7248c18d8571e1cc667258,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:0cd329f2-48e0-4c8f-b8b9-fa3ae0ed8406,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:36:04.136: INFO: Logging kubelet events for node master2 Aug 18 11:36:04.138: INFO: Logging pods the kubelet thinks is on node master2 Aug 18 11:36:04.149: INFO: dns-autoscaler-5b7b5c9b6f-hh47r started at 2021-08-18 08:23:57 +0000 UTC (0+1 container statuses recorded) Aug 18 11:36:04.149: INFO: Container autoscaler ready: true, restart count 2 Aug 18 11:36:04.149: INFO: node-feature-discovery-controller-5bf5c49849-mq57c started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:36:04.149: INFO: Container nfd-controller ready: true, restart count 0 Aug 18 11:36:04.149: INFO: node-exporter-48nfx started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:36:04.149: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:36:04.149: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:36:04.149: INFO: kube-apiserver-master2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:36:04.149: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:36:04.149: INFO: kube-scheduler-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:36:04.149: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:36:04.149: INFO: kube-multus-ds-amd64-mld8g started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:36:04.149: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:36:04.149: INFO: kube-controller-manager-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:36:04.149: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:36:04.149: INFO: kube-proxy-kh2l9 started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:36:04.149: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:36:04.149: INFO: kube-flannel-pp56h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:36:04.149: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:36:04.149: INFO: Container kube-flannel ready: true, restart count 1 W0818 11:36:04.163258 23 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:36:04.187: INFO: Latency metrics for node master2 Aug 18 11:36:04.187: INFO: Logging node info for node master3 Aug 18 11:36:04.189: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 44feac2b-9447-4be2-9fcd-62f836d67c72 64415 0 2021-08-18 08:21:41 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"86:e4:31:99:58:40"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {kubelet Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:35:58 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:35:58 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:35:58 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:35:58 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1fae19ae59884c44899bcd08aa243244,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:5db926c5-6530-4635-a0d5-806974a3b732,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:36:04.189: INFO: Logging kubelet events for node master3 Aug 18 11:36:04.191: INFO: Logging pods the kubelet thinks is on node master3 Aug 18 11:36:04.199: INFO: kube-controller-manager-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:36:04.199: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:36:04.199: INFO: kube-scheduler-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:36:04.199: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:36:04.199: INFO: kube-apiserver-master3 started at 2021-08-18 08:29:12 +0000 UTC (0+1 container statuses recorded) Aug 18 11:36:04.199: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:36:04.199: INFO: kube-proxy-sd5lc started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:36:04.199: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:36:04.199: INFO: kube-flannel-x6tlr started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:36:04.199: INFO: Init container install-cni ready: true, restart count 1 Aug 18 11:36:04.199: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:36:04.199: INFO: kube-multus-ds-amd64-bkw6c started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:36:04.199: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:36:04.199: INFO: coredns-7677f9bb54-5hxfh started at 2021-08-18 08:23:54 +0000 UTC (0+1 container statuses recorded) Aug 18 11:36:04.199: INFO: Container coredns ready: true, restart count 1 Aug 18 11:36:04.199: INFO: node-exporter-vq7d8 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:36:04.199: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:36:04.199: INFO: Container node-exporter ready: true, restart count 0 W0818 11:36:04.211230 23 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:36:04.238: INFO: Latency metrics for node master3 Aug 18 11:36:04.238: INFO: Logging node info for node node1 Aug 18 11:36:04.241: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 84defabd-6ebf-43ec-a629-44c6713da9c9 64430 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"9a:87:55:36:7b:df"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:13 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:35 +0000 UTC,LastTransitionTime:2021-08-18 08:26:35 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:36:02 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:36:02 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:36:02 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:36:02 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:69946ff2b7bc462fa25eb7adb4703c23,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:736dc52f-f5e3-494e-86ca-01eedbea015c,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:a7cea43d9d2f67c38fbf0407786edbe660ee9072945f7bb272b55fd255e8eaca opnfv/barometer-collectd:stable],SizeBytes:1075746799,},ContainerImage{Names:[@ :],SizeBytes:1003788820,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[aquasec/kube-hunter@sha256:2be6820bc1d7e0f57193a9a27d5a3e16b2fd93c53747b03ce8ca48c6fc323781 aquasec/kube-hunter:0.3.1],SizeBytes:347611549,},ContainerImage{Names:[golang@sha256:db2475a1dbb2149508e5db31d7d77a75e6600d54be645f37681f03f2762169ba golang:alpine3.12],SizeBytes:301186719,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:de25c7fc6c4f3a27c7f0c2dff454e4671823a34d88abd533f210848d527e0fbb alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:36:04.242: INFO: Logging kubelet events for node node1 Aug 18 11:36:04.244: INFO: Logging pods the kubelet thinks is on node node1 Aug 18 11:36:04.261: INFO: kube-multus-ds-amd64-rrvmb started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:36:04.261: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:36:04.261: INFO: node-feature-discovery-worker-pflgw started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:36:04.261: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:36:04.261: INFO: node-exporter-kcwvn started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:36:04.261: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:36:04.261: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:36:04.261: INFO: ss2-0 started at 2021-08-18 11:32:47 +0000 UTC (0+1 container statuses recorded) Aug 18 11:36:04.261: INFO: Container webserver ready: false, restart count 0 Aug 18 11:36:04.261: INFO: busybox-host-aliasesf99672e9-247c-4ef1-98b7-d10beeb0de14 started at 2021-08-18 11:35:06 +0000 UTC (0+1 container statuses recorded) Aug 18 11:36:04.261: INFO: Container busybox-host-aliasesf99672e9-247c-4ef1-98b7-d10beeb0de14 ready: false, restart count 0 Aug 18 11:36:04.261: INFO: pod-logs-websocket-d8642f34-1a3a-44bb-86fd-c0e2f884df31 started at 2021-08-18 11:32:11 +0000 UTC (0+1 container statuses recorded) Aug 18 11:36:04.261: INFO: Container main ready: false, restart count 0 Aug 18 11:36:04.261: INFO: ss2-0 started at 2021-08-18 11:26:45 +0000 UTC (0+1 container statuses recorded) Aug 18 11:36:04.261: INFO: Container webserver ready: true, restart count 0 Aug 18 11:36:04.261: INFO: kube-proxy-p6jvp started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:36:04.261: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:36:04.261: INFO: kubernetes-metrics-scraper-678c97765c-9nsv5 started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:36:04.261: INFO: Container kubernetes-metrics-scraper ready: true, restart count 2 Aug 18 11:36:04.261: INFO: cmk-init-discover-node1-bxznx started at 2021-08-18 08:32:10 +0000 UTC (0+3 container statuses recorded) Aug 18 11:36:04.261: INFO: Container discover ready: false, restart count 0 Aug 18 11:36:04.261: INFO: Container init ready: false, restart count 0 Aug 18 11:36:04.261: INFO: Container install ready: false, restart count 0 Aug 18 11:36:04.261: INFO: cmk-d8r27 started at 2021-08-18 08:32:52 +0000 UTC (0+2 container statuses recorded) Aug 18 11:36:04.261: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:36:04.261: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:36:04.261: INFO: collectd-xdprr started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:36:04.261: INFO: Container collectd ready: true, restart count 0 Aug 18 11:36:04.261: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:36:04.261: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:36:04.261: INFO: nginx-proxy-node1 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:36:04.261: INFO: Container nginx-proxy ready: true, restart count 2 Aug 18 11:36:04.261: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-vsxvg started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:36:04.261: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:36:04.261: INFO: fail-once-local-8rxnh started at 2021-08-18 11:34:14 +0000 UTC (0+1 container statuses recorded) Aug 18 11:36:04.261: INFO: Container c ready: false, restart count 0 Aug 18 11:36:04.261: INFO: pod-update-activedeadlineseconds-2e72b8c4-086d-4288-89a4-b11d1b093416 started at 2021-08-18 11:34:21 +0000 UTC (0+1 container statuses recorded) Aug 18 11:36:04.261: INFO: Container nginx ready: false, restart count 0 Aug 18 11:36:04.261: INFO: kube-flannel-q78nd started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:36:04.261: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:36:04.261: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:36:04.261: INFO: prometheus-k8s-0 started at 2021-08-18 08:34:03 +0000 UTC (0+5 container statuses recorded) Aug 18 11:36:04.261: INFO: Container custom-metrics-apiserver ready: true, restart count 0 Aug 18 11:36:04.261: INFO: Container grafana ready: true, restart count 0 Aug 18 11:36:04.261: INFO: Container prometheus ready: true, restart count 1 Aug 18 11:36:04.261: INFO: Container prometheus-config-reloader ready: true, restart count 0 Aug 18 11:36:04.261: INFO: Container rules-configmap-reloader ready: true, restart count 0 Aug 18 11:36:04.261: INFO: ss2-1 started at 2021-08-18 11:26:31 +0000 UTC (0+1 container statuses recorded) Aug 18 11:36:04.261: INFO: Container webserver ready: true, restart count 0 W0818 11:36:04.274466 23 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:36:04.317: INFO: Latency metrics for node node1 Aug 18 11:36:04.317: INFO: Logging node info for node node2 Aug 18 11:36:04.320: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 1d01177e-3dbb-48a1-a0bc-d18af27ab7f8 64429 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:d1:47:f8:1d:22"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:36 +0000 UTC,LastTransitionTime:2021-08-18 08:26:36 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:36:02 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:36:02 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:36:02 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:36:02 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:dc1f286135c145349b8a016880b65a2f,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:037e7e2d-94e9-42f4-a719-896e5005ac70,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:36:04.320: INFO: Logging kubelet events for node node2 Aug 18 11:36:04.322: INFO: Logging pods the kubelet thinks is on node node2 Aug 18 11:36:04.336: INFO: cmk-webhook-6c9d5f8578-7cxjr started at 2021-08-18 08:32:53 +0000 UTC (0+1 container statuses recorded) Aug 18 11:36:04.336: INFO: Container cmk-webhook ready: true, restart count 0 Aug 18 11:36:04.336: INFO: kube-flannel-h7t5h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:36:04.336: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:36:04.336: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:36:04.336: INFO: node-exporter-lrrf2 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:36:04.336: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:36:04.336: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:36:04.336: INFO: test-cleanup-controller-vzf4r started at 2021-08-18 11:32:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:36:04.336: INFO: Container httpd ready: false, restart count 0 Aug 18 11:36:04.336: INFO: nginx-proxy-node2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:36:04.336: INFO: Container nginx-proxy ready: true, restart count 1 Aug 18 11:36:04.336: INFO: cmk-init-discover-node2-6b2kz started at 2021-08-18 08:32:30 +0000 UTC (0+3 container statuses recorded) Aug 18 11:36:04.336: INFO: Container discover ready: false, restart count 0 Aug 18 11:36:04.336: INFO: Container init ready: false, restart count 0 Aug 18 11:36:04.336: INFO: Container install ready: false, restart count 0 Aug 18 11:36:04.336: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-7rn45 started at 2021-08-18 08:36:42 +0000 UTC (0+2 container statuses recorded) Aug 18 11:36:04.336: INFO: Container tas-controller ready: true, restart count 0 Aug 18 11:36:04.336: INFO: Container tas-extender ready: true, restart count 0 Aug 18 11:36:04.336: INFO: ss2-2 started at 2021-08-18 11:27:31 +0000 UTC (0+1 container statuses recorded) Aug 18 11:36:04.336: INFO: Container webserver ready: false, restart count 0 Aug 18 11:36:04.336: INFO: fail-once-local-pk5cs started at 2021-08-18 11:34:14 +0000 UTC (0+1 container statuses recorded) Aug 18 11:36:04.336: INFO: Container c ready: false, restart count 0 Aug 18 11:36:04.336: INFO: kubernetes-dashboard-86c6f9df5b-qrtdk started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:36:04.336: INFO: Container kubernetes-dashboard ready: true, restart count 2 Aug 18 11:36:04.336: INFO: liveness-d2835d64-2674-44b0-8016-a182b2556b33 started at 2021-08-18 11:34:45 +0000 UTC (0+1 container statuses recorded) Aug 18 11:36:04.336: INFO: Container liveness ready: true, restart count 0 Aug 18 11:36:04.336: INFO: cmk-748rz started at 2021-08-18 08:32:53 +0000 UTC (0+2 container statuses recorded) Aug 18 11:36:04.336: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:36:04.336: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:36:04.336: INFO: pod-configmaps-cf74abd4-bad1-4742-9696-0545d27eacc5 started at 2021-08-18 11:35:12 +0000 UTC (0+2 container statuses recorded) Aug 18 11:36:04.336: INFO: Container configmap-volume-binary-test ready: false, restart count 0 Aug 18 11:36:04.336: INFO: Container configmap-volume-data-test ready: true, restart count 0 Aug 18 11:36:04.336: INFO: kube-proxy-qkj9c started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:36:04.336: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:36:04.336: INFO: node-feature-discovery-worker-hzpf5 started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:36:04.336: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:36:04.336: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-c82pt started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:36:04.336: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:36:04.336: INFO: prometheus-operator-5bb8cb9d8f-k97ws started at 2021-08-18 08:33:38 +0000 UTC (0+2 container statuses recorded) Aug 18 11:36:04.336: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:36:04.336: INFO: Container prometheus-operator ready: true, restart count 0 Aug 18 11:36:04.336: INFO: kube-multus-ds-amd64-rvzsg started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:36:04.336: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:36:04.336: INFO: collectd-67ntq started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:36:04.336: INFO: Container collectd ready: true, restart count 0 Aug 18 11:36:04.336: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:36:04.336: INFO: Container rbac-proxy ready: true, restart count 0 W0818 11:36:04.348864 23 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:36:04.381: INFO: Latency metrics for node node2 Aug 18 11:36:04.381: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "downward-api-3670" for this suite. • Failure [302.893 seconds] [sig-node] Downward API /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/downward_api.go:34 should provide pod UID as env vars [NodeConformance] [Conformance] [It] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:36:04.066: Unexpected error: <*errors.errorString | 0xc002455140>: { s: "expected pod \"downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a\" success: Gave up after waiting 5m0s for pod \"downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a\" to be \"Succeeded or Failed\"", } expected pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a" success: Gave up after waiting 5m0s for pod "downward-api-52b724b6-231c-4c6a-bf00-673e60c5889a" to be "Succeeded or Failed" occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 ------------------------------ {"msg":"FAILED [sig-node] Downward API should provide pod UID as env vars [NodeConformance] [Conformance]","total":-1,"completed":2,"skipped":107,"failed":2,"failures":["[sig-apps] StatefulSet [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] Should recreate evicted statefulset [Conformance]","[sig-node] Downward API should provide pod UID as env vars [NodeConformance] [Conformance]"]} S ------------------------------ [BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:36:04.399: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename webhook STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:87 STEP: Setting up server cert STEP: Create role binding to let webhook read extension-apiserver-authentication STEP: Deploying the webhook pod STEP: Wait for the deployment to be ready Aug 18 11:36:04.772: INFO: deployment "sample-webhook-deployment" doesn't have the required revision set Aug 18 11:36:06.780: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764883364, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764883364, loc:(*time.Location)(0x77169a0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764883364, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764883364, loc:(*time.Location)(0x77169a0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-cbccbf6bb\" is progressing."}}, CollisionCount:(*int32)(nil)} STEP: Deploying the webhook service STEP: Verifying the service has paired with the endpoint Aug 18 11:36:09.790: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1 [It] should mutate custom resource with pruning [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:36:09.793: INFO: >>> kubeConfig: /root/.kube/config STEP: Registering the mutating webhook for custom resource e2e-test-webhook-8431-crds.webhook.example.com via the AdmissionRegistration API STEP: Creating a custom resource that should be mutated by the webhook [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:36:15.875: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "webhook-4041" for this suite. STEP: Destroying namespace "webhook-4041-markers" for this suite. [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:102 • [SLOW TEST:11.515 seconds] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23 should mutate custom resource with pruning [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should mutate custom resource with pruning [Conformance]","total":-1,"completed":3,"skipped":108,"failed":2,"failures":["[sig-apps] StatefulSet [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] Should recreate evicted statefulset [Conformance]","[sig-node] Downward API should provide pod UID as env vars [NodeConformance] [Conformance]"]} SSSSSSSS ------------------------------ [BeforeEach] [k8s.io] Pods /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:32:11.052: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename pods STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [k8s.io] Pods /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/pods.go:181 [It] should support retrieving logs from the container over websockets [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:32:11.070: INFO: >>> kubeConfig: /root/.kube/config STEP: creating the pod STEP: submitting the pod to kubernetes Aug 18 11:37:11.093: FAIL: Unexpected error: <*errors.errorString | 0xc000340200>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*PodClient).CreateSync(0xc00423ad00, 0xc003411400, 0x0) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:103 +0xfe k8s.io/kubernetes/test/e2e/common.glob..func18.8() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/pods.go:642 +0x48f k8s.io/kubernetes/test/e2e.RunE2ETests(0xc002593080) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc002593080) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc002593080, 0x4deb2c0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] Pods /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "pods-4686". STEP: Found 10 events. Aug 18 11:37:11.097: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for pod-logs-websocket-d8642f34-1a3a-44bb-86fd-c0e2f884df31: { } Scheduled: Successfully assigned pods-4686/pod-logs-websocket-d8642f34-1a3a-44bb-86fd-c0e2f884df31 to node1 Aug 18 11:37:11.097: INFO: At 2021-08-18 11:32:12 +0000 UTC - event for pod-logs-websocket-d8642f34-1a3a-44bb-86fd-c0e2f884df31: {multus } AddedInterface: Add eth0 [10.244.4.12/24] Aug 18 11:37:11.097: INFO: At 2021-08-18 11:32:12 +0000 UTC - event for pod-logs-websocket-d8642f34-1a3a-44bb-86fd-c0e2f884df31: {kubelet node1} Pulling: Pulling image "docker.io/library/busybox:1.29" Aug 18 11:37:11.097: INFO: At 2021-08-18 11:32:13 +0000 UTC - event for pod-logs-websocket-d8642f34-1a3a-44bb-86fd-c0e2f884df31: {kubelet node1} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit Aug 18 11:37:11.097: INFO: At 2021-08-18 11:32:13 +0000 UTC - event for pod-logs-websocket-d8642f34-1a3a-44bb-86fd-c0e2f884df31: {kubelet node1} Failed: Error: ErrImagePull Aug 18 11:37:11.097: INFO: At 2021-08-18 11:32:14 +0000 UTC - event for pod-logs-websocket-d8642f34-1a3a-44bb-86fd-c0e2f884df31: {kubelet node1} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Aug 18 11:37:11.097: INFO: At 2021-08-18 11:32:17 +0000 UTC - event for pod-logs-websocket-d8642f34-1a3a-44bb-86fd-c0e2f884df31: {multus } AddedInterface: Add eth0 [10.244.4.13/24] Aug 18 11:37:11.097: INFO: At 2021-08-18 11:32:17 +0000 UTC - event for pod-logs-websocket-d8642f34-1a3a-44bb-86fd-c0e2f884df31: {kubelet node1} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" Aug 18 11:37:11.097: INFO: At 2021-08-18 11:32:17 +0000 UTC - event for pod-logs-websocket-d8642f34-1a3a-44bb-86fd-c0e2f884df31: {kubelet node1} Failed: Error: ImagePullBackOff Aug 18 11:37:11.097: INFO: At 2021-08-18 11:32:20 +0000 UTC - event for pod-logs-websocket-d8642f34-1a3a-44bb-86fd-c0e2f884df31: {multus } AddedInterface: Add eth0 [10.244.4.14/24] Aug 18 11:37:11.100: INFO: POD NODE PHASE GRACE CONDITIONS Aug 18 11:37:11.101: INFO: pod-logs-websocket-d8642f34-1a3a-44bb-86fd-c0e2f884df31 node1 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:32:11 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:32:11 +0000 UTC ContainersNotReady containers with unready status: [main]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:32:11 +0000 UTC ContainersNotReady containers with unready status: [main]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:32:11 +0000 UTC }] Aug 18 11:37:11.101: INFO: Aug 18 11:37:11.105: INFO: Logging node info for node master1 Aug 18 11:37:11.107: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 ebb211fa-503f-4cfe-b1ed-c95d27a70e6e 64814 0 2021-08-18 08:20:52 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"3a:82:be:72:b5:15"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:20:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:20:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:25:59 +0000 UTC,LastTransitionTime:2021-08-18 08:25:59 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:37:04 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:37:04 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:37:04 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:37:04 +0000 UTC,LastTransitionTime:2021-08-18 08:25:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:58c3e57359b641ad92fa1959f2fecf5d,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:012cd796-2076-45d6-8b14-d3e0451b1e64,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[@ :],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:37:11.108: INFO: Logging kubelet events for node master1 Aug 18 11:37:11.111: INFO: Logging pods the kubelet thinks is on node master1 Aug 18 11:37:11.120: INFO: kube-apiserver-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:11.120: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:37:11.120: INFO: kube-proxy-vqk4v started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:11.120: INFO: Container kube-proxy ready: true, restart count 1 Aug 18 11:37:11.120: INFO: kube-flannel-q64cq started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:37:11.120: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:37:11.120: INFO: Container kube-flannel ready: true, restart count 3 Aug 18 11:37:11.120: INFO: coredns-7677f9bb54-kn2qg started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:11.120: INFO: Container coredns ready: true, restart count 2 Aug 18 11:37:11.120: INFO: kube-scheduler-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:11.120: INFO: Container kube-scheduler ready: true, restart count 0 Aug 18 11:37:11.120: INFO: kube-controller-manager-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:11.120: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:37:11.120: INFO: kube-multus-ds-amd64-kbcp6 started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:11.120: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:37:11.120: INFO: docker-registry-docker-registry-56cbc7bc58-49kl2 started at 2021-08-18 08:26:23 +0000 UTC (0+2 container statuses recorded) Aug 18 11:37:11.120: INFO: Container docker-registry ready: true, restart count 0 Aug 18 11:37:11.120: INFO: Container nginx ready: true, restart count 0 Aug 18 11:37:11.120: INFO: node-exporter-5hwz9 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:37:11.120: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:37:11.120: INFO: Container node-exporter ready: true, restart count 0 W0818 11:37:11.132872 36 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:37:11.163: INFO: Latency metrics for node master1 Aug 18 11:37:11.163: INFO: Logging node info for node master2 Aug 18 11:37:11.166: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 78946293-3abe-4442-84d4-8ed6b1d15ce0 64807 0 2021-08-18 08:21:31 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"7e:f5:c2:cc:3a:b4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:21:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:21:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-08-18 08:29:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:37:03 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:37:03 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:37:03 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:37:03 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0c44122c7a7248c18d8571e1cc667258,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:0cd329f2-48e0-4c8f-b8b9-fa3ae0ed8406,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:37:11.167: INFO: Logging kubelet events for node master2 Aug 18 11:37:11.169: INFO: Logging pods the kubelet thinks is on node master2 Aug 18 11:37:11.178: INFO: kube-multus-ds-amd64-mld8g started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:11.179: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:37:11.179: INFO: dns-autoscaler-5b7b5c9b6f-hh47r started at 2021-08-18 08:23:57 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:11.179: INFO: Container autoscaler ready: true, restart count 2 Aug 18 11:37:11.179: INFO: node-feature-discovery-controller-5bf5c49849-mq57c started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:11.179: INFO: Container nfd-controller ready: true, restart count 0 Aug 18 11:37:11.179: INFO: node-exporter-48nfx started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:37:11.179: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:37:11.179: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:37:11.179: INFO: kube-apiserver-master2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:11.179: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:37:11.179: INFO: kube-scheduler-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:11.179: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:37:11.179: INFO: kube-flannel-pp56h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:37:11.179: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:37:11.179: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:37:11.179: INFO: kube-controller-manager-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:11.179: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:37:11.179: INFO: kube-proxy-kh2l9 started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:11.179: INFO: Container kube-proxy ready: true, restart count 2 W0818 11:37:11.190289 36 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:37:11.220: INFO: Latency metrics for node master2 Aug 18 11:37:11.220: INFO: Logging node info for node master3 Aug 18 11:37:11.223: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 44feac2b-9447-4be2-9fcd-62f836d67c72 64828 0 2021-08-18 08:21:41 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"86:e4:31:99:58:40"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {kubelet Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:37:08 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:37:08 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:37:08 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:37:08 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1fae19ae59884c44899bcd08aa243244,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:5db926c5-6530-4635-a0d5-806974a3b732,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:37:11.223: INFO: Logging kubelet events for node master3 Aug 18 11:37:11.225: INFO: Logging pods the kubelet thinks is on node master3 Aug 18 11:37:11.232: INFO: kube-scheduler-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:11.232: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:37:11.232: INFO: kube-apiserver-master3 started at 2021-08-18 08:29:12 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:11.232: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:37:11.232: INFO: kube-proxy-sd5lc started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:11.232: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:37:11.232: INFO: kube-flannel-x6tlr started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:37:11.232: INFO: Init container install-cni ready: true, restart count 1 Aug 18 11:37:11.232: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:37:11.232: INFO: kube-multus-ds-amd64-bkw6c started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:11.232: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:37:11.232: INFO: coredns-7677f9bb54-5hxfh started at 2021-08-18 08:23:54 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:11.232: INFO: Container coredns ready: true, restart count 1 Aug 18 11:37:11.232: INFO: node-exporter-vq7d8 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:37:11.232: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:37:11.232: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:37:11.232: INFO: kube-controller-manager-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:11.232: INFO: Container kube-controller-manager ready: true, restart count 2 W0818 11:37:11.245632 36 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:37:11.273: INFO: Latency metrics for node master3 Aug 18 11:37:11.273: INFO: Logging node info for node node1 Aug 18 11:37:11.276: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 84defabd-6ebf-43ec-a629-44c6713da9c9 64806 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"9a:87:55:36:7b:df"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:13 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:35 +0000 UTC,LastTransitionTime:2021-08-18 08:26:35 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:37:02 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:37:02 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:37:02 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:37:02 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:69946ff2b7bc462fa25eb7adb4703c23,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:736dc52f-f5e3-494e-86ca-01eedbea015c,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:a7cea43d9d2f67c38fbf0407786edbe660ee9072945f7bb272b55fd255e8eaca opnfv/barometer-collectd:stable],SizeBytes:1075746799,},ContainerImage{Names:[@ :],SizeBytes:1003788820,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[aquasec/kube-hunter@sha256:2be6820bc1d7e0f57193a9a27d5a3e16b2fd93c53747b03ce8ca48c6fc323781 aquasec/kube-hunter:0.3.1],SizeBytes:347611549,},ContainerImage{Names:[golang@sha256:db2475a1dbb2149508e5db31d7d77a75e6600d54be645f37681f03f2762169ba golang:alpine3.12],SizeBytes:301186719,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:de25c7fc6c4f3a27c7f0c2dff454e4671823a34d88abd533f210848d527e0fbb alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:37:11.276: INFO: Logging kubelet events for node node1 Aug 18 11:37:11.279: INFO: Logging pods the kubelet thinks is on node node1 Aug 18 11:37:11.294: INFO: ss2-1 started at 2021-08-18 11:26:31 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:11.294: INFO: Container webserver ready: true, restart count 0 Aug 18 11:37:11.294: INFO: kube-flannel-q78nd started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:37:11.294: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:37:11.294: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:37:11.294: INFO: prometheus-k8s-0 started at 2021-08-18 08:34:03 +0000 UTC (0+5 container statuses recorded) Aug 18 11:37:11.294: INFO: Container custom-metrics-apiserver ready: true, restart count 0 Aug 18 11:37:11.294: INFO: Container grafana ready: true, restart count 0 Aug 18 11:37:11.294: INFO: Container prometheus ready: true, restart count 1 Aug 18 11:37:11.294: INFO: Container prometheus-config-reloader ready: true, restart count 0 Aug 18 11:37:11.294: INFO: Container rules-configmap-reloader ready: true, restart count 0 Aug 18 11:37:11.294: INFO: ss2-0 started at 2021-08-18 11:32:47 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:11.294: INFO: Container webserver ready: false, restart count 0 Aug 18 11:37:11.294: INFO: busybox-host-aliasesf99672e9-247c-4ef1-98b7-d10beeb0de14 started at 2021-08-18 11:35:06 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:11.294: INFO: Container busybox-host-aliasesf99672e9-247c-4ef1-98b7-d10beeb0de14 ready: false, restart count 0 Aug 18 11:37:11.294: INFO: pod-logs-websocket-d8642f34-1a3a-44bb-86fd-c0e2f884df31 started at 2021-08-18 11:32:11 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:11.294: INFO: Container main ready: false, restart count 0 Aug 18 11:37:11.294: INFO: kube-multus-ds-amd64-rrvmb started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:11.294: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:37:11.294: INFO: node-feature-discovery-worker-pflgw started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:11.294: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:37:11.294: INFO: node-exporter-kcwvn started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:37:11.294: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:37:11.294: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:37:11.294: INFO: cmk-d8r27 started at 2021-08-18 08:32:52 +0000 UTC (0+2 container statuses recorded) Aug 18 11:37:11.294: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:37:11.294: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:37:11.294: INFO: collectd-xdprr started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:37:11.294: INFO: Container collectd ready: true, restart count 0 Aug 18 11:37:11.294: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:37:11.294: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:37:11.294: INFO: ss2-0 started at 2021-08-18 11:26:45 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:11.294: INFO: Container webserver ready: true, restart count 0 Aug 18 11:37:11.294: INFO: kube-proxy-p6jvp started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:11.294: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:37:11.294: INFO: kubernetes-metrics-scraper-678c97765c-9nsv5 started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:11.294: INFO: Container kubernetes-metrics-scraper ready: true, restart count 2 Aug 18 11:37:11.294: INFO: cmk-init-discover-node1-bxznx started at 2021-08-18 08:32:10 +0000 UTC (0+3 container statuses recorded) Aug 18 11:37:11.294: INFO: Container discover ready: false, restart count 0 Aug 18 11:37:11.294: INFO: Container init ready: false, restart count 0 Aug 18 11:37:11.294: INFO: Container install ready: false, restart count 0 Aug 18 11:37:11.294: INFO: pod-update-activedeadlineseconds-2e72b8c4-086d-4288-89a4-b11d1b093416 started at 2021-08-18 11:34:21 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:11.294: INFO: Container nginx ready: false, restart count 0 Aug 18 11:37:11.294: INFO: nginx-proxy-node1 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:11.294: INFO: Container nginx-proxy ready: true, restart count 2 Aug 18 11:37:11.294: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-vsxvg started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:11.294: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:37:11.294: INFO: fail-once-local-8rxnh started at 2021-08-18 11:34:14 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:11.294: INFO: Container c ready: false, restart count 0 W0818 11:37:11.305906 36 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:37:11.346: INFO: Latency metrics for node node1 Aug 18 11:37:11.346: INFO: Logging node info for node node2 Aug 18 11:37:11.349: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 1d01177e-3dbb-48a1-a0bc-d18af27ab7f8 64805 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:d1:47:f8:1d:22"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:36 +0000 UTC,LastTransitionTime:2021-08-18 08:26:36 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:37:02 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:37:02 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:37:02 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:37:02 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:dc1f286135c145349b8a016880b65a2f,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:037e7e2d-94e9-42f4-a719-896e5005ac70,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:37:11.350: INFO: Logging kubelet events for node node2 Aug 18 11:37:11.352: INFO: Logging pods the kubelet thinks is on node node2 Aug 18 11:37:11.379: INFO: cmk-webhook-6c9d5f8578-7cxjr started at 2021-08-18 08:32:53 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:11.379: INFO: Container cmk-webhook ready: true, restart count 0 Aug 18 11:37:11.379: INFO: kube-flannel-h7t5h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:37:11.379: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:37:11.379: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:37:11.379: INFO: node-exporter-lrrf2 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:37:11.379: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:37:11.379: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:37:11.379: INFO: test-cleanup-controller-vzf4r started at 2021-08-18 11:32:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:11.379: INFO: Container httpd ready: false, restart count 0 Aug 18 11:37:11.379: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-7rn45 started at 2021-08-18 08:36:42 +0000 UTC (0+2 container statuses recorded) Aug 18 11:37:11.379: INFO: Container tas-controller ready: true, restart count 0 Aug 18 11:37:11.379: INFO: Container tas-extender ready: true, restart count 0 Aug 18 11:37:11.379: INFO: ss2-2 started at 2021-08-18 11:27:31 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:11.379: INFO: Container webserver ready: false, restart count 0 Aug 18 11:37:11.379: INFO: fail-once-local-pk5cs started at 2021-08-18 11:34:14 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:11.379: INFO: Container c ready: false, restart count 0 Aug 18 11:37:11.379: INFO: nginx-proxy-node2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:11.379: INFO: Container nginx-proxy ready: true, restart count 1 Aug 18 11:37:11.379: INFO: cmk-init-discover-node2-6b2kz started at 2021-08-18 08:32:30 +0000 UTC (0+3 container statuses recorded) Aug 18 11:37:11.379: INFO: Container discover ready: false, restart count 0 Aug 18 11:37:11.379: INFO: Container init ready: false, restart count 0 Aug 18 11:37:11.379: INFO: Container install ready: false, restart count 0 Aug 18 11:37:11.379: INFO: kubernetes-dashboard-86c6f9df5b-qrtdk started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:11.379: INFO: Container kubernetes-dashboard ready: true, restart count 2 Aug 18 11:37:11.379: INFO: liveness-d2835d64-2674-44b0-8016-a182b2556b33 started at 2021-08-18 11:34:45 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:11.379: INFO: Container liveness ready: true, restart count 0 Aug 18 11:37:11.379: INFO: pod-adoption started at 2021-08-18 11:36:15 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:11.379: INFO: Container pod-adoption ready: false, restart count 0 Aug 18 11:37:11.379: INFO: cmk-748rz started at 2021-08-18 08:32:53 +0000 UTC (0+2 container statuses recorded) Aug 18 11:37:11.379: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:37:11.379: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:37:11.379: INFO: pod-configmaps-cf74abd4-bad1-4742-9696-0545d27eacc5 started at 2021-08-18 11:35:12 +0000 UTC (0+2 container statuses recorded) Aug 18 11:37:11.379: INFO: Container configmap-volume-binary-test ready: false, restart count 0 Aug 18 11:37:11.379: INFO: Container configmap-volume-data-test ready: true, restart count 0 Aug 18 11:37:11.379: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-c82pt started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:11.379: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:37:11.379: INFO: prometheus-operator-5bb8cb9d8f-k97ws started at 2021-08-18 08:33:38 +0000 UTC (0+2 container statuses recorded) Aug 18 11:37:11.379: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:37:11.379: INFO: Container prometheus-operator ready: true, restart count 0 Aug 18 11:37:11.379: INFO: kube-proxy-qkj9c started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:11.379: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:37:11.379: INFO: node-feature-discovery-worker-hzpf5 started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:11.379: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:37:11.379: INFO: kube-multus-ds-amd64-rvzsg started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:11.379: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:37:11.379: INFO: collectd-67ntq started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:37:11.379: INFO: Container collectd ready: true, restart count 0 Aug 18 11:37:11.379: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:37:11.379: INFO: Container rbac-proxy ready: true, restart count 0 W0818 11:37:11.392988 36 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:37:11.424: INFO: Latency metrics for node node2 Aug 18 11:37:11.424: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "pods-4686" for this suite. • Failure [300.381 seconds] [k8s.io] Pods /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 should support retrieving logs from the container over websockets [NodeConformance] [Conformance] [It] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:37:11.093: Unexpected error: <*errors.errorString | 0xc000340200>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:103 ------------------------------ {"msg":"FAILED [k8s.io] Pods should support retrieving logs from the container over websockets [NodeConformance] [Conformance]","total":-1,"completed":17,"skipped":371,"failed":2,"failures":["[sig-network] Services should be able to create a functioning NodePort service [Conformance]","[k8s.io] Pods should support retrieving logs from the container over websockets [NodeConformance] [Conformance]"]} SSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:37:11.485: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename services STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:782 [It] should be able to change the type from ClusterIP to ExternalName [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: creating a service clusterip-service with the type=ClusterIP in namespace services-9747 STEP: Creating active service to test reachability when its FQDN is referred as externalName for another service STEP: creating service externalsvc in namespace services-9747 STEP: creating replication controller externalsvc in namespace services-9747 I0818 11:37:11.522554 36 runners.go:190] Created replication controller with name: externalsvc, namespace: services-9747, replica count: 2 I0818 11:37:14.573153 36 runners.go:190] externalsvc Pods: 2 out of 2 created, 1 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0818 11:37:17.573483 36 runners.go:190] externalsvc Pods: 2 out of 2 created, 2 running, 0 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady STEP: changing the ClusterIP service to type=ExternalName Aug 18 11:37:17.587: INFO: Creating new exec pod Aug 18 11:37:21.605: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-9747 exec execpodvmk66 -- /bin/sh -x -c nslookup clusterip-service.services-9747.svc.cluster.local' Aug 18 11:37:22.006: INFO: stderr: "+ nslookup clusterip-service.services-9747.svc.cluster.local\n" Aug 18 11:37:22.006: INFO: stdout: "Server:\t\t10.233.0.3\nAddress:\t10.233.0.3#53\n\nclusterip-service.services-9747.svc.cluster.local\tcanonical name = externalsvc.services-9747.svc.cluster.local.\nName:\texternalsvc.services-9747.svc.cluster.local\nAddress: 10.233.61.12\n\n" STEP: deleting ReplicationController externalsvc in namespace services-9747, will wait for the garbage collector to delete the pods Aug 18 11:37:22.067: INFO: Deleting ReplicationController externalsvc took: 7.189307ms Aug 18 11:37:22.767: INFO: Terminating ReplicationController externalsvc pods took: 700.444602ms Aug 18 11:37:31.180: INFO: Cleaning up the ClusterIP to ExternalName test service [AfterEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:37:31.188: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "services-9747" for this suite. [AfterEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:786 • [SLOW TEST:19.710 seconds] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/framework.go:23 should be able to change the type from ClusterIP to ExternalName [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-network] Services should be able to change the type from ClusterIP to ExternalName [Conformance]","total":-1,"completed":18,"skipped":390,"failed":2,"failures":["[sig-network] Services should be able to create a functioning NodePort service [Conformance]","[k8s.io] Pods should support retrieving logs from the container over websockets [NodeConformance] [Conformance]"]} SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-instrumentation] Events API /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:37:31.381: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename events STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-instrumentation] Events API /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/instrumentation/events.go:81 [It] should ensure that an event can be fetched, patched, deleted, and listed [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: creating a test event STEP: listing events in all namespaces STEP: listing events in test namespace STEP: listing events with field selection filtering on source STEP: listing events with field selection filtering on reportingController STEP: getting the test event STEP: patching the test event STEP: getting the test event STEP: updating the test event STEP: getting the test event STEP: deleting the test event STEP: listing events in all namespaces STEP: listing events in test namespace [AfterEach] [sig-instrumentation] Events API /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:37:31.457: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "events-8821" for this suite. • ------------------------------ {"msg":"PASSED [sig-instrumentation] Events API should ensure that an event can be fetched, patched, deleted, and listed [Conformance]","total":-1,"completed":19,"skipped":473,"failed":2,"failures":["[sig-network] Services should be able to create a functioning NodePort service [Conformance]","[k8s.io] Pods should support retrieving logs from the container over websockets [NodeConformance] [Conformance]"]} SSSSSSS ------------------------------ [BeforeEach] [sig-api-machinery] ResourceQuota /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:37:31.485: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename resourcequota STEP: Waiting for a default service account to be provisioned in namespace [It] should create a ResourceQuota and capture the life of a service. [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Counting existing ResourceQuota STEP: Creating a ResourceQuota STEP: Ensuring resource quota status is calculated STEP: Creating a Service STEP: Ensuring resource quota status captures service creation STEP: Deleting a Service STEP: Ensuring resource quota status released usage [AfterEach] [sig-api-machinery] ResourceQuota /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:37:42.546: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "resourcequota-4063" for this suite. • [SLOW TEST:11.070 seconds] [sig-api-machinery] ResourceQuota /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23 should create a ResourceQuota and capture the life of a service. [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-api-machinery] ResourceQuota should create a ResourceQuota and capture the life of a service. [Conformance]","total":-1,"completed":20,"skipped":480,"failed":2,"failures":["[sig-network] Services should be able to create a functioning NodePort service [Conformance]","[k8s.io] Pods should support retrieving logs from the container over websockets [NodeConformance] [Conformance]"]} SSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-apps] StatefulSet /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:25:14.159: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename statefulset Aug 18 11:25:14.177: INFO: Found PodSecurityPolicies; testing pod creation to see if PodSecurityPolicy is enabled Aug 18 11:25:14.179: INFO: Error creating dryrun pod; assuming PodSecurityPolicy is disabled: admission webhook "cmk.intel.com" does not support dry run STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-apps] StatefulSet /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/statefulset.go:88 [BeforeEach] [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/statefulset.go:103 STEP: Creating service test in namespace statefulset-3111 [It] should perform rolling updates and roll backs of template modifications [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating a new StatefulSet Aug 18 11:25:14.194: INFO: Found 0 stateful pods, waiting for 3 Aug 18 11:25:24.197: INFO: Found 1 stateful pods, waiting for 3 Aug 18 11:25:34.199: INFO: Waiting for pod ss2-0 to enter Running - Ready=true, currently Running - Ready=true Aug 18 11:25:34.199: INFO: Waiting for pod ss2-1 to enter Running - Ready=true, currently Running - Ready=true Aug 18 11:25:34.199: INFO: Waiting for pod ss2-2 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:25:44.198: INFO: Waiting for pod ss2-0 to enter Running - Ready=true, currently Running - Ready=true Aug 18 11:25:44.198: INFO: Waiting for pod ss2-1 to enter Running - Ready=true, currently Running - Ready=true Aug 18 11:25:44.198: INFO: Waiting for pod ss2-2 to enter Running - Ready=true, currently Running - Ready=true Aug 18 11:25:44.205: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=statefulset-3111 exec ss2-1 -- /bin/sh -x -c mv -v /usr/local/apache2/htdocs/index.html /tmp/ || true' Aug 18 11:25:44.510: INFO: stderr: "+ mv -v /usr/local/apache2/htdocs/index.html /tmp/\n" Aug 18 11:25:44.510: INFO: stdout: "'/usr/local/apache2/htdocs/index.html' -> '/tmp/index.html'\n" Aug 18 11:25:44.510: INFO: stdout of mv -v /usr/local/apache2/htdocs/index.html /tmp/ || true on ss2-1: '/usr/local/apache2/htdocs/index.html' -> '/tmp/index.html' STEP: Updating StatefulSet template: update image from docker.io/library/httpd:2.4.38-alpine to docker.io/library/httpd:2.4.39-alpine Aug 18 11:25:54.537: INFO: Updating stateful set ss2 STEP: Creating a new revision STEP: Updating Pods in reverse ordinal order Aug 18 11:26:04.551: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=statefulset-3111 exec ss2-1 -- /bin/sh -x -c mv -v /tmp/index.html /usr/local/apache2/htdocs/ || true' Aug 18 11:26:04.875: INFO: stderr: "+ mv -v /tmp/index.html /usr/local/apache2/htdocs/\n" Aug 18 11:26:04.875: INFO: stdout: "'/tmp/index.html' -> '/usr/local/apache2/htdocs/index.html'\n" Aug 18 11:26:04.875: INFO: stdout of mv -v /tmp/index.html /usr/local/apache2/htdocs/ || true on ss2-1: '/tmp/index.html' -> '/usr/local/apache2/htdocs/index.html' Aug 18 11:26:14.891: INFO: Waiting for StatefulSet statefulset-3111/ss2 to complete update Aug 18 11:26:14.891: INFO: Waiting for Pod statefulset-3111/ss2-0 to have revision ss2-84f9d6bf57 update revision ss2-65c7964b94 Aug 18 11:26:14.891: INFO: Waiting for Pod statefulset-3111/ss2-1 to have revision ss2-84f9d6bf57 update revision ss2-65c7964b94 Aug 18 11:26:24.904: INFO: Waiting for StatefulSet statefulset-3111/ss2 to complete update Aug 18 11:26:24.904: INFO: Waiting for Pod statefulset-3111/ss2-0 to have revision ss2-84f9d6bf57 update revision ss2-65c7964b94 Aug 18 11:26:24.904: INFO: Waiting for Pod statefulset-3111/ss2-1 to have revision ss2-84f9d6bf57 update revision ss2-65c7964b94 Aug 18 11:26:34.897: INFO: Waiting for StatefulSet statefulset-3111/ss2 to complete update Aug 18 11:26:34.897: INFO: Waiting for Pod statefulset-3111/ss2-0 to have revision ss2-84f9d6bf57 update revision ss2-65c7964b94 Aug 18 11:26:44.896: INFO: Waiting for StatefulSet statefulset-3111/ss2 to complete update Aug 18 11:26:44.897: INFO: Waiting for Pod statefulset-3111/ss2-0 to have revision ss2-84f9d6bf57 update revision ss2-65c7964b94 STEP: Rolling back to a previous revision Aug 18 11:26:54.899: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=statefulset-3111 exec ss2-1 -- /bin/sh -x -c mv -v /usr/local/apache2/htdocs/index.html /tmp/ || true' Aug 18 11:26:55.355: INFO: stderr: "+ mv -v /usr/local/apache2/htdocs/index.html /tmp/\n" Aug 18 11:26:55.355: INFO: stdout: "'/usr/local/apache2/htdocs/index.html' -> '/tmp/index.html'\n" Aug 18 11:26:55.355: INFO: stdout of mv -v /usr/local/apache2/htdocs/index.html /tmp/ || true on ss2-1: '/usr/local/apache2/htdocs/index.html' -> '/tmp/index.html' Aug 18 11:27:05.383: INFO: Updating stateful set ss2 STEP: Rolling back update in reverse ordinal order Aug 18 11:27:15.397: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=statefulset-3111 exec ss2-1 -- /bin/sh -x -c mv -v /tmp/index.html /usr/local/apache2/htdocs/ || true' Aug 18 11:27:16.495: INFO: stderr: "+ mv -v /tmp/index.html /usr/local/apache2/htdocs/\n" Aug 18 11:27:16.496: INFO: stdout: "'/tmp/index.html' -> '/usr/local/apache2/htdocs/index.html'\n" Aug 18 11:27:16.496: INFO: stdout of mv -v /tmp/index.html /usr/local/apache2/htdocs/ || true on ss2-1: '/tmp/index.html' -> '/usr/local/apache2/htdocs/index.html' Aug 18 11:27:26.511: INFO: Waiting for StatefulSet statefulset-3111/ss2 to complete update Aug 18 11:27:26.511: INFO: Waiting for Pod statefulset-3111/ss2-0 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:27:26.511: INFO: Waiting for Pod statefulset-3111/ss2-1 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:27:26.511: INFO: Waiting for Pod statefulset-3111/ss2-2 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:27:36.518: INFO: Waiting for StatefulSet statefulset-3111/ss2 to complete update Aug 18 11:27:36.518: INFO: Waiting for Pod statefulset-3111/ss2-0 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:27:36.518: INFO: Waiting for Pod statefulset-3111/ss2-1 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:27:46.516: INFO: Waiting for StatefulSet statefulset-3111/ss2 to complete update Aug 18 11:27:46.516: INFO: Waiting for Pod statefulset-3111/ss2-0 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:27:46.516: INFO: Waiting for Pod statefulset-3111/ss2-1 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:27:56.516: INFO: Waiting for StatefulSet statefulset-3111/ss2 to complete update Aug 18 11:27:56.516: INFO: Waiting for Pod statefulset-3111/ss2-0 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:27:56.516: INFO: Waiting for Pod statefulset-3111/ss2-1 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:28:06.517: INFO: Waiting for StatefulSet statefulset-3111/ss2 to complete update Aug 18 11:28:06.518: INFO: Waiting for Pod statefulset-3111/ss2-0 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:28:06.518: INFO: Waiting for Pod statefulset-3111/ss2-1 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:28:16.516: INFO: Waiting for StatefulSet statefulset-3111/ss2 to complete update Aug 18 11:28:16.516: INFO: Waiting for Pod statefulset-3111/ss2-0 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:28:16.516: INFO: Waiting for Pod statefulset-3111/ss2-1 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:28:26.520: INFO: Waiting for StatefulSet statefulset-3111/ss2 to complete update Aug 18 11:28:26.520: INFO: Waiting for Pod statefulset-3111/ss2-0 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:28:26.520: INFO: Waiting for Pod statefulset-3111/ss2-1 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:28:36.516: INFO: Waiting for StatefulSet statefulset-3111/ss2 to complete update Aug 18 11:28:36.516: INFO: Waiting for Pod statefulset-3111/ss2-0 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:28:36.516: INFO: Waiting for Pod statefulset-3111/ss2-1 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:28:46.517: INFO: Waiting for StatefulSet statefulset-3111/ss2 to complete update Aug 18 11:28:46.517: INFO: Waiting for Pod statefulset-3111/ss2-0 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:28:46.517: INFO: Waiting for Pod statefulset-3111/ss2-1 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:28:56.517: INFO: Waiting for StatefulSet statefulset-3111/ss2 to complete update Aug 18 11:28:56.517: INFO: Waiting for Pod statefulset-3111/ss2-0 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:28:56.517: INFO: Waiting for Pod statefulset-3111/ss2-1 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:29:06.517: INFO: Waiting for StatefulSet statefulset-3111/ss2 to complete update Aug 18 11:29:06.517: INFO: Waiting for Pod statefulset-3111/ss2-0 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:29:06.517: INFO: Waiting for Pod statefulset-3111/ss2-1 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:29:16.517: INFO: Waiting for StatefulSet statefulset-3111/ss2 to complete update Aug 18 11:29:16.517: INFO: Waiting for Pod statefulset-3111/ss2-0 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:29:16.517: INFO: Waiting for Pod statefulset-3111/ss2-1 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:29:26.519: INFO: Waiting for StatefulSet statefulset-3111/ss2 to complete update Aug 18 11:29:26.519: INFO: Waiting for Pod statefulset-3111/ss2-0 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:29:26.519: INFO: Waiting for Pod statefulset-3111/ss2-1 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:29:36.517: INFO: Waiting for StatefulSet statefulset-3111/ss2 to complete update Aug 18 11:29:36.517: INFO: Waiting for Pod statefulset-3111/ss2-0 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:29:36.517: INFO: Waiting for Pod statefulset-3111/ss2-1 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:29:46.519: INFO: Waiting for StatefulSet statefulset-3111/ss2 to complete update Aug 18 11:29:46.519: INFO: Waiting for Pod statefulset-3111/ss2-0 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:29:46.519: INFO: Waiting for Pod statefulset-3111/ss2-1 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:29:56.519: INFO: Waiting for StatefulSet statefulset-3111/ss2 to complete update Aug 18 11:29:56.519: INFO: Waiting for Pod statefulset-3111/ss2-0 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:29:56.519: INFO: Waiting for Pod statefulset-3111/ss2-1 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:30:06.518: INFO: Waiting for StatefulSet statefulset-3111/ss2 to complete update Aug 18 11:30:06.518: INFO: Waiting for Pod statefulset-3111/ss2-0 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:30:06.518: INFO: Waiting for Pod statefulset-3111/ss2-1 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:30:16.517: INFO: Waiting for StatefulSet statefulset-3111/ss2 to complete update Aug 18 11:30:16.517: INFO: Waiting for Pod statefulset-3111/ss2-0 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:30:16.517: INFO: Waiting for Pod statefulset-3111/ss2-1 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:30:26.516: INFO: Waiting for StatefulSet statefulset-3111/ss2 to complete update Aug 18 11:30:26.516: INFO: Waiting for Pod statefulset-3111/ss2-0 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:30:26.516: INFO: Waiting for Pod statefulset-3111/ss2-1 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:30:36.516: INFO: Waiting for StatefulSet statefulset-3111/ss2 to complete update Aug 18 11:30:36.516: INFO: Waiting for Pod statefulset-3111/ss2-0 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:30:36.516: INFO: Waiting for Pod statefulset-3111/ss2-1 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:30:46.518: INFO: Waiting for StatefulSet statefulset-3111/ss2 to complete update Aug 18 11:30:46.518: INFO: Waiting for Pod statefulset-3111/ss2-0 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:30:46.518: INFO: Waiting for Pod statefulset-3111/ss2-1 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:30:56.519: INFO: Waiting for StatefulSet statefulset-3111/ss2 to complete update Aug 18 11:30:56.519: INFO: Waiting for Pod statefulset-3111/ss2-0 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:30:56.519: INFO: Waiting for Pod statefulset-3111/ss2-1 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:31:06.517: INFO: Waiting for StatefulSet statefulset-3111/ss2 to complete update Aug 18 11:31:06.517: INFO: Waiting for Pod statefulset-3111/ss2-0 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:31:06.517: INFO: Waiting for Pod statefulset-3111/ss2-1 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:31:16.519: INFO: Waiting for StatefulSet statefulset-3111/ss2 to complete update Aug 18 11:31:16.519: INFO: Waiting for Pod statefulset-3111/ss2-0 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:31:16.519: INFO: Waiting for Pod statefulset-3111/ss2-1 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:31:26.520: INFO: Waiting for StatefulSet statefulset-3111/ss2 to complete update Aug 18 11:31:26.520: INFO: Waiting for Pod statefulset-3111/ss2-0 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:31:26.520: INFO: Waiting for Pod statefulset-3111/ss2-1 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:31:36.519: INFO: Waiting for StatefulSet statefulset-3111/ss2 to complete update Aug 18 11:31:36.519: INFO: Waiting for Pod statefulset-3111/ss2-0 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:31:36.519: INFO: Waiting for Pod statefulset-3111/ss2-1 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:31:46.519: INFO: Waiting for StatefulSet statefulset-3111/ss2 to complete update Aug 18 11:31:46.519: INFO: Waiting for Pod statefulset-3111/ss2-0 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:31:46.519: INFO: Waiting for Pod statefulset-3111/ss2-1 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:31:56.518: INFO: Waiting for StatefulSet statefulset-3111/ss2 to complete update Aug 18 11:31:56.518: INFO: Waiting for Pod statefulset-3111/ss2-0 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:31:56.518: INFO: Waiting for Pod statefulset-3111/ss2-1 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:32:06.518: INFO: Waiting for StatefulSet statefulset-3111/ss2 to complete update Aug 18 11:32:06.518: INFO: Waiting for Pod statefulset-3111/ss2-0 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:32:06.518: INFO: Waiting for Pod statefulset-3111/ss2-1 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:32:16.517: INFO: Waiting for StatefulSet statefulset-3111/ss2 to complete update Aug 18 11:32:16.517: INFO: Waiting for Pod statefulset-3111/ss2-0 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:32:16.517: INFO: Waiting for Pod statefulset-3111/ss2-1 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:32:26.517: INFO: Waiting for StatefulSet statefulset-3111/ss2 to complete update Aug 18 11:32:26.517: INFO: Waiting for Pod statefulset-3111/ss2-0 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:32:26.517: INFO: Waiting for Pod statefulset-3111/ss2-1 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:32:36.520: INFO: Waiting for StatefulSet statefulset-3111/ss2 to complete update Aug 18 11:32:36.520: INFO: Waiting for Pod statefulset-3111/ss2-0 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:32:36.520: INFO: Waiting for Pod statefulset-3111/ss2-1 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:32:46.516: INFO: Waiting for StatefulSet statefulset-3111/ss2 to complete update Aug 18 11:32:46.516: INFO: Waiting for Pod statefulset-3111/ss2-0 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:32:46.516: INFO: Waiting for Pod statefulset-3111/ss2-1 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:32:56.516: INFO: Waiting for StatefulSet statefulset-3111/ss2 to complete update Aug 18 11:32:56.516: INFO: Waiting for Pod statefulset-3111/ss2-0 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:32:56.516: INFO: Waiting for Pod statefulset-3111/ss2-1 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:33:06.518: INFO: Waiting for StatefulSet statefulset-3111/ss2 to complete update Aug 18 11:33:06.518: INFO: Waiting for Pod statefulset-3111/ss2-0 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:33:06.518: INFO: Waiting for Pod statefulset-3111/ss2-1 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:33:16.518: INFO: Waiting for StatefulSet statefulset-3111/ss2 to complete update Aug 18 11:33:16.518: INFO: Waiting for Pod statefulset-3111/ss2-0 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:33:16.518: INFO: Waiting for Pod statefulset-3111/ss2-1 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:33:26.517: INFO: Waiting for StatefulSet statefulset-3111/ss2 to complete update Aug 18 11:33:26.517: INFO: Waiting for Pod statefulset-3111/ss2-0 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:33:26.517: INFO: Waiting for Pod statefulset-3111/ss2-1 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:33:36.517: INFO: Waiting for StatefulSet statefulset-3111/ss2 to complete update Aug 18 11:33:36.517: INFO: Waiting for Pod statefulset-3111/ss2-0 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:33:36.517: INFO: Waiting for Pod statefulset-3111/ss2-1 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:33:46.519: INFO: Waiting for StatefulSet statefulset-3111/ss2 to complete update Aug 18 11:33:46.519: INFO: Waiting for Pod statefulset-3111/ss2-0 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:33:46.519: INFO: Waiting for Pod statefulset-3111/ss2-1 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:33:56.516: INFO: Waiting for StatefulSet statefulset-3111/ss2 to complete update Aug 18 11:33:56.516: INFO: Waiting for Pod statefulset-3111/ss2-0 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:33:56.516: INFO: Waiting for Pod statefulset-3111/ss2-1 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:34:06.517: INFO: Waiting for StatefulSet statefulset-3111/ss2 to complete update Aug 18 11:34:06.517: INFO: Waiting for Pod statefulset-3111/ss2-0 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:34:06.517: INFO: Waiting for Pod statefulset-3111/ss2-1 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:34:16.516: INFO: Waiting for StatefulSet statefulset-3111/ss2 to complete update Aug 18 11:34:16.516: INFO: Waiting for Pod statefulset-3111/ss2-0 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:34:16.516: INFO: Waiting for Pod statefulset-3111/ss2-1 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:34:26.516: INFO: Waiting for StatefulSet statefulset-3111/ss2 to complete update Aug 18 11:34:26.516: INFO: Waiting for Pod statefulset-3111/ss2-0 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:34:26.516: INFO: Waiting for Pod statefulset-3111/ss2-1 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:34:36.516: INFO: Waiting for StatefulSet statefulset-3111/ss2 to complete update Aug 18 11:34:36.516: INFO: Waiting for Pod statefulset-3111/ss2-0 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:34:36.516: INFO: Waiting for Pod statefulset-3111/ss2-1 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:34:46.516: INFO: Waiting for StatefulSet statefulset-3111/ss2 to complete update Aug 18 11:34:46.516: INFO: Waiting for Pod statefulset-3111/ss2-0 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:34:46.516: INFO: Waiting for Pod statefulset-3111/ss2-1 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:34:56.519: INFO: Waiting for StatefulSet statefulset-3111/ss2 to complete update Aug 18 11:34:56.519: INFO: Waiting for Pod statefulset-3111/ss2-0 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:34:56.519: INFO: Waiting for Pod statefulset-3111/ss2-1 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:35:06.518: INFO: Waiting for StatefulSet statefulset-3111/ss2 to complete update Aug 18 11:35:06.518: INFO: Waiting for Pod statefulset-3111/ss2-0 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:35:06.518: INFO: Waiting for Pod statefulset-3111/ss2-1 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:35:16.516: INFO: Waiting for StatefulSet statefulset-3111/ss2 to complete update Aug 18 11:35:16.516: INFO: Waiting for Pod statefulset-3111/ss2-0 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:35:16.516: INFO: Waiting for Pod statefulset-3111/ss2-1 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:35:26.520: INFO: Waiting for StatefulSet statefulset-3111/ss2 to complete update Aug 18 11:35:26.520: INFO: Waiting for Pod statefulset-3111/ss2-0 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:35:26.520: INFO: Waiting for Pod statefulset-3111/ss2-1 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:35:36.517: INFO: Waiting for StatefulSet statefulset-3111/ss2 to complete update Aug 18 11:35:36.517: INFO: Waiting for Pod statefulset-3111/ss2-0 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:35:36.517: INFO: Waiting for Pod statefulset-3111/ss2-1 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:35:46.518: INFO: Waiting for StatefulSet statefulset-3111/ss2 to complete update Aug 18 11:35:46.518: INFO: Waiting for Pod statefulset-3111/ss2-0 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:35:46.518: INFO: Waiting for Pod statefulset-3111/ss2-1 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:35:56.516: INFO: Waiting for StatefulSet statefulset-3111/ss2 to complete update Aug 18 11:35:56.516: INFO: Waiting for Pod statefulset-3111/ss2-0 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:35:56.516: INFO: Waiting for Pod statefulset-3111/ss2-1 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:36:06.518: INFO: Waiting for StatefulSet statefulset-3111/ss2 to complete update Aug 18 11:36:06.518: INFO: Waiting for Pod statefulset-3111/ss2-0 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:36:06.518: INFO: Waiting for Pod statefulset-3111/ss2-1 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:36:16.516: INFO: Waiting for StatefulSet statefulset-3111/ss2 to complete update Aug 18 11:36:16.516: INFO: Waiting for Pod statefulset-3111/ss2-0 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:36:16.516: INFO: Waiting for Pod statefulset-3111/ss2-1 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:36:26.517: INFO: Waiting for StatefulSet statefulset-3111/ss2 to complete update Aug 18 11:36:26.517: INFO: Waiting for Pod statefulset-3111/ss2-0 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:36:26.517: INFO: Waiting for Pod statefulset-3111/ss2-1 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:36:36.517: INFO: Waiting for StatefulSet statefulset-3111/ss2 to complete update Aug 18 11:36:36.517: INFO: Waiting for Pod statefulset-3111/ss2-0 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:36:36.517: INFO: Waiting for Pod statefulset-3111/ss2-1 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:36:46.517: INFO: Waiting for StatefulSet statefulset-3111/ss2 to complete update Aug 18 11:36:46.517: INFO: Waiting for Pod statefulset-3111/ss2-0 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:36:46.517: INFO: Waiting for Pod statefulset-3111/ss2-1 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:36:56.517: INFO: Waiting for StatefulSet statefulset-3111/ss2 to complete update Aug 18 11:36:56.517: INFO: Waiting for Pod statefulset-3111/ss2-0 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:36:56.517: INFO: Waiting for Pod statefulset-3111/ss2-1 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:37:06.516: INFO: Waiting for StatefulSet statefulset-3111/ss2 to complete update Aug 18 11:37:06.516: INFO: Waiting for Pod statefulset-3111/ss2-0 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:37:06.516: INFO: Waiting for Pod statefulset-3111/ss2-1 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:37:16.524: INFO: Waiting for StatefulSet statefulset-3111/ss2 to complete update Aug 18 11:37:16.524: INFO: Waiting for Pod statefulset-3111/ss2-0 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:37:16.524: INFO: Waiting for Pod statefulset-3111/ss2-1 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:37:26.518: INFO: Waiting for StatefulSet statefulset-3111/ss2 to complete update Aug 18 11:37:26.518: INFO: Waiting for Pod statefulset-3111/ss2-0 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:37:26.518: INFO: Waiting for Pod statefulset-3111/ss2-1 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:37:26.523: INFO: Waiting for StatefulSet statefulset-3111/ss2 to complete update Aug 18 11:37:26.523: INFO: Waiting for Pod statefulset-3111/ss2-0 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:37:26.523: INFO: Waiting for Pod statefulset-3111/ss2-1 to have revision ss2-65c7964b94 update revision ss2-84f9d6bf57 Aug 18 11:37:26.523: FAIL: Failed waiting for state update: timed out waiting for the condition Full Stack Trace k8s.io/kubernetes/test/e2e/framework/statefulset.WaitForState(0x5410260, 0xc0018c6420, 0xc000d13900, 0xc0038faec0) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/statefulset/wait.go:74 +0x10a k8s.io/kubernetes/test/e2e/apps.waitForRollingUpdate(0x5410260, 0xc0018c6420, 0xc0014c4f00, 0xc0020b2e1a, 0x5) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/wait.go:124 +0x1c5 k8s.io/kubernetes/test/e2e/apps.rollbackTest(0x5410260, 0xc0018c6420, 0xc000e17990, 0x10, 0xc00003cf00) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/statefulset.go:1212 +0x1d65 k8s.io/kubernetes/test/e2e/apps.glob..func10.2.7() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/statefulset.go:299 +0x14f k8s.io/kubernetes/test/e2e.RunE2ETests(0xc001b28d80) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc001b28d80) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc001b28d80, 0x4deb2c0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/statefulset.go:114 Aug 18 11:37:26.528: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=statefulset-3111 describe po ss2-0' Aug 18 11:37:26.707: INFO: stderr: "" Aug 18 11:37:26.707: INFO: stdout: "Name: ss2-0\nNamespace: statefulset-3111\nPriority: 0\nNode: node1/10.10.190.207\nStart Time: Wed, 18 Aug 2021 11:26:45 +0000\nLabels: baz=blah\n controller-revision-hash=ss2-84f9d6bf57\n foo=bar\n statefulset.kubernetes.io/pod-name=ss2-0\nAnnotations: k8s.v1.cni.cncf.io/network-status:\n [{\n \"name\": \"default-cni-network\",\n \"interface\": \"eth0\",\n \"ips\": [\n \"10.244.4.231\"\n ],\n \"mac\": \"ba:bc:7d:d2:6e:b8\",\n \"default\": true,\n \"dns\": {}\n }]\n k8s.v1.cni.cncf.io/networks-status:\n [{\n \"name\": \"default-cni-network\",\n \"interface\": \"eth0\",\n \"ips\": [\n \"10.244.4.231\"\n ],\n \"mac\": \"ba:bc:7d:d2:6e:b8\",\n \"default\": true,\n \"dns\": {}\n }]\n kubernetes.io/psp: collectd\nStatus: Running\nIP: 10.244.4.231\nIPs:\n IP: 10.244.4.231\nControlled By: StatefulSet/ss2\nContainers:\n webserver:\n Container ID: docker://7fdf3af9058537cd2a2c4ec75da44f6dcbd6a90435af11ccf71ccbc2ea55c173\n Image: docker.io/library/httpd:2.4.39-alpine\n Image ID: docker-pullable://httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a\n Port: \n Host Port: \n State: Running\n Started: Wed, 18 Aug 2021 11:26:50 +0000\n Ready: True\n Restart Count: 0\n Readiness: http-get http://:80/index.html delay=0s timeout=1s period=1s #success=1 #failure=1\n Environment: \n Mounts:\n /var/run/secrets/kubernetes.io/serviceaccount from default-token-pzft4 (ro)\nConditions:\n Type Status\n Initialized True \n Ready True \n ContainersReady True \n PodScheduled True \nVolumes:\n default-token-pzft4:\n Type: Secret (a volume populated by a Secret)\n SecretName: default-token-pzft4\n Optional: false\nQoS Class: BestEffort\nNode-Selectors: \nTolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s\n node.kubernetes.io/unreachable:NoExecute op=Exists for 300s\nEvents:\n Type Reason Age From Message\n ---- ------ ---- ---- -------\n Normal Scheduled 10m default-scheduler Successfully assigned statefulset-3111/ss2-0 to node1\n Normal AddedInterface 10m multus Add eth0 [10.244.4.231/24]\n Normal Pulling 10m kubelet Pulling image \"docker.io/library/httpd:2.4.39-alpine\"\n Normal Pulled 10m kubelet Successfully pulled image \"docker.io/library/httpd:2.4.39-alpine\" in 1.927338402s\n Normal Created 10m kubelet Created container webserver\n Normal Started 10m kubelet Started container webserver\n" Aug 18 11:37:26.707: INFO: Output of kubectl describe ss2-0: Name: ss2-0 Namespace: statefulset-3111 Priority: 0 Node: node1/10.10.190.207 Start Time: Wed, 18 Aug 2021 11:26:45 +0000 Labels: baz=blah controller-revision-hash=ss2-84f9d6bf57 foo=bar statefulset.kubernetes.io/pod-name=ss2-0 Annotations: k8s.v1.cni.cncf.io/network-status: [{ "name": "default-cni-network", "interface": "eth0", "ips": [ "10.244.4.231" ], "mac": "ba:bc:7d:d2:6e:b8", "default": true, "dns": {} }] k8s.v1.cni.cncf.io/networks-status: [{ "name": "default-cni-network", "interface": "eth0", "ips": [ "10.244.4.231" ], "mac": "ba:bc:7d:d2:6e:b8", "default": true, "dns": {} }] kubernetes.io/psp: collectd Status: Running IP: 10.244.4.231 IPs: IP: 10.244.4.231 Controlled By: StatefulSet/ss2 Containers: webserver: Container ID: docker://7fdf3af9058537cd2a2c4ec75da44f6dcbd6a90435af11ccf71ccbc2ea55c173 Image: docker.io/library/httpd:2.4.39-alpine Image ID: docker-pullable://httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a Port: Host Port: State: Running Started: Wed, 18 Aug 2021 11:26:50 +0000 Ready: True Restart Count: 0 Readiness: http-get http://:80/index.html delay=0s timeout=1s period=1s #success=1 #failure=1 Environment: Mounts: /var/run/secrets/kubernetes.io/serviceaccount from default-token-pzft4 (ro) Conditions: Type Status Initialized True Ready True ContainersReady True PodScheduled True Volumes: default-token-pzft4: Type: Secret (a volume populated by a Secret) SecretName: default-token-pzft4 Optional: false QoS Class: BestEffort Node-Selectors: Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s node.kubernetes.io/unreachable:NoExecute op=Exists for 300s Events: Type Reason Age From Message ---- ------ ---- ---- ------- Normal Scheduled 10m default-scheduler Successfully assigned statefulset-3111/ss2-0 to node1 Normal AddedInterface 10m multus Add eth0 [10.244.4.231/24] Normal Pulling 10m kubelet Pulling image "docker.io/library/httpd:2.4.39-alpine" Normal Pulled 10m kubelet Successfully pulled image "docker.io/library/httpd:2.4.39-alpine" in 1.927338402s Normal Created 10m kubelet Created container webserver Normal Started 10m kubelet Started container webserver Aug 18 11:37:26.707: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=statefulset-3111 logs ss2-0 --tail=100' Aug 18 11:37:26.901: INFO: stderr: "" Aug 18 11:37:26.901: INFO: stdout: "10.244.4.1 - - [18/Aug/2021:11:35:47 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:35:48 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:35:49 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:35:50 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:35:51 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:35:52 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:35:53 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:35:54 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:35:55 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:35:56 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:35:57 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:35:58 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:35:59 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:00 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:01 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:02 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:03 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:04 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:05 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:06 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:07 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:08 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:09 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:10 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:11 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:12 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:13 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:14 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:15 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:16 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:17 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:18 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:19 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:20 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:21 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:22 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:23 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:24 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:25 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:26 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:27 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:28 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:29 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:30 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:31 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:32 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:33 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:34 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:35 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:36 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:37 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:38 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:39 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:40 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:41 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:42 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:43 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:44 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:45 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:46 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:47 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:48 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:49 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:50 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:51 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:52 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:53 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:54 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:55 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:56 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:57 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:58 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:59 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:37:00 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:37:01 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:37:02 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:37:03 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:37:04 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:37:05 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:37:06 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:37:07 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:37:08 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:37:09 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:37:10 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:37:11 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:37:12 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:37:13 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:37:14 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:37:15 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:37:16 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:37:17 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:37:18 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:37:19 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:37:20 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:37:21 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:37:22 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:37:23 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:37:24 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:37:25 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:37:26 +0000] \"GET /index.html HTTP/1.1\" 200 45\n" Aug 18 11:37:26.901: INFO: Last 100 log lines of ss2-0: 10.244.4.1 - - [18/Aug/2021:11:35:47 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:35:48 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:35:49 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:35:50 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:35:51 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:35:52 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:35:53 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:35:54 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:35:55 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:35:56 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:35:57 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:35:58 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:35:59 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:00 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:01 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:02 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:03 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:04 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:05 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:06 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:07 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:08 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:09 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:10 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:11 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:12 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:13 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:14 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:15 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:16 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:17 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:18 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:19 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:20 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:21 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:22 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:23 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:24 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:25 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:26 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:27 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:28 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:29 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:30 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:31 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:32 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:33 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:34 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:35 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:36 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:37 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:38 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:39 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:40 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:41 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:42 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:43 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:44 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:45 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:46 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:47 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:48 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:49 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:50 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:51 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:52 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:53 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:54 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:55 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:56 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:57 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:58 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:59 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:37:00 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:37:01 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:37:02 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:37:03 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:37:04 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:37:05 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:37:06 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:37:07 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:37:08 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:37:09 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:37:10 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:37:11 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:37:12 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:37:13 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:37:14 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:37:15 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:37:16 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:37:17 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:37:18 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:37:19 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:37:20 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:37:21 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:37:22 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:37:23 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:37:24 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:37:25 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:37:26 +0000] "GET /index.html HTTP/1.1" 200 45 Aug 18 11:37:26.901: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=statefulset-3111 describe po ss2-1' Aug 18 11:37:27.096: INFO: stderr: "" Aug 18 11:37:27.096: INFO: stdout: "Name: ss2-1\nNamespace: statefulset-3111\nPriority: 0\nNode: node1/10.10.190.207\nStart Time: Wed, 18 Aug 2021 11:26:31 +0000\nLabels: baz=blah\n controller-revision-hash=ss2-84f9d6bf57\n foo=bar\n statefulset.kubernetes.io/pod-name=ss2-1\nAnnotations: k8s.v1.cni.cncf.io/network-status:\n [{\n \"name\": \"default-cni-network\",\n \"interface\": \"eth0\",\n \"ips\": [\n \"10.244.4.226\"\n ],\n \"mac\": \"3e:37:cf:d3:77:15\",\n \"default\": true,\n \"dns\": {}\n }]\n k8s.v1.cni.cncf.io/networks-status:\n [{\n \"name\": \"default-cni-network\",\n \"interface\": \"eth0\",\n \"ips\": [\n \"10.244.4.226\"\n ],\n \"mac\": \"3e:37:cf:d3:77:15\",\n \"default\": true,\n \"dns\": {}\n }]\n kubernetes.io/psp: collectd\nStatus: Running\nIP: 10.244.4.226\nIPs:\n IP: 10.244.4.226\nControlled By: StatefulSet/ss2\nContainers:\n webserver:\n Container ID: docker://52edbb2fd3bc2ced75d2884e413ac855098bcfe6dabbd6d9ec4ab83f01d8cd97\n Image: docker.io/library/httpd:2.4.39-alpine\n Image ID: docker-pullable://httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a\n Port: \n Host Port: \n State: Running\n Started: Wed, 18 Aug 2021 11:26:39 +0000\n Ready: True\n Restart Count: 0\n Readiness: http-get http://:80/index.html delay=0s timeout=1s period=1s #success=1 #failure=1\n Environment: \n Mounts:\n /var/run/secrets/kubernetes.io/serviceaccount from default-token-pzft4 (ro)\nConditions:\n Type Status\n Initialized True \n Ready True \n ContainersReady True \n PodScheduled True \nVolumes:\n default-token-pzft4:\n Type: Secret (a volume populated by a Secret)\n SecretName: default-token-pzft4\n Optional: false\nQoS Class: BestEffort\nNode-Selectors: \nTolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s\n node.kubernetes.io/unreachable:NoExecute op=Exists for 300s\nEvents:\n Type Reason Age From Message\n ---- ------ ---- ---- -------\n Normal Scheduled 10m default-scheduler Successfully assigned statefulset-3111/ss2-1 to node1\n Normal AddedInterface 10m multus Add eth0 [10.244.4.226/24]\n Normal Pulling 10m kubelet Pulling image \"docker.io/library/httpd:2.4.39-alpine\"\n Normal Pulled 10m kubelet Successfully pulled image \"docker.io/library/httpd:2.4.39-alpine\" in 6.21847623s\n Normal Created 10m kubelet Created container webserver\n Normal Started 10m kubelet Started container webserver\n Warning Unhealthy 10m (x21 over 10m) kubelet Readiness probe failed: HTTP probe failed with statuscode: 404\n" Aug 18 11:37:27.096: INFO: Output of kubectl describe ss2-1: Name: ss2-1 Namespace: statefulset-3111 Priority: 0 Node: node1/10.10.190.207 Start Time: Wed, 18 Aug 2021 11:26:31 +0000 Labels: baz=blah controller-revision-hash=ss2-84f9d6bf57 foo=bar statefulset.kubernetes.io/pod-name=ss2-1 Annotations: k8s.v1.cni.cncf.io/network-status: [{ "name": "default-cni-network", "interface": "eth0", "ips": [ "10.244.4.226" ], "mac": "3e:37:cf:d3:77:15", "default": true, "dns": {} }] k8s.v1.cni.cncf.io/networks-status: [{ "name": "default-cni-network", "interface": "eth0", "ips": [ "10.244.4.226" ], "mac": "3e:37:cf:d3:77:15", "default": true, "dns": {} }] kubernetes.io/psp: collectd Status: Running IP: 10.244.4.226 IPs: IP: 10.244.4.226 Controlled By: StatefulSet/ss2 Containers: webserver: Container ID: docker://52edbb2fd3bc2ced75d2884e413ac855098bcfe6dabbd6d9ec4ab83f01d8cd97 Image: docker.io/library/httpd:2.4.39-alpine Image ID: docker-pullable://httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a Port: Host Port: State: Running Started: Wed, 18 Aug 2021 11:26:39 +0000 Ready: True Restart Count: 0 Readiness: http-get http://:80/index.html delay=0s timeout=1s period=1s #success=1 #failure=1 Environment: Mounts: /var/run/secrets/kubernetes.io/serviceaccount from default-token-pzft4 (ro) Conditions: Type Status Initialized True Ready True ContainersReady True PodScheduled True Volumes: default-token-pzft4: Type: Secret (a volume populated by a Secret) SecretName: default-token-pzft4 Optional: false QoS Class: BestEffort Node-Selectors: Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s node.kubernetes.io/unreachable:NoExecute op=Exists for 300s Events: Type Reason Age From Message ---- ------ ---- ---- ------- Normal Scheduled 10m default-scheduler Successfully assigned statefulset-3111/ss2-1 to node1 Normal AddedInterface 10m multus Add eth0 [10.244.4.226/24] Normal Pulling 10m kubelet Pulling image "docker.io/library/httpd:2.4.39-alpine" Normal Pulled 10m kubelet Successfully pulled image "docker.io/library/httpd:2.4.39-alpine" in 6.21847623s Normal Created 10m kubelet Created container webserver Normal Started 10m kubelet Started container webserver Warning Unhealthy 10m (x21 over 10m) kubelet Readiness probe failed: HTTP probe failed with statuscode: 404 Aug 18 11:37:27.096: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=statefulset-3111 logs ss2-1 --tail=100' Aug 18 11:37:27.298: INFO: stderr: "" Aug 18 11:37:27.298: INFO: stdout: "10.244.4.1 - - [18/Aug/2021:11:35:47 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:35:48 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:35:49 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:35:50 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:35:51 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:35:52 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:35:53 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:35:54 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:35:55 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:35:56 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:35:57 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:35:58 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:35:59 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:00 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:01 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:02 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:03 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:04 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:05 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:06 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:07 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:08 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:09 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:10 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:11 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:12 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:13 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:14 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:15 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:16 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:17 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:19 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:19 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:20 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:21 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:22 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:23 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:24 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:25 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:26 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:27 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:28 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:29 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:30 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:31 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:32 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:33 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:34 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:35 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:36 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:37 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:38 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:39 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:40 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:41 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:42 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:43 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:44 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:45 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:46 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:47 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:48 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:49 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:50 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:51 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:52 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:53 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:54 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:55 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:56 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:57 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:58 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:36:59 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:37:00 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:37:01 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:37:02 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:37:03 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:37:04 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:37:05 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:37:06 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:37:07 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:37:08 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:37:09 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:37:10 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:37:11 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:37:12 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:37:13 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:37:14 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:37:15 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:37:16 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:37:17 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:37:18 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:37:19 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:37:20 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:37:21 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:37:22 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:37:23 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:37:24 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:37:25 +0000] \"GET /index.html HTTP/1.1\" 200 45\n10.244.4.1 - - [18/Aug/2021:11:37:26 +0000] \"GET /index.html HTTP/1.1\" 200 45\n" Aug 18 11:37:27.298: INFO: Last 100 log lines of ss2-1: 10.244.4.1 - - [18/Aug/2021:11:35:47 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:35:48 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:35:49 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:35:50 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:35:51 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:35:52 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:35:53 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:35:54 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:35:55 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:35:56 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:35:57 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:35:58 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:35:59 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:00 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:01 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:02 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:03 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:04 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:05 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:06 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:07 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:08 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:09 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:10 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:11 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:12 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:13 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:14 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:15 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:16 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:17 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:19 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:19 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:20 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:21 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:22 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:23 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:24 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:25 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:26 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:27 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:28 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:29 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:30 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:31 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:32 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:33 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:34 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:35 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:36 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:37 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:38 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:39 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:40 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:41 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:42 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:43 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:44 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:45 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:46 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:47 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:48 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:49 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:50 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:51 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:52 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:53 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:54 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:55 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:56 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:57 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:58 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:36:59 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:37:00 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:37:01 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:37:02 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:37:03 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:37:04 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:37:05 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:37:06 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:37:07 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:37:08 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:37:09 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:37:10 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:37:11 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:37:12 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:37:13 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:37:14 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:37:15 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:37:16 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:37:17 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:37:18 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:37:19 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:37:20 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:37:21 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:37:22 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:37:23 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:37:24 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:37:25 +0000] "GET /index.html HTTP/1.1" 200 45 10.244.4.1 - - [18/Aug/2021:11:37:26 +0000] "GET /index.html HTTP/1.1" 200 45 Aug 18 11:37:27.298: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=statefulset-3111 describe po ss2-2' Aug 18 11:37:27.480: INFO: stderr: "" Aug 18 11:37:27.480: INFO: stdout: "Name: ss2-2\nNamespace: statefulset-3111\nPriority: 0\nNode: node2/10.10.190.208\nStart Time: Wed, 18 Aug 2021 11:27:31 +0000\nLabels: baz=blah\n controller-revision-hash=ss2-65c7964b94\n foo=bar\n statefulset.kubernetes.io/pod-name=ss2-2\nAnnotations: k8s.v1.cni.cncf.io/network-status:\n [{\n \"name\": \"default-cni-network\",\n \"interface\": \"eth0\",\n \"ips\": [\n \"10.244.3.235\"\n ],\n \"mac\": \"ba:8f:88:d4:84:d9\",\n \"default\": true,\n \"dns\": {}\n }]\n k8s.v1.cni.cncf.io/networks-status:\n [{\n \"name\": \"default-cni-network\",\n \"interface\": \"eth0\",\n \"ips\": [\n \"10.244.3.235\"\n ],\n \"mac\": \"ba:8f:88:d4:84:d9\",\n \"default\": true,\n \"dns\": {}\n }]\n kubernetes.io/psp: collectd\nStatus: Pending\nIP: 10.244.3.235\nIPs:\n IP: 10.244.3.235\nControlled By: StatefulSet/ss2\nContainers:\n webserver:\n Container ID: \n Image: docker.io/library/httpd:2.4.38-alpine\n Image ID: \n Port: \n Host Port: \n State: Waiting\n Reason: ImagePullBackOff\n Ready: False\n Restart Count: 0\n Readiness: http-get http://:80/index.html delay=0s timeout=1s period=1s #success=1 #failure=1\n Environment: \n Mounts:\n /var/run/secrets/kubernetes.io/serviceaccount from default-token-pzft4 (ro)\nConditions:\n Type Status\n Initialized True \n Ready False \n ContainersReady False \n PodScheduled True \nVolumes:\n default-token-pzft4:\n Type: Secret (a volume populated by a Secret)\n SecretName: default-token-pzft4\n Optional: false\nQoS Class: BestEffort\nNode-Selectors: \nTolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s\n node.kubernetes.io/unreachable:NoExecute op=Exists for 300s\nEvents:\n Type Reason Age From Message\n ---- ------ ---- ---- -------\n Normal Scheduled 9m56s default-scheduler Successfully assigned statefulset-3111/ss2-2 to node2\n Normal AddedInterface 9m55s multus Add eth0 [10.244.3.233/24]\n Normal SandboxChanged 9m53s kubelet Pod sandbox changed, it will be killed and re-created.\n Normal AddedInterface 9m52s multus Add eth0 [10.244.3.235/24]\n Normal BackOff 8m37s (x6 over 9m51s) kubelet Back-off pulling image \"docker.io/library/httpd:2.4.38-alpine\"\n Normal Pulling 8m24s (x4 over 9m55s) kubelet Pulling image \"docker.io/library/httpd:2.4.38-alpine\"\n Warning Failed 8m23s (x4 over 9m54s) kubelet Failed to pull image \"docker.io/library/httpd:2.4.38-alpine\": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit\n Warning Failed 8m23s (x4 over 9m54s) kubelet Error: ErrImagePull\n Warning Failed 4m54s (x21 over 9m51s) kubelet Error: ImagePullBackOff\n" Aug 18 11:37:27.480: INFO: Output of kubectl describe ss2-2: Name: ss2-2 Namespace: statefulset-3111 Priority: 0 Node: node2/10.10.190.208 Start Time: Wed, 18 Aug 2021 11:27:31 +0000 Labels: baz=blah controller-revision-hash=ss2-65c7964b94 foo=bar statefulset.kubernetes.io/pod-name=ss2-2 Annotations: k8s.v1.cni.cncf.io/network-status: [{ "name": "default-cni-network", "interface": "eth0", "ips": [ "10.244.3.235" ], "mac": "ba:8f:88:d4:84:d9", "default": true, "dns": {} }] k8s.v1.cni.cncf.io/networks-status: [{ "name": "default-cni-network", "interface": "eth0", "ips": [ "10.244.3.235" ], "mac": "ba:8f:88:d4:84:d9", "default": true, "dns": {} }] kubernetes.io/psp: collectd Status: Pending IP: 10.244.3.235 IPs: IP: 10.244.3.235 Controlled By: StatefulSet/ss2 Containers: webserver: Container ID: Image: docker.io/library/httpd:2.4.38-alpine Image ID: Port: Host Port: State: Waiting Reason: ImagePullBackOff Ready: False Restart Count: 0 Readiness: http-get http://:80/index.html delay=0s timeout=1s period=1s #success=1 #failure=1 Environment: Mounts: /var/run/secrets/kubernetes.io/serviceaccount from default-token-pzft4 (ro) Conditions: Type Status Initialized True Ready False ContainersReady False PodScheduled True Volumes: default-token-pzft4: Type: Secret (a volume populated by a Secret) SecretName: default-token-pzft4 Optional: false QoS Class: BestEffort Node-Selectors: Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s node.kubernetes.io/unreachable:NoExecute op=Exists for 300s Events: Type Reason Age From Message ---- ------ ---- ---- ------- Normal Scheduled 9m56s default-scheduler Successfully assigned statefulset-3111/ss2-2 to node2 Normal AddedInterface 9m55s multus Add eth0 [10.244.3.233/24] Normal SandboxChanged 9m53s kubelet Pod sandbox changed, it will be killed and re-created. Normal AddedInterface 9m52s multus Add eth0 [10.244.3.235/24] Normal BackOff 8m37s (x6 over 9m51s) kubelet Back-off pulling image "docker.io/library/httpd:2.4.38-alpine" Normal Pulling 8m24s (x4 over 9m55s) kubelet Pulling image "docker.io/library/httpd:2.4.38-alpine" Warning Failed 8m23s (x4 over 9m54s) kubelet Failed to pull image "docker.io/library/httpd:2.4.38-alpine": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit Warning Failed 8m23s (x4 over 9m54s) kubelet Error: ErrImagePull Warning Failed 4m54s (x21 over 9m51s) kubelet Error: ImagePullBackOff Aug 18 11:37:27.480: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=statefulset-3111 logs ss2-2 --tail=100' Aug 18 11:37:27.628: INFO: rc: 1 Aug 18 11:37:27.628: INFO: Last 100 log lines of ss2-2: Aug 18 11:37:27.628: INFO: Deleting all statefulset in ns statefulset-3111 Aug 18 11:37:27.631: INFO: Scaling statefulset ss2 to 0 Aug 18 11:37:57.643: INFO: Waiting for statefulset status.replicas updated to 0 Aug 18 11:37:57.646: INFO: Deleting statefulset ss2 [AfterEach] [sig-apps] StatefulSet /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "statefulset-3111". STEP: Found 66 events. Aug 18 11:37:57.662: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for ss2-0: { } Scheduled: Successfully assigned statefulset-3111/ss2-0 to node1 Aug 18 11:37:57.662: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for ss2-0: { } Scheduled: Successfully assigned statefulset-3111/ss2-0 to node1 Aug 18 11:37:57.662: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for ss2-1: { } Scheduled: Successfully assigned statefulset-3111/ss2-1 to node2 Aug 18 11:37:57.662: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for ss2-1: { } Scheduled: Successfully assigned statefulset-3111/ss2-1 to node1 Aug 18 11:37:57.662: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for ss2-2: { } Scheduled: Successfully assigned statefulset-3111/ss2-2 to node2 Aug 18 11:37:57.662: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for ss2-2: { } Scheduled: Successfully assigned statefulset-3111/ss2-2 to node2 Aug 18 11:37:57.662: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for ss2-2: { } Scheduled: Successfully assigned statefulset-3111/ss2-2 to node1 Aug 18 11:37:57.662: INFO: At 2021-08-18 11:25:14 +0000 UTC - event for ss2: {statefulset-controller } SuccessfulCreate: create Pod ss2-0 in StatefulSet ss2 successful Aug 18 11:37:57.662: INFO: At 2021-08-18 11:25:17 +0000 UTC - event for ss2-0: {multus } AddedInterface: Add eth0 [10.244.4.194/24] Aug 18 11:37:57.662: INFO: At 2021-08-18 11:25:17 +0000 UTC - event for ss2-0: {kubelet node1} Pulling: Pulling image "docker.io/library/httpd:2.4.38-alpine" Aug 18 11:37:57.662: INFO: At 2021-08-18 11:25:25 +0000 UTC - event for ss2-0: {kubelet node1} Pulled: Successfully pulled image "docker.io/library/httpd:2.4.38-alpine" in 7.837431469s Aug 18 11:37:57.662: INFO: At 2021-08-18 11:25:26 +0000 UTC - event for ss2-0: {kubelet node1} Created: Created container webserver Aug 18 11:37:57.662: INFO: At 2021-08-18 11:25:26 +0000 UTC - event for ss2-0: {kubelet node1} Started: Started container webserver Aug 18 11:37:57.662: INFO: At 2021-08-18 11:25:28 +0000 UTC - event for ss2: {statefulset-controller } SuccessfulCreate: create Pod ss2-1 in StatefulSet ss2 successful Aug 18 11:37:57.662: INFO: At 2021-08-18 11:25:29 +0000 UTC - event for ss2-1: {multus } AddedInterface: Add eth0 [10.244.3.197/24] Aug 18 11:37:57.662: INFO: At 2021-08-18 11:25:29 +0000 UTC - event for ss2-1: {kubelet node2} Pulling: Pulling image "docker.io/library/httpd:2.4.38-alpine" Aug 18 11:37:57.662: INFO: At 2021-08-18 11:25:31 +0000 UTC - event for ss2-1: {kubelet node2} Started: Started container webserver Aug 18 11:37:57.662: INFO: At 2021-08-18 11:25:31 +0000 UTC - event for ss2-1: {kubelet node2} Pulled: Successfully pulled image "docker.io/library/httpd:2.4.38-alpine" in 1.520008953s Aug 18 11:37:57.662: INFO: At 2021-08-18 11:25:31 +0000 UTC - event for ss2-1: {kubelet node2} Created: Created container webserver Aug 18 11:37:57.662: INFO: At 2021-08-18 11:25:33 +0000 UTC - event for ss2: {statefulset-controller } SuccessfulCreate: create Pod ss2-2 in StatefulSet ss2 successful Aug 18 11:37:57.662: INFO: At 2021-08-18 11:25:35 +0000 UTC - event for ss2-2: {kubelet node1} Pulling: Pulling image "docker.io/library/httpd:2.4.38-alpine" Aug 18 11:37:57.662: INFO: At 2021-08-18 11:25:35 +0000 UTC - event for ss2-2: {multus } AddedInterface: Add eth0 [10.244.4.203/24] Aug 18 11:37:57.662: INFO: At 2021-08-18 11:25:38 +0000 UTC - event for ss2-2: {kubelet node1} Created: Created container webserver Aug 18 11:37:57.662: INFO: At 2021-08-18 11:25:38 +0000 UTC - event for ss2-2: {kubelet node1} Started: Started container webserver Aug 18 11:37:57.662: INFO: At 2021-08-18 11:25:38 +0000 UTC - event for ss2-2: {kubelet node1} Pulled: Successfully pulled image "docker.io/library/httpd:2.4.38-alpine" in 2.988403461s Aug 18 11:37:57.662: INFO: At 2021-08-18 11:25:45 +0000 UTC - event for ss2-1: {kubelet node2} Unhealthy: Readiness probe failed: HTTP probe failed with statuscode: 404 Aug 18 11:37:57.663: INFO: At 2021-08-18 11:26:05 +0000 UTC - event for ss2: {statefulset-controller } SuccessfulDelete: delete Pod ss2-2 in StatefulSet ss2 successful Aug 18 11:37:57.663: INFO: At 2021-08-18 11:26:05 +0000 UTC - event for ss2-2: {kubelet node1} Killing: Stopping container webserver Aug 18 11:37:57.663: INFO: At 2021-08-18 11:26:05 +0000 UTC - event for ss2-2: {kubelet node1} Unhealthy: Readiness probe failed: Get "http://10.244.4.203:80/index.html": dial tcp 10.244.4.203:80: connect: connection refused Aug 18 11:37:57.663: INFO: At 2021-08-18 11:26:07 +0000 UTC - event for ss2-2: {kubelet node1} Unhealthy: Readiness probe failed: Get "http://10.244.4.203:80/index.html": dial tcp 10.244.4.203:80: i/o timeout (Client.Timeout exceeded while awaiting headers) Aug 18 11:37:57.663: INFO: At 2021-08-18 11:26:08 +0000 UTC - event for ss2-2: {kubelet node1} Unhealthy: Readiness probe failed: Get "http://10.244.4.203:80/index.html": context deadline exceeded (Client.Timeout exceeded while awaiting headers) Aug 18 11:37:57.663: INFO: At 2021-08-18 11:26:15 +0000 UTC - event for ss2-2: {kubelet node2} Pulling: Pulling image "docker.io/library/httpd:2.4.39-alpine" Aug 18 11:37:57.663: INFO: At 2021-08-18 11:26:15 +0000 UTC - event for ss2-2: {multus } AddedInterface: Add eth0 [10.244.3.212/24] Aug 18 11:37:57.663: INFO: At 2021-08-18 11:26:20 +0000 UTC - event for ss2-2: {kubelet node2} Pulled: Successfully pulled image "docker.io/library/httpd:2.4.39-alpine" in 4.945783948s Aug 18 11:37:57.663: INFO: At 2021-08-18 11:26:20 +0000 UTC - event for ss2-2: {kubelet node2} Started: Started container webserver Aug 18 11:37:57.663: INFO: At 2021-08-18 11:26:20 +0000 UTC - event for ss2-2: {kubelet node2} Created: Created container webserver Aug 18 11:37:57.663: INFO: At 2021-08-18 11:26:22 +0000 UTC - event for ss2: {statefulset-controller } SuccessfulDelete: delete Pod ss2-1 in StatefulSet ss2 successful Aug 18 11:37:57.663: INFO: At 2021-08-18 11:26:22 +0000 UTC - event for ss2-1: {kubelet node2} Killing: Stopping container webserver Aug 18 11:37:57.663: INFO: At 2021-08-18 11:26:33 +0000 UTC - event for ss2-1: {multus } AddedInterface: Add eth0 [10.244.4.226/24] Aug 18 11:37:57.663: INFO: At 2021-08-18 11:26:33 +0000 UTC - event for ss2-1: {kubelet node1} Pulling: Pulling image "docker.io/library/httpd:2.4.39-alpine" Aug 18 11:37:57.663: INFO: At 2021-08-18 11:26:39 +0000 UTC - event for ss2-1: {kubelet node1} Started: Started container webserver Aug 18 11:37:57.663: INFO: At 2021-08-18 11:26:39 +0000 UTC - event for ss2-1: {kubelet node1} Created: Created container webserver Aug 18 11:37:57.663: INFO: At 2021-08-18 11:26:39 +0000 UTC - event for ss2-1: {kubelet node1} Pulled: Successfully pulled image "docker.io/library/httpd:2.4.39-alpine" in 6.21847623s Aug 18 11:37:57.663: INFO: At 2021-08-18 11:26:40 +0000 UTC - event for ss2: {statefulset-controller } SuccessfulDelete: delete Pod ss2-0 in StatefulSet ss2 successful Aug 18 11:37:57.663: INFO: At 2021-08-18 11:26:40 +0000 UTC - event for ss2-0: {kubelet node1} Killing: Stopping container webserver Aug 18 11:37:57.663: INFO: At 2021-08-18 11:26:41 +0000 UTC - event for ss2-0: {kubelet node1} Unhealthy: Readiness probe failed: Get "http://10.244.4.194:80/index.html": dial tcp 10.244.4.194:80: connect: connection refused Aug 18 11:37:57.663: INFO: At 2021-08-18 11:26:43 +0000 UTC - event for ss2-0: {kubelet node1} Unhealthy: Readiness probe failed: Get "http://10.244.4.194:80/index.html": dial tcp 10.244.4.194:80: i/o timeout (Client.Timeout exceeded while awaiting headers) Aug 18 11:37:57.663: INFO: At 2021-08-18 11:26:48 +0000 UTC - event for ss2-0: {kubelet node1} Pulling: Pulling image "docker.io/library/httpd:2.4.39-alpine" Aug 18 11:37:57.663: INFO: At 2021-08-18 11:26:48 +0000 UTC - event for ss2-0: {multus } AddedInterface: Add eth0 [10.244.4.231/24] Aug 18 11:37:57.663: INFO: At 2021-08-18 11:26:50 +0000 UTC - event for ss2-0: {kubelet node1} Started: Started container webserver Aug 18 11:37:57.663: INFO: At 2021-08-18 11:26:50 +0000 UTC - event for ss2-0: {kubelet node1} Created: Created container webserver Aug 18 11:37:57.663: INFO: At 2021-08-18 11:26:50 +0000 UTC - event for ss2-0: {kubelet node1} Pulled: Successfully pulled image "docker.io/library/httpd:2.4.39-alpine" in 1.927338402s Aug 18 11:37:57.663: INFO: At 2021-08-18 11:26:55 +0000 UTC - event for ss2-1: {kubelet node1} Unhealthy: Readiness probe failed: HTTP probe failed with statuscode: 404 Aug 18 11:37:57.663: INFO: At 2021-08-18 11:27:17 +0000 UTC - event for ss2-2: {kubelet node2} Killing: Stopping container webserver Aug 18 11:37:57.663: INFO: At 2021-08-18 11:27:19 +0000 UTC - event for ss2-2: {kubelet node2} Unhealthy: Readiness probe failed: Get "http://10.244.3.212:80/index.html": context deadline exceeded (Client.Timeout exceeded while awaiting headers) Aug 18 11:37:57.663: INFO: At 2021-08-18 11:27:32 +0000 UTC - event for ss2-2: {multus } AddedInterface: Add eth0 [10.244.3.233/24] Aug 18 11:37:57.663: INFO: At 2021-08-18 11:27:32 +0000 UTC - event for ss2-2: {kubelet node2} Pulling: Pulling image "docker.io/library/httpd:2.4.38-alpine" Aug 18 11:37:57.663: INFO: At 2021-08-18 11:27:33 +0000 UTC - event for ss2-2: {kubelet node2} Failed: Error: ErrImagePull Aug 18 11:37:57.663: INFO: At 2021-08-18 11:27:33 +0000 UTC - event for ss2-2: {kubelet node2} Failed: Failed to pull image "docker.io/library/httpd:2.4.38-alpine": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit Aug 18 11:37:57.663: INFO: At 2021-08-18 11:27:34 +0000 UTC - event for ss2-2: {kubelet node2} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Aug 18 11:37:57.663: INFO: At 2021-08-18 11:27:35 +0000 UTC - event for ss2-2: {multus } AddedInterface: Add eth0 [10.244.3.235/24] Aug 18 11:37:57.663: INFO: At 2021-08-18 11:27:36 +0000 UTC - event for ss2-2: {kubelet node2} BackOff: Back-off pulling image "docker.io/library/httpd:2.4.38-alpine" Aug 18 11:37:57.663: INFO: At 2021-08-18 11:27:36 +0000 UTC - event for ss2-2: {kubelet node2} Failed: Error: ImagePullBackOff Aug 18 11:37:57.663: INFO: At 2021-08-18 11:37:29 +0000 UTC - event for ss2-1: {kubelet node1} Killing: Stopping container webserver Aug 18 11:37:57.663: INFO: At 2021-08-18 11:37:31 +0000 UTC - event for ss2-1: {kubelet node1} Unhealthy: Readiness probe failed: Get "http://10.244.4.226:80/index.html": context deadline exceeded (Client.Timeout exceeded while awaiting headers) Aug 18 11:37:57.663: INFO: At 2021-08-18 11:37:41 +0000 UTC - event for ss2-0: {kubelet node1} Killing: Stopping container webserver Aug 18 11:37:57.666: INFO: POD NODE PHASE GRACE CONDITIONS Aug 18 11:37:57.666: INFO: Aug 18 11:37:57.671: INFO: Logging node info for node master1 Aug 18 11:37:57.674: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 ebb211fa-503f-4cfe-b1ed-c95d27a70e6e 65222 0 2021-08-18 08:20:52 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"3a:82:be:72:b5:15"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:20:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:20:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:25:59 +0000 UTC,LastTransitionTime:2021-08-18 08:25:59 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:37:54 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:37:54 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:37:54 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:37:54 +0000 UTC,LastTransitionTime:2021-08-18 08:25:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:58c3e57359b641ad92fa1959f2fecf5d,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:012cd796-2076-45d6-8b14-d3e0451b1e64,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[@ :],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:37:57.675: INFO: Logging kubelet events for node master1 Aug 18 11:37:57.678: INFO: Logging pods the kubelet thinks is on node master1 Aug 18 11:37:57.699: INFO: kube-apiserver-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:57.699: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:37:57.699: INFO: kube-proxy-vqk4v started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:57.699: INFO: Container kube-proxy ready: true, restart count 1 Aug 18 11:37:57.699: INFO: kube-flannel-q64cq started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:37:57.699: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:37:57.699: INFO: Container kube-flannel ready: true, restart count 3 Aug 18 11:37:57.699: INFO: coredns-7677f9bb54-kn2qg started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:57.699: INFO: Container coredns ready: true, restart count 2 Aug 18 11:37:57.699: INFO: kube-scheduler-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:57.699: INFO: Container kube-scheduler ready: true, restart count 0 Aug 18 11:37:57.699: INFO: kube-controller-manager-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:57.699: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:37:57.699: INFO: kube-multus-ds-amd64-kbcp6 started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:57.699: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:37:57.699: INFO: docker-registry-docker-registry-56cbc7bc58-49kl2 started at 2021-08-18 08:26:23 +0000 UTC (0+2 container statuses recorded) Aug 18 11:37:57.699: INFO: Container docker-registry ready: true, restart count 0 Aug 18 11:37:57.699: INFO: Container nginx ready: true, restart count 0 Aug 18 11:37:57.699: INFO: node-exporter-5hwz9 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:37:57.699: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:37:57.699: INFO: Container node-exporter ready: true, restart count 0 W0818 11:37:57.712598 31 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:37:57.740: INFO: Latency metrics for node master1 Aug 18 11:37:57.740: INFO: Logging node info for node master2 Aug 18 11:37:57.743: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 78946293-3abe-4442-84d4-8ed6b1d15ce0 65216 0 2021-08-18 08:21:31 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"7e:f5:c2:cc:3a:b4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:21:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:21:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-08-18 08:29:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:37:53 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:37:53 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:37:53 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:37:53 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0c44122c7a7248c18d8571e1cc667258,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:0cd329f2-48e0-4c8f-b8b9-fa3ae0ed8406,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:37:57.743: INFO: Logging kubelet events for node master2 Aug 18 11:37:57.746: INFO: Logging pods the kubelet thinks is on node master2 Aug 18 11:37:57.755: INFO: kube-proxy-kh2l9 started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:57.755: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:37:57.755: INFO: kube-flannel-pp56h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:37:57.755: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:37:57.755: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:37:57.755: INFO: kube-controller-manager-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:57.755: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:37:57.755: INFO: kube-scheduler-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:57.755: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:37:57.755: INFO: kube-multus-ds-amd64-mld8g started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:57.755: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:37:57.755: INFO: dns-autoscaler-5b7b5c9b6f-hh47r started at 2021-08-18 08:23:57 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:57.755: INFO: Container autoscaler ready: true, restart count 2 Aug 18 11:37:57.755: INFO: node-feature-discovery-controller-5bf5c49849-mq57c started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:57.755: INFO: Container nfd-controller ready: true, restart count 0 Aug 18 11:37:57.755: INFO: node-exporter-48nfx started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:37:57.755: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:37:57.755: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:37:57.755: INFO: kube-apiserver-master2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:57.755: INFO: Container kube-apiserver ready: true, restart count 0 W0818 11:37:57.767592 31 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:37:57.791: INFO: Latency metrics for node master2 Aug 18 11:37:57.791: INFO: Logging node info for node master3 Aug 18 11:37:57.793: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 44feac2b-9447-4be2-9fcd-62f836d67c72 65192 0 2021-08-18 08:21:41 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"86:e4:31:99:58:40"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {kubelet Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:37:48 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:37:48 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:37:48 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:37:48 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1fae19ae59884c44899bcd08aa243244,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:5db926c5-6530-4635-a0d5-806974a3b732,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:37:57.794: INFO: Logging kubelet events for node master3 Aug 18 11:37:57.796: INFO: Logging pods the kubelet thinks is on node master3 Aug 18 11:37:57.803: INFO: kube-controller-manager-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:57.803: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:37:57.803: INFO: kube-scheduler-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:57.803: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:37:57.803: INFO: kube-apiserver-master3 started at 2021-08-18 08:29:12 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:57.803: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:37:57.803: INFO: kube-proxy-sd5lc started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:57.803: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:37:57.803: INFO: kube-flannel-x6tlr started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:37:57.803: INFO: Init container install-cni ready: true, restart count 1 Aug 18 11:37:57.803: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:37:57.803: INFO: kube-multus-ds-amd64-bkw6c started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:57.803: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:37:57.803: INFO: coredns-7677f9bb54-5hxfh started at 2021-08-18 08:23:54 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:57.803: INFO: Container coredns ready: true, restart count 1 Aug 18 11:37:57.803: INFO: node-exporter-vq7d8 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:37:57.803: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:37:57.803: INFO: Container node-exporter ready: true, restart count 0 W0818 11:37:57.817707 31 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:37:57.840: INFO: Latency metrics for node master3 Aug 18 11:37:57.840: INFO: Logging node info for node node1 Aug 18 11:37:57.843: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 84defabd-6ebf-43ec-a629-44c6713da9c9 65213 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"9a:87:55:36:7b:df"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:13 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:35 +0000 UTC,LastTransitionTime:2021-08-18 08:26:35 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:37:53 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:37:53 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:37:53 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:37:53 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:69946ff2b7bc462fa25eb7adb4703c23,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:736dc52f-f5e3-494e-86ca-01eedbea015c,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:a7cea43d9d2f67c38fbf0407786edbe660ee9072945f7bb272b55fd255e8eaca opnfv/barometer-collectd:stable],SizeBytes:1075746799,},ContainerImage{Names:[@ :],SizeBytes:1003788820,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[aquasec/kube-hunter@sha256:2be6820bc1d7e0f57193a9a27d5a3e16b2fd93c53747b03ce8ca48c6fc323781 aquasec/kube-hunter:0.3.1],SizeBytes:347611549,},ContainerImage{Names:[golang@sha256:db2475a1dbb2149508e5db31d7d77a75e6600d54be645f37681f03f2762169ba golang:alpine3.12],SizeBytes:301186719,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:de25c7fc6c4f3a27c7f0c2dff454e4671823a34d88abd533f210848d527e0fbb alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:37:57.844: INFO: Logging kubelet events for node node1 Aug 18 11:37:57.845: INFO: Logging pods the kubelet thinks is on node node1 Aug 18 11:37:57.859: INFO: nginx-proxy-node1 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:57.859: INFO: Container nginx-proxy ready: true, restart count 2 Aug 18 11:37:57.859: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-vsxvg started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:57.859: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:37:57.859: INFO: fail-once-local-8rxnh started at 2021-08-18 11:34:14 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:57.859: INFO: Container c ready: false, restart count 0 Aug 18 11:37:57.859: INFO: pod-update-activedeadlineseconds-2e72b8c4-086d-4288-89a4-b11d1b093416 started at 2021-08-18 11:34:21 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:57.859: INFO: Container nginx ready: false, restart count 0 Aug 18 11:37:57.859: INFO: kube-flannel-q78nd started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:37:57.859: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:37:57.859: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:37:57.859: INFO: prometheus-k8s-0 started at 2021-08-18 08:34:03 +0000 UTC (0+5 container statuses recorded) Aug 18 11:37:57.859: INFO: Container custom-metrics-apiserver ready: true, restart count 0 Aug 18 11:37:57.859: INFO: Container grafana ready: true, restart count 0 Aug 18 11:37:57.859: INFO: Container prometheus ready: true, restart count 1 Aug 18 11:37:57.859: INFO: Container prometheus-config-reloader ready: true, restart count 0 Aug 18 11:37:57.859: INFO: Container rules-configmap-reloader ready: true, restart count 0 Aug 18 11:37:57.859: INFO: kube-multus-ds-amd64-rrvmb started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:57.859: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:37:57.859: INFO: node-feature-discovery-worker-pflgw started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:57.859: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:37:57.859: INFO: node-exporter-kcwvn started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:37:57.859: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:37:57.859: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:37:57.859: INFO: ss2-0 started at 2021-08-18 11:32:47 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:57.859: INFO: Container webserver ready: false, restart count 0 Aug 18 11:37:57.859: INFO: busybox-host-aliasesf99672e9-247c-4ef1-98b7-d10beeb0de14 started at 2021-08-18 11:35:06 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:57.859: INFO: Container busybox-host-aliasesf99672e9-247c-4ef1-98b7-d10beeb0de14 ready: false, restart count 0 Aug 18 11:37:57.859: INFO: kube-proxy-p6jvp started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:57.859: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:37:57.859: INFO: kubernetes-metrics-scraper-678c97765c-9nsv5 started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:57.859: INFO: Container kubernetes-metrics-scraper ready: true, restart count 2 Aug 18 11:37:57.859: INFO: cmk-init-discover-node1-bxznx started at 2021-08-18 08:32:10 +0000 UTC (0+3 container statuses recorded) Aug 18 11:37:57.859: INFO: Container discover ready: false, restart count 0 Aug 18 11:37:57.859: INFO: Container init ready: false, restart count 0 Aug 18 11:37:57.859: INFO: Container install ready: false, restart count 0 Aug 18 11:37:57.859: INFO: cmk-d8r27 started at 2021-08-18 08:32:52 +0000 UTC (0+2 container statuses recorded) Aug 18 11:37:57.859: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:37:57.859: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:37:57.859: INFO: collectd-xdprr started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:37:57.859: INFO: Container collectd ready: true, restart count 0 Aug 18 11:37:57.859: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:37:57.859: INFO: Container rbac-proxy ready: true, restart count 0 W0818 11:37:57.872210 31 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:37:57.905: INFO: Latency metrics for node node1 Aug 18 11:37:57.905: INFO: Logging node info for node node2 Aug 18 11:37:57.907: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 1d01177e-3dbb-48a1-a0bc-d18af27ab7f8 65214 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:d1:47:f8:1d:22"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:36 +0000 UTC,LastTransitionTime:2021-08-18 08:26:36 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:37:53 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:37:53 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:37:53 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:37:53 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:dc1f286135c145349b8a016880b65a2f,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:037e7e2d-94e9-42f4-a719-896e5005ac70,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:37:57.908: INFO: Logging kubelet events for node node2 Aug 18 11:37:57.910: INFO: Logging pods the kubelet thinks is on node node2 Aug 18 11:37:57.924: INFO: fail-once-local-pk5cs started at 2021-08-18 11:34:14 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:57.924: INFO: Container c ready: false, restart count 0 Aug 18 11:37:57.924: INFO: nginx-proxy-node2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:57.924: INFO: Container nginx-proxy ready: true, restart count 1 Aug 18 11:37:57.924: INFO: cmk-init-discover-node2-6b2kz started at 2021-08-18 08:32:30 +0000 UTC (0+3 container statuses recorded) Aug 18 11:37:57.924: INFO: Container discover ready: false, restart count 0 Aug 18 11:37:57.924: INFO: Container init ready: false, restart count 0 Aug 18 11:37:57.924: INFO: Container install ready: false, restart count 0 Aug 18 11:37:57.924: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-7rn45 started at 2021-08-18 08:36:42 +0000 UTC (0+2 container statuses recorded) Aug 18 11:37:57.924: INFO: Container tas-controller ready: true, restart count 0 Aug 18 11:37:57.924: INFO: Container tas-extender ready: true, restart count 0 Aug 18 11:37:57.924: INFO: kubernetes-dashboard-86c6f9df5b-qrtdk started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:57.924: INFO: Container kubernetes-dashboard ready: true, restart count 2 Aug 18 11:37:57.924: INFO: liveness-d2835d64-2674-44b0-8016-a182b2556b33 started at 2021-08-18 11:34:45 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:57.924: INFO: Container liveness ready: true, restart count 0 Aug 18 11:37:57.924: INFO: cmk-748rz started at 2021-08-18 08:32:53 +0000 UTC (0+2 container statuses recorded) Aug 18 11:37:57.924: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:37:57.924: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:37:57.924: INFO: pod-configmaps-cf74abd4-bad1-4742-9696-0545d27eacc5 started at 2021-08-18 11:35:12 +0000 UTC (0+2 container statuses recorded) Aug 18 11:37:57.924: INFO: Container configmap-volume-binary-test ready: false, restart count 0 Aug 18 11:37:57.924: INFO: Container configmap-volume-data-test ready: true, restart count 0 Aug 18 11:37:57.924: INFO: pod-adoption started at 2021-08-18 11:36:15 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:57.924: INFO: Container pod-adoption ready: false, restart count 0 Aug 18 11:37:57.924: INFO: kube-proxy-qkj9c started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:57.924: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:37:57.924: INFO: node-feature-discovery-worker-hzpf5 started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:57.924: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:37:57.924: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-c82pt started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:57.924: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:37:57.924: INFO: prometheus-operator-5bb8cb9d8f-k97ws started at 2021-08-18 08:33:38 +0000 UTC (0+2 container statuses recorded) Aug 18 11:37:57.924: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:37:57.924: INFO: Container prometheus-operator ready: true, restart count 0 Aug 18 11:37:57.924: INFO: kube-multus-ds-amd64-rvzsg started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:57.924: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:37:57.924: INFO: collectd-67ntq started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:37:57.924: INFO: Container collectd ready: true, restart count 0 Aug 18 11:37:57.924: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:37:57.924: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:37:57.924: INFO: cmk-webhook-6c9d5f8578-7cxjr started at 2021-08-18 08:32:53 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:57.924: INFO: Container cmk-webhook ready: true, restart count 0 Aug 18 11:37:57.924: INFO: pod-init-c9a6ec62-328a-48d0-ad87-8e4a921066e8 started at 2021-08-18 11:37:42 +0000 UTC (2+1 container statuses recorded) Aug 18 11:37:57.924: INFO: Init container init1 ready: false, restart count 0 Aug 18 11:37:57.924: INFO: Init container init2 ready: false, restart count 0 Aug 18 11:37:57.924: INFO: Container run1 ready: false, restart count 0 Aug 18 11:37:57.924: INFO: kube-flannel-h7t5h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:37:57.924: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:37:57.924: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:37:57.924: INFO: node-exporter-lrrf2 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:37:57.924: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:37:57.924: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:37:57.924: INFO: test-cleanup-controller-vzf4r started at 2021-08-18 11:32:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:37:57.925: INFO: Container httpd ready: false, restart count 0 W0818 11:37:57.936656 31 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:37:57.985: INFO: Latency metrics for node node2 Aug 18 11:37:57.986: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "statefulset-3111" for this suite. • Failure [763.834 seconds] [sig-apps] StatefulSet /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/framework.go:23 [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 should perform rolling updates and roll backs of template modifications [Conformance] [It] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:37:26.524: Failed waiting for state update: timed out waiting for the condition /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/statefulset/wait.go:74 ------------------------------ {"msg":"FAILED [sig-apps] StatefulSet [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] should perform rolling updates and roll backs of template modifications [Conformance]","total":-1,"completed":0,"skipped":31,"failed":1,"failures":["[sig-apps] StatefulSet [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] should perform rolling updates and roll backs of template modifications [Conformance]"]} SSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-apps] Deployment /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:32:59.441: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename deployment STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-apps] Deployment /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/deployment.go:78 [It] deployment should delete old replica sets [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:32:59.471: INFO: Pod name cleanup-pod: Found 0 pods out of 1 Aug 18 11:33:04.474: INFO: Pod name cleanup-pod: Found 1 pods out of 1 STEP: ensuring each pod is running Aug 18 11:38:04.482: FAIL: error in waiting for pods to come up: failed to wait for pods running: [timed out waiting for the condition] Unexpected error: <*errors.errorString | 0xc004602980>: { s: "failed to wait for pods running: [timed out waiting for the condition]", } failed to wait for pods running: [timed out waiting for the condition] occurred Full Stack Trace k8s.io/kubernetes/test/e2e/apps.testDeploymentCleanUpPolicy(0xc000b8e6e0) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/deployment.go:367 +0x55a k8s.io/kubernetes/test/e2e/apps.glob..func4.6() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/deployment.go:109 +0x2a k8s.io/kubernetes/test/e2e.RunE2ETests(0xc001a9de00) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc001a9de00) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc001a9de00, 0x4deb2c0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [sig-apps] Deployment /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/deployment.go:72 Aug 18 11:38:04.486: INFO: Log out all the ReplicaSets if there is no deployment created Aug 18 11:38:04.489: INFO: ReplicaSet "test-cleanup-controller": &ReplicaSet{ObjectMeta:{test-cleanup-controller deployment-7167 /apis/apps/v1/namespaces/deployment-7167/replicasets/test-cleanup-controller 37015821-2c9f-4991-b7d0-4d833a645c47 62621 1 2021-08-18 11:32:59 +0000 UTC map[name:cleanup-pod pod:httpd] map[] [] [] [{e2e.test Update apps/v1 2021-08-18 11:32:59 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{".":{},"f:name":{},"f:pod":{}}},"f:spec":{"f:replicas":{},"f:selector":{"f:matchLabels":{".":{},"f:name":{},"f:pod":{}}},"f:template":{"f:metadata":{"f:labels":{".":{},"f:name":{},"f:pod":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"httpd\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}}}} {kube-controller-manager Update apps/v1 2021-08-18 11:32:59 +0000 UTC FieldsV1 {"f:status":{"f:fullyLabeledReplicas":{},"f:observedGeneration":{},"f:replicas":{}}}}]},Spec:ReplicaSetSpec{Replicas:*1,Selector:&v1.LabelSelector{MatchLabels:map[string]string{name: cleanup-pod,pod: httpd,},MatchExpressions:[]LabelSelectorRequirement{},},Template:{{ 0 0001-01-01 00:00:00 +0000 UTC map[name:cleanup-pod pod:httpd] map[] [] [] []} {[] [] [{httpd docker.io/library/httpd:2.4.38-alpine [] [] [] [] [] {map[] map[]} [] [] nil nil nil nil /dev/termination-log File IfNotPresent nil false false false}] [] Always 0xc002c95a28 ClusterFirst map[] false false false PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,} [] nil default-scheduler [] [] nil [] map[] [] }},MinReadySeconds:0,},Status:ReplicaSetStatus{Replicas:1,FullyLabeledReplicas:1,ObservedGeneration:1,ReadyReplicas:0,AvailableReplicas:0,Conditions:[]ReplicaSetCondition{},},} Aug 18 11:38:04.493: INFO: pod: "test-cleanup-controller-vzf4r": &Pod{ObjectMeta:{test-cleanup-controller-vzf4r test-cleanup-controller- deployment-7167 /api/v1/namespaces/deployment-7167/pods/test-cleanup-controller-vzf4r e59531cc-75a3-40bd-9fbd-77b25764d89b 64642 0 2021-08-18 11:32:59 +0000 UTC map[name:cleanup-pod pod:httpd] map[k8s.v1.cni.cncf.io/network-status:[{ "name": "default-cni-network", "interface": "eth0", "ips": [ "10.244.3.18" ], "mac": "c2:02:06:f1:69:93", "default": true, "dns": {} }] k8s.v1.cni.cncf.io/networks-status:[{ "name": "default-cni-network", "interface": "eth0", "ips": [ "10.244.3.18" ], "mac": "c2:02:06:f1:69:93", "default": true, "dns": {} }] kubernetes.io/psp:collectd] [{apps/v1 ReplicaSet test-cleanup-controller 37015821-2c9f-4991-b7d0-4d833a645c47 0xc002c95d67 0xc002c95d68}] [] [{kube-controller-manager Update v1 2021-08-18 11:32:59 +0000 UTC FieldsV1 {"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:name":{},"f:pod":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"37015821-2c9f-4991-b7d0-4d833a645c47\"}":{".":{},"f:apiVersion":{},"f:blockOwnerDeletion":{},"f:controller":{},"f:kind":{},"f:name":{},"f:uid":{}}}},"f:spec":{"f:containers":{"k:{\"name\":\"httpd\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}} {kubelet Update v1 2021-08-18 11:33:05 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:podIP":{},"f:podIPs":{".":{},"k:{\"ip\":\"10.244.3.18\"}":{".":{},"f:ip":{}}},"f:startTime":{}}}} {multus Update v1 2021-08-18 11:33:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:k8s.v1.cni.cncf.io/network-status":{},"f:k8s.v1.cni.cncf.io/networks-status":{}}}}}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:default-token-kvtpq,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:&SecretVolumeSource{SecretName:default-token-kvtpq,Items:[]KeyToPath{},DefaultMode:*420,Optional:nil,},NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:httpd,Image:docker.io/library/httpd:2.4.38-alpine,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:default-token-kvtpq,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:Always,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*0,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:node2,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,},Status:PodStatus{Phase:Pending,Conditions:[]PodCondition{PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-08-18 11:32:59 +0000 UTC,Reason:,Message:,},PodCondition{Type:Ready,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-08-18 11:32:59 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:ContainersReady,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-08-18 11:32:59 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-08-18 11:32:59 +0000 UTC,Reason:,Message:,},},Message:,Reason:,HostIP:10.10.190.208,PodIP:10.244.3.18,StartTime:2021-08-18 11:32:59 +0000 UTC,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:httpd,State:ContainerState{Waiting:&ContainerStateWaiting{Reason:ImagePullBackOff,Message:Back-off pulling image "docker.io/library/httpd:2.4.38-alpine",},Running:nil,Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:false,RestartCount:0,Image:docker.io/library/httpd:2.4.38-alpine,ImageID:,ContainerID:,Started:*false,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{PodIP{IP:10.244.3.18,},},EphemeralContainerStatuses:[]ContainerStatus{},},} [AfterEach] [sig-apps] Deployment /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "deployment-7167". STEP: Found 10 events. Aug 18 11:38:04.496: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for test-cleanup-controller-vzf4r: { } Scheduled: Successfully assigned deployment-7167/test-cleanup-controller-vzf4r to node2 Aug 18 11:38:04.496: INFO: At 2021-08-18 11:32:59 +0000 UTC - event for test-cleanup-controller: {replicaset-controller } SuccessfulCreate: Created pod: test-cleanup-controller-vzf4r Aug 18 11:38:04.496: INFO: At 2021-08-18 11:33:00 +0000 UTC - event for test-cleanup-controller-vzf4r: {multus } AddedInterface: Add eth0 [10.244.3.16/24] Aug 18 11:38:04.496: INFO: At 2021-08-18 11:33:00 +0000 UTC - event for test-cleanup-controller-vzf4r: {kubelet node2} Pulling: Pulling image "docker.io/library/httpd:2.4.38-alpine" Aug 18 11:38:04.496: INFO: At 2021-08-18 11:33:01 +0000 UTC - event for test-cleanup-controller-vzf4r: {kubelet node2} Failed: Error: ErrImagePull Aug 18 11:38:04.496: INFO: At 2021-08-18 11:33:01 +0000 UTC - event for test-cleanup-controller-vzf4r: {kubelet node2} Failed: Failed to pull image "docker.io/library/httpd:2.4.38-alpine": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit Aug 18 11:38:04.496: INFO: At 2021-08-18 11:33:02 +0000 UTC - event for test-cleanup-controller-vzf4r: {kubelet node2} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Aug 18 11:38:04.496: INFO: At 2021-08-18 11:33:05 +0000 UTC - event for test-cleanup-controller-vzf4r: {multus } AddedInterface: Add eth0 [10.244.3.18/24] Aug 18 11:38:04.496: INFO: At 2021-08-18 11:33:05 +0000 UTC - event for test-cleanup-controller-vzf4r: {kubelet node2} BackOff: Back-off pulling image "docker.io/library/httpd:2.4.38-alpine" Aug 18 11:38:04.496: INFO: At 2021-08-18 11:33:05 +0000 UTC - event for test-cleanup-controller-vzf4r: {kubelet node2} Failed: Error: ImagePullBackOff Aug 18 11:38:04.498: INFO: POD NODE PHASE GRACE CONDITIONS Aug 18 11:38:04.499: INFO: test-cleanup-controller-vzf4r node2 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:32:59 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:32:59 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:32:59 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:32:59 +0000 UTC }] Aug 18 11:38:04.499: INFO: Aug 18 11:38:04.503: INFO: Logging node info for node master1 Aug 18 11:38:04.505: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 ebb211fa-503f-4cfe-b1ed-c95d27a70e6e 65222 0 2021-08-18 08:20:52 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"3a:82:be:72:b5:15"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:20:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:20:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:25:59 +0000 UTC,LastTransitionTime:2021-08-18 08:25:59 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:37:54 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:37:54 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:37:54 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:37:54 +0000 UTC,LastTransitionTime:2021-08-18 08:25:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:58c3e57359b641ad92fa1959f2fecf5d,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:012cd796-2076-45d6-8b14-d3e0451b1e64,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[@ :],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:38:04.505: INFO: Logging kubelet events for node master1 Aug 18 11:38:04.508: INFO: Logging pods the kubelet thinks is on node master1 Aug 18 11:38:04.517: INFO: kube-controller-manager-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:38:04.517: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:38:04.517: INFO: kube-multus-ds-amd64-kbcp6 started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:38:04.517: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:38:04.517: INFO: docker-registry-docker-registry-56cbc7bc58-49kl2 started at 2021-08-18 08:26:23 +0000 UTC (0+2 container statuses recorded) Aug 18 11:38:04.517: INFO: Container docker-registry ready: true, restart count 0 Aug 18 11:38:04.517: INFO: Container nginx ready: true, restart count 0 Aug 18 11:38:04.517: INFO: node-exporter-5hwz9 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:38:04.517: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:38:04.517: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:38:04.517: INFO: kube-apiserver-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:38:04.517: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:38:04.517: INFO: kube-proxy-vqk4v started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:38:04.517: INFO: Container kube-proxy ready: true, restart count 1 Aug 18 11:38:04.517: INFO: kube-flannel-q64cq started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:38:04.517: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:38:04.517: INFO: Container kube-flannel ready: true, restart count 3 Aug 18 11:38:04.517: INFO: coredns-7677f9bb54-kn2qg started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:38:04.517: INFO: Container coredns ready: true, restart count 2 Aug 18 11:38:04.517: INFO: kube-scheduler-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:38:04.517: INFO: Container kube-scheduler ready: true, restart count 0 W0818 11:38:04.530991 34 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:38:04.555: INFO: Latency metrics for node master1 Aug 18 11:38:04.555: INFO: Logging node info for node master2 Aug 18 11:38:04.558: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 78946293-3abe-4442-84d4-8ed6b1d15ce0 65360 0 2021-08-18 08:21:31 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"7e:f5:c2:cc:3a:b4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:21:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:21:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-08-18 08:29:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:38:03 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:38:03 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:38:03 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:38:03 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0c44122c7a7248c18d8571e1cc667258,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:0cd329f2-48e0-4c8f-b8b9-fa3ae0ed8406,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:38:04.559: INFO: Logging kubelet events for node master2 Aug 18 11:38:04.561: INFO: Logging pods the kubelet thinks is on node master2 Aug 18 11:38:04.570: INFO: kube-flannel-pp56h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:38:04.570: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:38:04.570: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:38:04.570: INFO: kube-controller-manager-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:38:04.570: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:38:04.570: INFO: kube-proxy-kh2l9 started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:38:04.570: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:38:04.570: INFO: kube-multus-ds-amd64-mld8g started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:38:04.570: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:38:04.570: INFO: dns-autoscaler-5b7b5c9b6f-hh47r started at 2021-08-18 08:23:57 +0000 UTC (0+1 container statuses recorded) Aug 18 11:38:04.570: INFO: Container autoscaler ready: true, restart count 2 Aug 18 11:38:04.570: INFO: node-feature-discovery-controller-5bf5c49849-mq57c started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:38:04.570: INFO: Container nfd-controller ready: true, restart count 0 Aug 18 11:38:04.570: INFO: node-exporter-48nfx started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:38:04.570: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:38:04.570: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:38:04.570: INFO: kube-apiserver-master2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:38:04.570: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:38:04.570: INFO: kube-scheduler-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:38:04.570: INFO: Container kube-scheduler ready: true, restart count 2 W0818 11:38:04.583126 34 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:38:04.611: INFO: Latency metrics for node master2 Aug 18 11:38:04.611: INFO: Logging node info for node master3 Aug 18 11:38:04.613: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 44feac2b-9447-4be2-9fcd-62f836d67c72 65251 0 2021-08-18 08:21:41 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"86:e4:31:99:58:40"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {kubelet Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:37:58 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:37:58 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:37:58 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:37:58 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1fae19ae59884c44899bcd08aa243244,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:5db926c5-6530-4635-a0d5-806974a3b732,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:38:04.614: INFO: Logging kubelet events for node master3 Aug 18 11:38:04.616: INFO: Logging pods the kubelet thinks is on node master3 Aug 18 11:38:04.624: INFO: kube-scheduler-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:38:04.624: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:38:04.624: INFO: kube-apiserver-master3 started at 2021-08-18 08:29:12 +0000 UTC (0+1 container statuses recorded) Aug 18 11:38:04.624: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:38:04.624: INFO: kube-proxy-sd5lc started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:38:04.624: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:38:04.624: INFO: kube-flannel-x6tlr started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:38:04.624: INFO: Init container install-cni ready: true, restart count 1 Aug 18 11:38:04.624: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:38:04.624: INFO: kube-multus-ds-amd64-bkw6c started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:38:04.624: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:38:04.624: INFO: coredns-7677f9bb54-5hxfh started at 2021-08-18 08:23:54 +0000 UTC (0+1 container statuses recorded) Aug 18 11:38:04.624: INFO: Container coredns ready: true, restart count 1 Aug 18 11:38:04.624: INFO: node-exporter-vq7d8 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:38:04.624: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:38:04.624: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:38:04.624: INFO: kube-controller-manager-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:38:04.624: INFO: Container kube-controller-manager ready: true, restart count 2 W0818 11:38:04.636657 34 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:38:04.665: INFO: Latency metrics for node master3 Aug 18 11:38:04.666: INFO: Logging node info for node node1 Aug 18 11:38:04.668: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 84defabd-6ebf-43ec-a629-44c6713da9c9 65350 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"9a:87:55:36:7b:df"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:13 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:35 +0000 UTC,LastTransitionTime:2021-08-18 08:26:35 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:38:03 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:38:03 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:38:03 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:38:03 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:69946ff2b7bc462fa25eb7adb4703c23,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:736dc52f-f5e3-494e-86ca-01eedbea015c,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:a7cea43d9d2f67c38fbf0407786edbe660ee9072945f7bb272b55fd255e8eaca opnfv/barometer-collectd:stable],SizeBytes:1075746799,},ContainerImage{Names:[@ :],SizeBytes:1003788820,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[aquasec/kube-hunter@sha256:2be6820bc1d7e0f57193a9a27d5a3e16b2fd93c53747b03ce8ca48c6fc323781 aquasec/kube-hunter:0.3.1],SizeBytes:347611549,},ContainerImage{Names:[golang@sha256:db2475a1dbb2149508e5db31d7d77a75e6600d54be645f37681f03f2762169ba golang:alpine3.12],SizeBytes:301186719,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:de25c7fc6c4f3a27c7f0c2dff454e4671823a34d88abd533f210848d527e0fbb alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:38:04.669: INFO: Logging kubelet events for node node1 Aug 18 11:38:04.672: INFO: Logging pods the kubelet thinks is on node node1 Aug 18 11:38:04.687: INFO: busybox-ca1d4157-6037-47c1-a37c-160e2dd5121c started at 2021-08-18 11:37:58 +0000 UTC (0+1 container statuses recorded) Aug 18 11:38:04.687: INFO: Container busybox ready: false, restart count 0 Aug 18 11:38:04.687: INFO: kube-proxy-p6jvp started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:38:04.687: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:38:04.687: INFO: kubernetes-metrics-scraper-678c97765c-9nsv5 started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:38:04.687: INFO: Container kubernetes-metrics-scraper ready: true, restart count 2 Aug 18 11:38:04.687: INFO: cmk-init-discover-node1-bxznx started at 2021-08-18 08:32:10 +0000 UTC (0+3 container statuses recorded) Aug 18 11:38:04.687: INFO: Container discover ready: false, restart count 0 Aug 18 11:38:04.687: INFO: Container init ready: false, restart count 0 Aug 18 11:38:04.687: INFO: Container install ready: false, restart count 0 Aug 18 11:38:04.687: INFO: cmk-d8r27 started at 2021-08-18 08:32:52 +0000 UTC (0+2 container statuses recorded) Aug 18 11:38:04.687: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:38:04.687: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:38:04.687: INFO: collectd-xdprr started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:38:04.687: INFO: Container collectd ready: true, restart count 0 Aug 18 11:38:04.687: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:38:04.687: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:38:04.687: INFO: nginx-proxy-node1 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:38:04.687: INFO: Container nginx-proxy ready: true, restart count 2 Aug 18 11:38:04.687: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-vsxvg started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:38:04.687: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:38:04.687: INFO: fail-once-local-8rxnh started at 2021-08-18 11:34:14 +0000 UTC (0+1 container statuses recorded) Aug 18 11:38:04.687: INFO: Container c ready: false, restart count 0 Aug 18 11:38:04.687: INFO: pod-update-activedeadlineseconds-2e72b8c4-086d-4288-89a4-b11d1b093416 started at 2021-08-18 11:34:21 +0000 UTC (0+1 container statuses recorded) Aug 18 11:38:04.687: INFO: Container nginx ready: false, restart count 0 Aug 18 11:38:04.687: INFO: kube-flannel-q78nd started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:38:04.687: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:38:04.687: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:38:04.687: INFO: prometheus-k8s-0 started at 2021-08-18 08:34:03 +0000 UTC (0+5 container statuses recorded) Aug 18 11:38:04.687: INFO: Container custom-metrics-apiserver ready: true, restart count 0 Aug 18 11:38:04.687: INFO: Container grafana ready: true, restart count 0 Aug 18 11:38:04.687: INFO: Container prometheus ready: true, restart count 1 Aug 18 11:38:04.687: INFO: Container prometheus-config-reloader ready: true, restart count 0 Aug 18 11:38:04.687: INFO: Container rules-configmap-reloader ready: true, restart count 0 Aug 18 11:38:04.687: INFO: kube-multus-ds-amd64-rrvmb started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:38:04.687: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:38:04.687: INFO: node-feature-discovery-worker-pflgw started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:38:04.687: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:38:04.687: INFO: node-exporter-kcwvn started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:38:04.687: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:38:04.687: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:38:04.687: INFO: ss2-0 started at 2021-08-18 11:32:47 +0000 UTC (0+1 container statuses recorded) Aug 18 11:38:04.687: INFO: Container webserver ready: false, restart count 0 Aug 18 11:38:04.687: INFO: busybox-host-aliasesf99672e9-247c-4ef1-98b7-d10beeb0de14 started at 2021-08-18 11:35:06 +0000 UTC (0+1 container statuses recorded) Aug 18 11:38:04.687: INFO: Container busybox-host-aliasesf99672e9-247c-4ef1-98b7-d10beeb0de14 ready: false, restart count 0 W0818 11:38:04.701159 34 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:38:04.746: INFO: Latency metrics for node node1 Aug 18 11:38:04.746: INFO: Logging node info for node node2 Aug 18 11:38:04.749: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 1d01177e-3dbb-48a1-a0bc-d18af27ab7f8 65353 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:d1:47:f8:1d:22"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:36 +0000 UTC,LastTransitionTime:2021-08-18 08:26:36 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:38:03 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:38:03 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:38:03 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:38:03 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:dc1f286135c145349b8a016880b65a2f,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:037e7e2d-94e9-42f4-a719-896e5005ac70,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:38:04.749: INFO: Logging kubelet events for node node2 Aug 18 11:38:04.752: INFO: Logging pods the kubelet thinks is on node node2 Aug 18 11:38:04.773: INFO: kube-proxy-qkj9c started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:38:04.774: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:38:04.774: INFO: node-feature-discovery-worker-hzpf5 started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:38:04.774: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:38:04.774: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-c82pt started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:38:04.774: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:38:04.774: INFO: prometheus-operator-5bb8cb9d8f-k97ws started at 2021-08-18 08:33:38 +0000 UTC (0+2 container statuses recorded) Aug 18 11:38:04.774: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:38:04.774: INFO: Container prometheus-operator ready: true, restart count 0 Aug 18 11:38:04.774: INFO: kube-multus-ds-amd64-rvzsg started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:38:04.774: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:38:04.774: INFO: collectd-67ntq started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:38:04.774: INFO: Container collectd ready: true, restart count 0 Aug 18 11:38:04.774: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:38:04.774: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:38:04.774: INFO: cmk-webhook-6c9d5f8578-7cxjr started at 2021-08-18 08:32:53 +0000 UTC (0+1 container statuses recorded) Aug 18 11:38:04.774: INFO: Container cmk-webhook ready: true, restart count 0 Aug 18 11:38:04.774: INFO: pod-init-c9a6ec62-328a-48d0-ad87-8e4a921066e8 started at 2021-08-18 11:37:42 +0000 UTC (2+1 container statuses recorded) Aug 18 11:38:04.774: INFO: Init container init1 ready: false, restart count 0 Aug 18 11:38:04.774: INFO: Init container init2 ready: false, restart count 0 Aug 18 11:38:04.774: INFO: Container run1 ready: false, restart count 0 Aug 18 11:38:04.774: INFO: kube-flannel-h7t5h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:38:04.774: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:38:04.774: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:38:04.774: INFO: node-exporter-lrrf2 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:38:04.774: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:38:04.774: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:38:04.774: INFO: test-cleanup-controller-vzf4r started at 2021-08-18 11:32:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:38:04.774: INFO: Container httpd ready: false, restart count 0 Aug 18 11:38:04.774: INFO: fail-once-local-pk5cs started at 2021-08-18 11:34:14 +0000 UTC (0+1 container statuses recorded) Aug 18 11:38:04.774: INFO: Container c ready: false, restart count 0 Aug 18 11:38:04.774: INFO: nginx-proxy-node2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:38:04.774: INFO: Container nginx-proxy ready: true, restart count 1 Aug 18 11:38:04.774: INFO: cmk-init-discover-node2-6b2kz started at 2021-08-18 08:32:30 +0000 UTC (0+3 container statuses recorded) Aug 18 11:38:04.774: INFO: Container discover ready: false, restart count 0 Aug 18 11:38:04.774: INFO: Container init ready: false, restart count 0 Aug 18 11:38:04.774: INFO: Container install ready: false, restart count 0 Aug 18 11:38:04.774: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-7rn45 started at 2021-08-18 08:36:42 +0000 UTC (0+2 container statuses recorded) Aug 18 11:38:04.774: INFO: Container tas-controller ready: true, restart count 0 Aug 18 11:38:04.774: INFO: Container tas-extender ready: true, restart count 0 Aug 18 11:38:04.774: INFO: kubernetes-dashboard-86c6f9df5b-qrtdk started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:38:04.774: INFO: Container kubernetes-dashboard ready: true, restart count 2 Aug 18 11:38:04.774: INFO: liveness-d2835d64-2674-44b0-8016-a182b2556b33 started at 2021-08-18 11:34:45 +0000 UTC (0+1 container statuses recorded) Aug 18 11:38:04.774: INFO: Container liveness ready: true, restart count 0 Aug 18 11:38:04.774: INFO: cmk-748rz started at 2021-08-18 08:32:53 +0000 UTC (0+2 container statuses recorded) Aug 18 11:38:04.774: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:38:04.774: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:38:04.774: INFO: pod-configmaps-cf74abd4-bad1-4742-9696-0545d27eacc5 started at 2021-08-18 11:35:12 +0000 UTC (0+2 container statuses recorded) Aug 18 11:38:04.774: INFO: Container configmap-volume-binary-test ready: false, restart count 0 Aug 18 11:38:04.774: INFO: Container configmap-volume-data-test ready: true, restart count 0 Aug 18 11:38:04.774: INFO: pod-adoption started at 2021-08-18 11:36:15 +0000 UTC (0+1 container statuses recorded) Aug 18 11:38:04.774: INFO: Container pod-adoption ready: false, restart count 0 W0818 11:38:04.786432 34 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:38:04.825: INFO: Latency metrics for node node2 Aug 18 11:38:04.825: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "deployment-7167" for this suite. • Failure [305.393 seconds] [sig-apps] Deployment /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/framework.go:23 deployment should delete old replica sets [Conformance] [It] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:38:04.482: error in waiting for pods to come up: failed to wait for pods running: [timed out waiting for the condition] Unexpected error: <*errors.errorString | 0xc004602980>: { s: "failed to wait for pods running: [timed out waiting for the condition]", } failed to wait for pods running: [timed out waiting for the condition] occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/deployment.go:367 ------------------------------ {"msg":"FAILED [sig-apps] Deployment deployment should delete old replica sets [Conformance]","total":-1,"completed":8,"skipped":60,"failed":2,"failures":["[k8s.io] Variable Expansion should verify that a failing subpath expansion can be modified during the lifecycle of a container [sig-storage][Slow] [Conformance]","[sig-apps] Deployment deployment should delete old replica sets [Conformance]"]} SSSS ------------------------------ [BeforeEach] [sig-storage] ConfigMap /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:38:04.851: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename configmap STEP: Waiting for a default service account to be provisioned in namespace [It] optional updates should be reflected in volume [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating configMap with name cm-test-opt-del-c92ed3a5-9ec9-4475-ab76-c8cae9c650ed STEP: Creating configMap with name cm-test-opt-upd-19fd96f9-3a28-4b02-bafb-3c68d19dca3c STEP: Creating the pod STEP: Deleting configmap cm-test-opt-del-c92ed3a5-9ec9-4475-ab76-c8cae9c650ed STEP: Updating configmap cm-test-opt-upd-19fd96f9-3a28-4b02-bafb-3c68d19dca3c STEP: Creating configMap with name cm-test-opt-create-1230f189-848c-4394-a396-471f77368c7d STEP: waiting to observe update in volume [AfterEach] [sig-storage] ConfigMap /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:38:12.980: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "configmap-4076" for this suite. • [SLOW TEST:8.139 seconds] [sig-storage] ConfigMap /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/configmap_volume.go:36 optional updates should be reflected in volume [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-storage] ConfigMap optional updates should be reflected in volume [NodeConformance] [Conformance]","total":-1,"completed":9,"skipped":64,"failed":2,"failures":["[k8s.io] Variable Expansion should verify that a failing subpath expansion can be modified during the lifecycle of a container [sig-storage][Slow] [Conformance]","[sig-apps] Deployment deployment should delete old replica sets [Conformance]"]} SSSS ------------------------------ [BeforeEach] [sig-network] DNS /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:38:13.003: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename dns STEP: Waiting for a default service account to be provisioned in namespace [It] should provide /etc/hosts entries for the cluster [LinuxOnly] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Running these commands on wheezy: for i in `seq 1 600`; do test -n "$$(getent hosts dns-querier-1.dns-test-service.dns-4234.svc.cluster.local)" && echo OK > /results/wheezy_hosts@dns-querier-1.dns-test-service.dns-4234.svc.cluster.local;test -n "$$(getent hosts dns-querier-1)" && echo OK > /results/wheezy_hosts@dns-querier-1;podARec=$$(hostname -i| awk -F. '{print $$1"-"$$2"-"$$3"-"$$4".dns-4234.pod.cluster.local"}');check="$$(dig +notcp +noall +answer +search $${podARec} A)" && test -n "$$check" && echo OK > /results/wheezy_udp@PodARecord;check="$$(dig +tcp +noall +answer +search $${podARec} A)" && test -n "$$check" && echo OK > /results/wheezy_tcp@PodARecord;sleep 1; done STEP: Running these commands on jessie: for i in `seq 1 600`; do test -n "$$(getent hosts dns-querier-1.dns-test-service.dns-4234.svc.cluster.local)" && echo OK > /results/jessie_hosts@dns-querier-1.dns-test-service.dns-4234.svc.cluster.local;test -n "$$(getent hosts dns-querier-1)" && echo OK > /results/jessie_hosts@dns-querier-1;podARec=$$(hostname -i| awk -F. '{print $$1"-"$$2"-"$$3"-"$$4".dns-4234.pod.cluster.local"}');check="$$(dig +notcp +noall +answer +search $${podARec} A)" && test -n "$$check" && echo OK > /results/jessie_udp@PodARecord;check="$$(dig +tcp +noall +answer +search $${podARec} A)" && test -n "$$check" && echo OK > /results/jessie_tcp@PodARecord;sleep 1; done STEP: creating a pod to probe /etc/hosts STEP: submitting the pod to kubernetes STEP: retrieving the pod STEP: looking for the results for each expected name from probers Aug 18 11:38:19.074: INFO: DNS probes using dns-4234/dns-test-f089cf40-08d7-4c67-a8db-501e1115a7f1 succeeded STEP: deleting the pod [AfterEach] [sig-network] DNS /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:38:19.082: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "dns-4234" for this suite. • [SLOW TEST:6.086 seconds] [sig-network] DNS /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/framework.go:23 should provide /etc/hosts entries for the cluster [LinuxOnly] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-network] DNS should provide /etc/hosts entries for the cluster [LinuxOnly] [Conformance]","total":-1,"completed":10,"skipped":68,"failed":2,"failures":["[k8s.io] Variable Expansion should verify that a failing subpath expansion can be modified during the lifecycle of a container [sig-storage][Slow] [Conformance]","[sig-apps] Deployment deployment should delete old replica sets [Conformance]"]} SSSSSSSSS ------------------------------ [BeforeEach] [k8s.io] Probing container /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:34:45.669: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename container-probe STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [k8s.io] Probing container /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:54 [It] should *not* be restarted with a tcp:8080 liveness probe [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating pod liveness-d2835d64-2674-44b0-8016-a182b2556b33 in namespace container-probe-2473 Aug 18 11:34:49.717: INFO: Started pod liveness-d2835d64-2674-44b0-8016-a182b2556b33 in namespace container-probe-2473 STEP: checking the pod's current state and verifying that restartCount is present Aug 18 11:34:49.719: INFO: Initial restart count of pod liveness-d2835d64-2674-44b0-8016-a182b2556b33 is 0 STEP: deleting the pod [AfterEach] [k8s.io] Probing container /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:38:50.149: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "container-probe-2473" for this suite. • [SLOW TEST:244.487 seconds] [k8s.io] Probing container /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 should *not* be restarted with a tcp:8080 liveness probe [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [k8s.io] Probing container should *not* be restarted with a tcp:8080 liveness probe [NodeConformance] [Conformance]","total":-1,"completed":13,"skipped":190,"failed":2,"failures":["[sig-apps] Deployment deployment should support rollover [Conformance]","[sig-network] Services should be able to switch session affinity for NodePort service [LinuxOnly] [Conformance]"]} SSSSSSSSS ------------------------------ [BeforeEach] [sig-storage] Downward API volume /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:38:50.183: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename downward-api STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-storage] Downward API volume /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/downwardapi_volume.go:42 [It] should provide node allocatable (cpu) as default cpu limit if the limit is not set [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating a pod to test downward API volume plugin Aug 18 11:38:50.218: INFO: Waiting up to 5m0s for pod "downwardapi-volume-fccfa755-26b4-4bf4-a973-f602be98afcb" in namespace "downward-api-20" to be "Succeeded or Failed" Aug 18 11:38:50.223: INFO: Pod "downwardapi-volume-fccfa755-26b4-4bf4-a973-f602be98afcb": Phase="Pending", Reason="", readiness=false. Elapsed: 4.15435ms Aug 18 11:38:52.226: INFO: Pod "downwardapi-volume-fccfa755-26b4-4bf4-a973-f602be98afcb": Phase="Pending", Reason="", readiness=false. Elapsed: 2.007613956s Aug 18 11:38:54.229: INFO: Pod "downwardapi-volume-fccfa755-26b4-4bf4-a973-f602be98afcb": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.010693576s STEP: Saw pod success Aug 18 11:38:54.229: INFO: Pod "downwardapi-volume-fccfa755-26b4-4bf4-a973-f602be98afcb" satisfied condition "Succeeded or Failed" Aug 18 11:38:54.231: INFO: Trying to get logs from node node1 pod downwardapi-volume-fccfa755-26b4-4bf4-a973-f602be98afcb container client-container: STEP: delete the pod Aug 18 11:38:54.244: INFO: Waiting for pod downwardapi-volume-fccfa755-26b4-4bf4-a973-f602be98afcb to disappear Aug 18 11:38:54.246: INFO: Pod downwardapi-volume-fccfa755-26b4-4bf4-a973-f602be98afcb no longer exists [AfterEach] [sig-storage] Downward API volume /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:38:54.246: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "downward-api-20" for this suite. • ------------------------------ {"msg":"PASSED [sig-storage] Downward API volume should provide node allocatable (cpu) as default cpu limit if the limit is not set [NodeConformance] [Conformance]","total":-1,"completed":14,"skipped":199,"failed":2,"failures":["[sig-apps] Deployment deployment should support rollover [Conformance]","[sig-network] Services should be able to switch session affinity for NodePort service [LinuxOnly] [Conformance]"]} SSSSSSS ------------------------------ [BeforeEach] [k8s.io] Pods /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:34:21.186: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename pods STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [k8s.io] Pods /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/pods.go:181 [It] should allow activeDeadlineSeconds to be updated [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: creating the pod STEP: submitting the pod to kubernetes Aug 18 11:39:21.231: FAIL: Unexpected error: <*errors.errorString | 0xc0003081f0>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*PodClient).CreateSync(0xc002f34d40, 0xc009701000, 0x0) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:103 +0xfe k8s.io/kubernetes/test/e2e/common.glob..func18.5() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/pods.go:423 +0x498 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc00393c780) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc00393c780) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc00393c780, 0x4deb2c0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] Pods /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "pods-1160". STEP: Found 7 events. Aug 18 11:39:21.236: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for pod-update-activedeadlineseconds-2e72b8c4-086d-4288-89a4-b11d1b093416: { } Scheduled: Successfully assigned pods-1160/pod-update-activedeadlineseconds-2e72b8c4-086d-4288-89a4-b11d1b093416 to node1 Aug 18 11:39:21.236: INFO: At 2021-08-18 11:34:22 +0000 UTC - event for pod-update-activedeadlineseconds-2e72b8c4-086d-4288-89a4-b11d1b093416: {multus } AddedInterface: Add eth0 [10.244.4.26/24] Aug 18 11:39:21.236: INFO: At 2021-08-18 11:34:22 +0000 UTC - event for pod-update-activedeadlineseconds-2e72b8c4-086d-4288-89a4-b11d1b093416: {kubelet node1} Pulling: Pulling image "docker.io/library/nginx:1.14-alpine" Aug 18 11:39:21.236: INFO: At 2021-08-18 11:34:23 +0000 UTC - event for pod-update-activedeadlineseconds-2e72b8c4-086d-4288-89a4-b11d1b093416: {kubelet node1} Failed: Failed to pull image "docker.io/library/nginx:1.14-alpine": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit Aug 18 11:39:21.236: INFO: At 2021-08-18 11:34:23 +0000 UTC - event for pod-update-activedeadlineseconds-2e72b8c4-086d-4288-89a4-b11d1b093416: {kubelet node1} Failed: Error: ErrImagePull Aug 18 11:39:21.236: INFO: At 2021-08-18 11:34:24 +0000 UTC - event for pod-update-activedeadlineseconds-2e72b8c4-086d-4288-89a4-b11d1b093416: {kubelet node1} BackOff: Back-off pulling image "docker.io/library/nginx:1.14-alpine" Aug 18 11:39:21.236: INFO: At 2021-08-18 11:34:24 +0000 UTC - event for pod-update-activedeadlineseconds-2e72b8c4-086d-4288-89a4-b11d1b093416: {kubelet node1} Failed: Error: ImagePullBackOff Aug 18 11:39:21.239: INFO: POD NODE PHASE GRACE CONDITIONS Aug 18 11:39:21.239: INFO: pod-update-activedeadlineseconds-2e72b8c4-086d-4288-89a4-b11d1b093416 node1 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:34:21 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:34:21 +0000 UTC ContainersNotReady containers with unready status: [nginx]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:34:21 +0000 UTC ContainersNotReady containers with unready status: [nginx]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:34:21 +0000 UTC }] Aug 18 11:39:21.239: INFO: Aug 18 11:39:21.243: INFO: Logging node info for node master1 Aug 18 11:39:21.245: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 ebb211fa-503f-4cfe-b1ed-c95d27a70e6e 65875 0 2021-08-18 08:20:52 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"3a:82:be:72:b5:15"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:20:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:20:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:25:59 +0000 UTC,LastTransitionTime:2021-08-18 08:25:59 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:39:15 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:39:15 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:39:15 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:39:15 +0000 UTC,LastTransitionTime:2021-08-18 08:25:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:58c3e57359b641ad92fa1959f2fecf5d,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:012cd796-2076-45d6-8b14-d3e0451b1e64,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[@ :],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:39:21.246: INFO: Logging kubelet events for node master1 Aug 18 11:39:21.248: INFO: Logging pods the kubelet thinks is on node master1 Aug 18 11:39:21.257: INFO: kube-flannel-q64cq started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:39:21.257: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:39:21.257: INFO: Container kube-flannel ready: true, restart count 3 Aug 18 11:39:21.257: INFO: coredns-7677f9bb54-kn2qg started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:39:21.257: INFO: Container coredns ready: true, restart count 2 Aug 18 11:39:21.257: INFO: kube-scheduler-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:39:21.257: INFO: Container kube-scheduler ready: true, restart count 0 Aug 18 11:39:21.257: INFO: kube-apiserver-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:39:21.257: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:39:21.257: INFO: kube-proxy-vqk4v started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:39:21.257: INFO: Container kube-proxy ready: true, restart count 1 Aug 18 11:39:21.257: INFO: kube-multus-ds-amd64-kbcp6 started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:39:21.257: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:39:21.257: INFO: docker-registry-docker-registry-56cbc7bc58-49kl2 started at 2021-08-18 08:26:23 +0000 UTC (0+2 container statuses recorded) Aug 18 11:39:21.257: INFO: Container docker-registry ready: true, restart count 0 Aug 18 11:39:21.257: INFO: Container nginx ready: true, restart count 0 Aug 18 11:39:21.257: INFO: node-exporter-5hwz9 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:39:21.257: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:39:21.257: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:39:21.257: INFO: kube-controller-manager-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:39:21.257: INFO: Container kube-controller-manager ready: true, restart count 2 W0818 11:39:21.270781 29 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:39:21.295: INFO: Latency metrics for node master1 Aug 18 11:39:21.295: INFO: Logging node info for node master2 Aug 18 11:39:21.298: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 78946293-3abe-4442-84d4-8ed6b1d15ce0 65867 0 2021-08-18 08:21:31 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"7e:f5:c2:cc:3a:b4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:21:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:21:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-08-18 08:29:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:39:13 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:39:13 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:39:13 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:39:13 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0c44122c7a7248c18d8571e1cc667258,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:0cd329f2-48e0-4c8f-b8b9-fa3ae0ed8406,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:39:21.298: INFO: Logging kubelet events for node master2 Aug 18 11:39:21.300: INFO: Logging pods the kubelet thinks is on node master2 Aug 18 11:39:21.308: INFO: kube-proxy-kh2l9 started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:39:21.308: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:39:21.308: INFO: kube-flannel-pp56h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:39:21.308: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:39:21.308: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:39:21.308: INFO: kube-controller-manager-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:39:21.308: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:39:21.308: INFO: kube-scheduler-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:39:21.309: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:39:21.309: INFO: kube-multus-ds-amd64-mld8g started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:39:21.309: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:39:21.309: INFO: dns-autoscaler-5b7b5c9b6f-hh47r started at 2021-08-18 08:23:57 +0000 UTC (0+1 container statuses recorded) Aug 18 11:39:21.309: INFO: Container autoscaler ready: true, restart count 2 Aug 18 11:39:21.309: INFO: node-feature-discovery-controller-5bf5c49849-mq57c started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:39:21.309: INFO: Container nfd-controller ready: true, restart count 0 Aug 18 11:39:21.309: INFO: node-exporter-48nfx started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:39:21.309: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:39:21.309: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:39:21.309: INFO: kube-apiserver-master2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:39:21.309: INFO: Container kube-apiserver ready: true, restart count 0 W0818 11:39:21.321467 29 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:39:21.351: INFO: Latency metrics for node master2 Aug 18 11:39:21.351: INFO: Logging node info for node master3 Aug 18 11:39:21.353: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 44feac2b-9447-4be2-9fcd-62f836d67c72 65896 0 2021-08-18 08:21:41 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"86:e4:31:99:58:40"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {kubelet Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:39:19 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:39:19 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:39:19 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:39:19 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1fae19ae59884c44899bcd08aa243244,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:5db926c5-6530-4635-a0d5-806974a3b732,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:39:21.354: INFO: Logging kubelet events for node master3 Aug 18 11:39:21.355: INFO: Logging pods the kubelet thinks is on node master3 Aug 18 11:39:21.363: INFO: kube-apiserver-master3 started at 2021-08-18 08:29:12 +0000 UTC (0+1 container statuses recorded) Aug 18 11:39:21.363: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:39:21.363: INFO: kube-proxy-sd5lc started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:39:21.363: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:39:21.363: INFO: kube-flannel-x6tlr started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:39:21.363: INFO: Init container install-cni ready: true, restart count 1 Aug 18 11:39:21.363: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:39:21.363: INFO: kube-multus-ds-amd64-bkw6c started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:39:21.363: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:39:21.363: INFO: coredns-7677f9bb54-5hxfh started at 2021-08-18 08:23:54 +0000 UTC (0+1 container statuses recorded) Aug 18 11:39:21.363: INFO: Container coredns ready: true, restart count 1 Aug 18 11:39:21.363: INFO: node-exporter-vq7d8 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:39:21.363: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:39:21.363: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:39:21.363: INFO: kube-controller-manager-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:39:21.363: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:39:21.363: INFO: kube-scheduler-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:39:21.363: INFO: Container kube-scheduler ready: true, restart count 2 W0818 11:39:21.377119 29 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:39:21.399: INFO: Latency metrics for node master3 Aug 18 11:39:21.399: INFO: Logging node info for node node1 Aug 18 11:39:21.402: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 84defabd-6ebf-43ec-a629-44c6713da9c9 65874 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"9a:87:55:36:7b:df"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:13 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:35 +0000 UTC,LastTransitionTime:2021-08-18 08:26:35 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:39:15 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:39:15 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:39:15 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:39:15 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:69946ff2b7bc462fa25eb7adb4703c23,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:736dc52f-f5e3-494e-86ca-01eedbea015c,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:a7cea43d9d2f67c38fbf0407786edbe660ee9072945f7bb272b55fd255e8eaca opnfv/barometer-collectd:stable],SizeBytes:1075746799,},ContainerImage{Names:[@ :],SizeBytes:1003788820,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[aquasec/kube-hunter@sha256:2be6820bc1d7e0f57193a9a27d5a3e16b2fd93c53747b03ce8ca48c6fc323781 aquasec/kube-hunter:0.3.1],SizeBytes:347611549,},ContainerImage{Names:[golang@sha256:db2475a1dbb2149508e5db31d7d77a75e6600d54be645f37681f03f2762169ba golang:alpine3.12],SizeBytes:301186719,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:de25c7fc6c4f3a27c7f0c2dff454e4671823a34d88abd533f210848d527e0fbb alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:39:21.403: INFO: Logging kubelet events for node node1 Aug 18 11:39:21.405: INFO: Logging pods the kubelet thinks is on node node1 Aug 18 11:39:21.420: INFO: nginx-proxy-node1 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:39:21.420: INFO: Container nginx-proxy ready: true, restart count 2 Aug 18 11:39:21.420: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-vsxvg started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:39:21.420: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:39:21.420: INFO: fail-once-local-8rxnh started at 2021-08-18 11:34:14 +0000 UTC (0+1 container statuses recorded) Aug 18 11:39:21.420: INFO: Container c ready: false, restart count 0 Aug 18 11:39:21.420: INFO: pod-update-activedeadlineseconds-2e72b8c4-086d-4288-89a4-b11d1b093416 started at 2021-08-18 11:34:21 +0000 UTC (0+1 container statuses recorded) Aug 18 11:39:21.420: INFO: Container nginx ready: false, restart count 0 Aug 18 11:39:21.420: INFO: kube-flannel-q78nd started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:39:21.420: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:39:21.420: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:39:21.420: INFO: prometheus-k8s-0 started at 2021-08-18 08:34:03 +0000 UTC (0+5 container statuses recorded) Aug 18 11:39:21.420: INFO: Container custom-metrics-apiserver ready: true, restart count 0 Aug 18 11:39:21.420: INFO: Container grafana ready: true, restart count 0 Aug 18 11:39:21.420: INFO: Container prometheus ready: true, restart count 1 Aug 18 11:39:21.420: INFO: Container prometheus-config-reloader ready: true, restart count 0 Aug 18 11:39:21.420: INFO: Container rules-configmap-reloader ready: true, restart count 0 Aug 18 11:39:21.420: INFO: test-webserver-8f4c0481-c94e-4c5f-93b9-b7833f265766 started at 2021-08-18 11:38:54 +0000 UTC (0+1 container statuses recorded) Aug 18 11:39:21.420: INFO: Container test-webserver ready: false, restart count 0 Aug 18 11:39:21.420: INFO: kube-multus-ds-amd64-rrvmb started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:39:21.420: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:39:21.420: INFO: node-feature-discovery-worker-pflgw started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:39:21.420: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:39:21.420: INFO: node-exporter-kcwvn started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:39:21.420: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:39:21.420: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:39:21.420: INFO: ss2-0 started at 2021-08-18 11:32:47 +0000 UTC (0+1 container statuses recorded) Aug 18 11:39:21.420: INFO: Container webserver ready: false, restart count 0 Aug 18 11:39:21.420: INFO: busybox-host-aliasesf99672e9-247c-4ef1-98b7-d10beeb0de14 started at 2021-08-18 11:35:06 +0000 UTC (0+1 container statuses recorded) Aug 18 11:39:21.420: INFO: Container busybox-host-aliasesf99672e9-247c-4ef1-98b7-d10beeb0de14 ready: false, restart count 0 Aug 18 11:39:21.420: INFO: var-expansion-6fae893b-fb11-45bd-9eb5-520674ef36fa started at 2021-08-18 11:38:19 +0000 UTC (0+1 container statuses recorded) Aug 18 11:39:21.420: INFO: Container dapi-container ready: false, restart count 0 Aug 18 11:39:21.420: INFO: kube-proxy-p6jvp started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:39:21.420: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:39:21.420: INFO: kubernetes-metrics-scraper-678c97765c-9nsv5 started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:39:21.420: INFO: Container kubernetes-metrics-scraper ready: true, restart count 2 Aug 18 11:39:21.420: INFO: cmk-init-discover-node1-bxznx started at 2021-08-18 08:32:10 +0000 UTC (0+3 container statuses recorded) Aug 18 11:39:21.420: INFO: Container discover ready: false, restart count 0 Aug 18 11:39:21.420: INFO: Container init ready: false, restart count 0 Aug 18 11:39:21.420: INFO: Container install ready: false, restart count 0 Aug 18 11:39:21.420: INFO: cmk-d8r27 started at 2021-08-18 08:32:52 +0000 UTC (0+2 container statuses recorded) Aug 18 11:39:21.420: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:39:21.420: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:39:21.420: INFO: collectd-xdprr started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:39:21.420: INFO: Container collectd ready: true, restart count 0 Aug 18 11:39:21.420: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:39:21.420: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:39:21.420: INFO: busybox-ca1d4157-6037-47c1-a37c-160e2dd5121c started at 2021-08-18 11:37:58 +0000 UTC (0+1 container statuses recorded) Aug 18 11:39:21.420: INFO: Container busybox ready: false, restart count 0 W0818 11:39:21.432015 29 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:39:21.462: INFO: Latency metrics for node node1 Aug 18 11:39:21.462: INFO: Logging node info for node node2 Aug 18 11:39:21.464: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 1d01177e-3dbb-48a1-a0bc-d18af27ab7f8 65873 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:d1:47:f8:1d:22"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:36 +0000 UTC,LastTransitionTime:2021-08-18 08:26:36 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:39:14 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:39:14 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:39:14 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:39:14 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:dc1f286135c145349b8a016880b65a2f,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:037e7e2d-94e9-42f4-a719-896e5005ac70,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:39:21.465: INFO: Logging kubelet events for node node2 Aug 18 11:39:21.467: INFO: Logging pods the kubelet thinks is on node node2 Aug 18 11:39:21.479: INFO: kubernetes-dashboard-86c6f9df5b-qrtdk started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:39:21.480: INFO: Container kubernetes-dashboard ready: true, restart count 2 Aug 18 11:39:21.480: INFO: cmk-748rz started at 2021-08-18 08:32:53 +0000 UTC (0+2 container statuses recorded) Aug 18 11:39:21.480: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:39:21.480: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:39:21.480: INFO: pod-configmaps-cf74abd4-bad1-4742-9696-0545d27eacc5 started at 2021-08-18 11:35:12 +0000 UTC (0+2 container statuses recorded) Aug 18 11:39:21.480: INFO: Container configmap-volume-binary-test ready: false, restart count 0 Aug 18 11:39:21.480: INFO: Container configmap-volume-data-test ready: false, restart count 0 Aug 18 11:39:21.480: INFO: pod-adoption started at 2021-08-18 11:36:15 +0000 UTC (0+1 container statuses recorded) Aug 18 11:39:21.480: INFO: Container pod-adoption ready: false, restart count 0 Aug 18 11:39:21.480: INFO: prometheus-operator-5bb8cb9d8f-k97ws started at 2021-08-18 08:33:38 +0000 UTC (0+2 container statuses recorded) Aug 18 11:39:21.480: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:39:21.480: INFO: Container prometheus-operator ready: true, restart count 0 Aug 18 11:39:21.480: INFO: kube-proxy-qkj9c started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:39:21.480: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:39:21.480: INFO: node-feature-discovery-worker-hzpf5 started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:39:21.480: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:39:21.480: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-c82pt started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:39:21.480: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:39:21.480: INFO: kube-multus-ds-amd64-rvzsg started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:39:21.480: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:39:21.480: INFO: collectd-67ntq started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:39:21.480: INFO: Container collectd ready: true, restart count 0 Aug 18 11:39:21.480: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:39:21.480: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:39:21.480: INFO: cmk-webhook-6c9d5f8578-7cxjr started at 2021-08-18 08:32:53 +0000 UTC (0+1 container statuses recorded) Aug 18 11:39:21.480: INFO: Container cmk-webhook ready: true, restart count 0 Aug 18 11:39:21.480: INFO: pod-init-c9a6ec62-328a-48d0-ad87-8e4a921066e8 started at 2021-08-18 11:37:42 +0000 UTC (2+1 container statuses recorded) Aug 18 11:39:21.480: INFO: Init container init1 ready: false, restart count 0 Aug 18 11:39:21.480: INFO: Init container init2 ready: false, restart count 0 Aug 18 11:39:21.480: INFO: Container run1 ready: false, restart count 0 Aug 18 11:39:21.480: INFO: kube-flannel-h7t5h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:39:21.480: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:39:21.480: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:39:21.480: INFO: node-exporter-lrrf2 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:39:21.480: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:39:21.480: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:39:21.480: INFO: fail-once-local-pk5cs started at 2021-08-18 11:34:14 +0000 UTC (0+1 container statuses recorded) Aug 18 11:39:21.480: INFO: Container c ready: false, restart count 0 Aug 18 11:39:21.480: INFO: nginx-proxy-node2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:39:21.480: INFO: Container nginx-proxy ready: true, restart count 1 Aug 18 11:39:21.480: INFO: cmk-init-discover-node2-6b2kz started at 2021-08-18 08:32:30 +0000 UTC (0+3 container statuses recorded) Aug 18 11:39:21.480: INFO: Container discover ready: false, restart count 0 Aug 18 11:39:21.480: INFO: Container init ready: false, restart count 0 Aug 18 11:39:21.480: INFO: Container install ready: false, restart count 0 Aug 18 11:39:21.480: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-7rn45 started at 2021-08-18 08:36:42 +0000 UTC (0+2 container statuses recorded) Aug 18 11:39:21.480: INFO: Container tas-controller ready: true, restart count 0 Aug 18 11:39:21.480: INFO: Container tas-extender ready: true, restart count 0 W0818 11:39:21.493108 29 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:39:21.539: INFO: Latency metrics for node node2 Aug 18 11:39:21.539: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "pods-1160" for this suite. • Failure [300.365 seconds] [k8s.io] Pods /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 should allow activeDeadlineSeconds to be updated [NodeConformance] [Conformance] [It] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:39:21.231: Unexpected error: <*errors.errorString | 0xc0003081f0>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:103 ------------------------------ {"msg":"FAILED [k8s.io] Pods should allow activeDeadlineSeconds to be updated [NodeConformance] [Conformance]","total":-1,"completed":18,"skipped":336,"failed":2,"failures":["[k8s.io] InitContainer [NodeConformance] should invoke init containers on a RestartAlways pod [Conformance]","[k8s.io] Pods should allow activeDeadlineSeconds to be updated [NodeConformance] [Conformance]"]} SSSSSS ------------------------------ [BeforeEach] [sig-storage] Projected secret /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:39:21.571: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename projected STEP: Waiting for a default service account to be provisioned in namespace [It] should be consumable in multiple volumes in a pod [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating secret with name projected-secret-test-494df0bb-d3b8-4347-8d25-5c326fbdca35 STEP: Creating a pod to test consume secrets Aug 18 11:39:21.609: INFO: Waiting up to 5m0s for pod "pod-projected-secrets-bf7808cf-fc47-44b3-9d47-06a4b7953061" in namespace "projected-3284" to be "Succeeded or Failed" Aug 18 11:39:21.611: INFO: Pod "pod-projected-secrets-bf7808cf-fc47-44b3-9d47-06a4b7953061": Phase="Pending", Reason="", readiness=false. Elapsed: 2.148338ms Aug 18 11:39:23.614: INFO: Pod "pod-projected-secrets-bf7808cf-fc47-44b3-9d47-06a4b7953061": Phase="Pending", Reason="", readiness=false. Elapsed: 2.005170516s Aug 18 11:39:25.617: INFO: Pod "pod-projected-secrets-bf7808cf-fc47-44b3-9d47-06a4b7953061": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.00761729s STEP: Saw pod success Aug 18 11:39:25.617: INFO: Pod "pod-projected-secrets-bf7808cf-fc47-44b3-9d47-06a4b7953061" satisfied condition "Succeeded or Failed" Aug 18 11:39:25.619: INFO: Trying to get logs from node node1 pod pod-projected-secrets-bf7808cf-fc47-44b3-9d47-06a4b7953061 container secret-volume-test: STEP: delete the pod Aug 18 11:39:25.631: INFO: Waiting for pod pod-projected-secrets-bf7808cf-fc47-44b3-9d47-06a4b7953061 to disappear Aug 18 11:39:25.633: INFO: Pod pod-projected-secrets-bf7808cf-fc47-44b3-9d47-06a4b7953061 no longer exists [AfterEach] [sig-storage] Projected secret /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:39:25.633: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "projected-3284" for this suite. • ------------------------------ {"msg":"PASSED [sig-storage] Projected secret should be consumable in multiple volumes in a pod [NodeConformance] [Conformance]","total":-1,"completed":19,"skipped":342,"failed":2,"failures":["[k8s.io] InitContainer [NodeConformance] should invoke init containers on a RestartAlways pod [Conformance]","[k8s.io] Pods should allow activeDeadlineSeconds to be updated [NodeConformance] [Conformance]"]} SSSSS ------------------------------ [BeforeEach] [sig-instrumentation] Events API /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:39:25.657: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename events STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-instrumentation] Events API /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/instrumentation/events.go:81 [It] should delete a collection of events [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Create set of events STEP: get a list of Events with a label in the current namespace STEP: delete a list of events Aug 18 11:39:25.698: INFO: requesting DeleteCollection of events STEP: check that the list of events matches the requested quantity [AfterEach] [sig-instrumentation] Events API /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:39:25.728: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "events-8123" for this suite. • ------------------------------ {"msg":"PASSED [sig-instrumentation] Events API should delete a collection of events [Conformance]","total":-1,"completed":20,"skipped":347,"failed":2,"failures":["[k8s.io] InitContainer [NodeConformance] should invoke init containers on a RestartAlways pod [Conformance]","[k8s.io] Pods should allow activeDeadlineSeconds to be updated [NodeConformance] [Conformance]"]} SSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-cli] Kubectl client /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:39:25.774: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename kubectl STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-cli] Kubectl client /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/kubectl.go:247 [It] should check if kubectl can dry-run update Pods [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: running the image docker.io/library/httpd:2.4.38-alpine Aug 18 11:39:25.791: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-5514 run e2e-test-httpd-pod --image=docker.io/library/httpd:2.4.38-alpine --labels=run=e2e-test-httpd-pod' Aug 18 11:39:25.971: INFO: stderr: "" Aug 18 11:39:25.971: INFO: stdout: "pod/e2e-test-httpd-pod created\n" STEP: replace the image in the pod with server-side dry-run Aug 18 11:39:25.971: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-5514 patch pod e2e-test-httpd-pod -p {"spec":{"containers":[{"name": "e2e-test-httpd-pod","image": "docker.io/library/busybox:1.29"}]}} --dry-run=server' Aug 18 11:39:26.334: INFO: stderr: "" Aug 18 11:39:26.334: INFO: stdout: "pod/e2e-test-httpd-pod patched\n" STEP: verifying the pod e2e-test-httpd-pod has the right image docker.io/library/httpd:2.4.38-alpine Aug 18 11:39:26.336: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-5514 delete pods e2e-test-httpd-pod' Aug 18 11:39:27.421: INFO: stderr: "" Aug 18 11:39:27.421: INFO: stdout: "pod \"e2e-test-httpd-pod\" deleted\n" [AfterEach] [sig-cli] Kubectl client /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:39:27.421: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "kubectl-5514" for this suite. • ------------------------------ {"msg":"PASSED [sig-cli] Kubectl client Kubectl server-side dry-run should check if kubectl can dry-run update Pods [Conformance]","total":-1,"completed":21,"skipped":361,"failed":2,"failures":["[k8s.io] InitContainer [NodeConformance] should invoke init containers on a RestartAlways pod [Conformance]","[k8s.io] Pods should allow activeDeadlineSeconds to be updated [NodeConformance] [Conformance]"]} SSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-storage] Projected configMap /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:39:27.503: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename projected STEP: Waiting for a default service account to be provisioned in namespace [It] should be consumable from pods in volume with mappings and Item mode set [LinuxOnly] [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating configMap with name projected-configmap-test-volume-map-67105a2e-cc79-4f42-b2bd-de7769dc15fa STEP: Creating a pod to test consume configMaps Aug 18 11:39:27.541: INFO: Waiting up to 5m0s for pod "pod-projected-configmaps-d56e717f-008d-40a5-a138-714a97273290" in namespace "projected-3913" to be "Succeeded or Failed" Aug 18 11:39:27.543: INFO: Pod "pod-projected-configmaps-d56e717f-008d-40a5-a138-714a97273290": Phase="Pending", Reason="", readiness=false. Elapsed: 2.138135ms Aug 18 11:39:29.547: INFO: Pod "pod-projected-configmaps-d56e717f-008d-40a5-a138-714a97273290": Phase="Pending", Reason="", readiness=false. Elapsed: 2.005759171s Aug 18 11:39:31.550: INFO: Pod "pod-projected-configmaps-d56e717f-008d-40a5-a138-714a97273290": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.009152439s STEP: Saw pod success Aug 18 11:39:31.550: INFO: Pod "pod-projected-configmaps-d56e717f-008d-40a5-a138-714a97273290" satisfied condition "Succeeded or Failed" Aug 18 11:39:31.552: INFO: Trying to get logs from node node1 pod pod-projected-configmaps-d56e717f-008d-40a5-a138-714a97273290 container projected-configmap-volume-test: STEP: delete the pod Aug 18 11:39:31.567: INFO: Waiting for pod pod-projected-configmaps-d56e717f-008d-40a5-a138-714a97273290 to disappear Aug 18 11:39:31.569: INFO: Pod pod-projected-configmaps-d56e717f-008d-40a5-a138-714a97273290 no longer exists [AfterEach] [sig-storage] Projected configMap /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:39:31.569: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "projected-3913" for this suite. • ------------------------------ {"msg":"PASSED [sig-storage] Projected configMap should be consumable from pods in volume with mappings and Item mode set [LinuxOnly] [NodeConformance] [Conformance]","total":-1,"completed":22,"skipped":391,"failed":2,"failures":["[k8s.io] InitContainer [NodeConformance] should invoke init containers on a RestartAlways pod [Conformance]","[k8s.io] Pods should allow activeDeadlineSeconds to be updated [NodeConformance] [Conformance]"]} SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [k8s.io] Probing container /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:38:54.272: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename container-probe STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [k8s.io] Probing container /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:54 [It] with readiness probe that fails should never be ready and never restart [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 [AfterEach] [k8s.io] Probing container /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:39:54.315: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "container-probe-1096" for this suite. • [SLOW TEST:60.052 seconds] [k8s.io] Probing container /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 with readiness probe that fails should never be ready and never restart [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ [BeforeEach] [k8s.io] Kubelet /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:35:06.686: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename kubelet-test STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [k8s.io] Kubelet /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/kubelet.go:38 [It] should write entries to /etc/hosts [LinuxOnly] [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:40:06.739: FAIL: Unexpected error: <*errors.errorString | 0xc0003001f0>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*PodClient).CreateSync(0xc0047113a0, 0xc003882c00, 0x7f0982d4daa8) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:103 +0xfe k8s.io/kubernetes/test/e2e/common.glob..func12.4.1() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/kubelet.go:147 +0x26f k8s.io/kubernetes/test/e2e.RunE2ETests(0xc001283680) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc001283680) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc001283680, 0x4deb2c0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] Kubelet /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "kubelet-test-7368". STEP: Found 9 events. Aug 18 11:40:06.743: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for busybox-host-aliasesf99672e9-247c-4ef1-98b7-d10beeb0de14: { } Scheduled: Successfully assigned kubelet-test-7368/busybox-host-aliasesf99672e9-247c-4ef1-98b7-d10beeb0de14 to node1 Aug 18 11:40:06.743: INFO: At 2021-08-18 11:35:08 +0000 UTC - event for busybox-host-aliasesf99672e9-247c-4ef1-98b7-d10beeb0de14: {multus } AddedInterface: Add eth0 [10.244.4.30/24] Aug 18 11:40:06.743: INFO: At 2021-08-18 11:35:08 +0000 UTC - event for busybox-host-aliasesf99672e9-247c-4ef1-98b7-d10beeb0de14: {kubelet node1} Pulling: Pulling image "docker.io/library/busybox:1.29" Aug 18 11:40:06.743: INFO: At 2021-08-18 11:35:09 +0000 UTC - event for busybox-host-aliasesf99672e9-247c-4ef1-98b7-d10beeb0de14: {kubelet node1} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit Aug 18 11:40:06.743: INFO: At 2021-08-18 11:35:09 +0000 UTC - event for busybox-host-aliasesf99672e9-247c-4ef1-98b7-d10beeb0de14: {kubelet node1} Failed: Error: ErrImagePull Aug 18 11:40:06.743: INFO: At 2021-08-18 11:35:09 +0000 UTC - event for busybox-host-aliasesf99672e9-247c-4ef1-98b7-d10beeb0de14: {kubelet node1} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Aug 18 11:40:06.743: INFO: At 2021-08-18 11:35:11 +0000 UTC - event for busybox-host-aliasesf99672e9-247c-4ef1-98b7-d10beeb0de14: {multus } AddedInterface: Add eth0 [10.244.4.32/24] Aug 18 11:40:06.743: INFO: At 2021-08-18 11:35:11 +0000 UTC - event for busybox-host-aliasesf99672e9-247c-4ef1-98b7-d10beeb0de14: {kubelet node1} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" Aug 18 11:40:06.743: INFO: At 2021-08-18 11:35:11 +0000 UTC - event for busybox-host-aliasesf99672e9-247c-4ef1-98b7-d10beeb0de14: {kubelet node1} Failed: Error: ImagePullBackOff Aug 18 11:40:06.746: INFO: POD NODE PHASE GRACE CONDITIONS Aug 18 11:40:06.746: INFO: busybox-host-aliasesf99672e9-247c-4ef1-98b7-d10beeb0de14 node1 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:35:06 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:35:06 +0000 UTC ContainersNotReady containers with unready status: [busybox-host-aliasesf99672e9-247c-4ef1-98b7-d10beeb0de14]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:35:06 +0000 UTC ContainersNotReady containers with unready status: [busybox-host-aliasesf99672e9-247c-4ef1-98b7-d10beeb0de14]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:35:06 +0000 UTC }] Aug 18 11:40:06.746: INFO: Aug 18 11:40:06.750: INFO: Logging node info for node master1 Aug 18 11:40:06.752: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 ebb211fa-503f-4cfe-b1ed-c95d27a70e6e 66270 0 2021-08-18 08:20:52 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"3a:82:be:72:b5:15"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:20:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:20:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:25:59 +0000 UTC,LastTransitionTime:2021-08-18 08:25:59 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:40:05 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:40:05 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:40:05 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:40:05 +0000 UTC,LastTransitionTime:2021-08-18 08:25:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:58c3e57359b641ad92fa1959f2fecf5d,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:012cd796-2076-45d6-8b14-d3e0451b1e64,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[@ :],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:40:06.753: INFO: Logging kubelet events for node master1 Aug 18 11:40:06.755: INFO: Logging pods the kubelet thinks is on node master1 Aug 18 11:40:06.763: INFO: kube-scheduler-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:06.763: INFO: Container kube-scheduler ready: true, restart count 0 Aug 18 11:40:06.763: INFO: kube-apiserver-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:06.763: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:40:06.763: INFO: kube-proxy-vqk4v started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:06.763: INFO: Container kube-proxy ready: true, restart count 1 Aug 18 11:40:06.763: INFO: kube-flannel-q64cq started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:40:06.763: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:40:06.763: INFO: Container kube-flannel ready: true, restart count 3 Aug 18 11:40:06.763: INFO: coredns-7677f9bb54-kn2qg started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:06.763: INFO: Container coredns ready: true, restart count 2 Aug 18 11:40:06.763: INFO: node-exporter-5hwz9 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:40:06.763: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:40:06.763: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:40:06.763: INFO: kube-controller-manager-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:06.763: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:40:06.763: INFO: kube-multus-ds-amd64-kbcp6 started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:06.763: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:40:06.763: INFO: docker-registry-docker-registry-56cbc7bc58-49kl2 started at 2021-08-18 08:26:23 +0000 UTC (0+2 container statuses recorded) Aug 18 11:40:06.763: INFO: Container docker-registry ready: true, restart count 0 Aug 18 11:40:06.763: INFO: Container nginx ready: true, restart count 0 W0818 11:40:06.776859 27 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:40:06.801: INFO: Latency metrics for node master1 Aug 18 11:40:06.801: INFO: Logging node info for node master2 Aug 18 11:40:06.805: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 78946293-3abe-4442-84d4-8ed6b1d15ce0 66259 0 2021-08-18 08:21:31 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"7e:f5:c2:cc:3a:b4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:21:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:21:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-08-18 08:29:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:40:04 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:40:04 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:40:04 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:40:04 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0c44122c7a7248c18d8571e1cc667258,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:0cd329f2-48e0-4c8f-b8b9-fa3ae0ed8406,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:40:06.805: INFO: Logging kubelet events for node master2 Aug 18 11:40:06.808: INFO: Logging pods the kubelet thinks is on node master2 Aug 18 11:40:06.816: INFO: kube-controller-manager-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:06.816: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:40:06.816: INFO: kube-proxy-kh2l9 started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:06.816: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:40:06.816: INFO: kube-flannel-pp56h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:40:06.817: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:40:06.817: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:40:06.817: INFO: node-feature-discovery-controller-5bf5c49849-mq57c started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:06.817: INFO: Container nfd-controller ready: true, restart count 0 Aug 18 11:40:06.817: INFO: node-exporter-48nfx started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:40:06.817: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:40:06.817: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:40:06.817: INFO: kube-apiserver-master2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:06.817: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:40:06.817: INFO: kube-scheduler-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:06.817: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:40:06.817: INFO: kube-multus-ds-amd64-mld8g started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:06.817: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:40:06.817: INFO: dns-autoscaler-5b7b5c9b6f-hh47r started at 2021-08-18 08:23:57 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:06.817: INFO: Container autoscaler ready: true, restart count 2 W0818 11:40:06.830874 27 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:40:06.856: INFO: Latency metrics for node master2 Aug 18 11:40:06.856: INFO: Logging node info for node master3 Aug 18 11:40:06.859: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 44feac2b-9447-4be2-9fcd-62f836d67c72 66235 0 2021-08-18 08:21:41 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"86:e4:31:99:58:40"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {kubelet Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:39:59 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:39:59 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:39:59 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:39:59 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1fae19ae59884c44899bcd08aa243244,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:5db926c5-6530-4635-a0d5-806974a3b732,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:40:06.859: INFO: Logging kubelet events for node master3 Aug 18 11:40:06.862: INFO: Logging pods the kubelet thinks is on node master3 Aug 18 11:40:06.869: INFO: coredns-7677f9bb54-5hxfh started at 2021-08-18 08:23:54 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:06.869: INFO: Container coredns ready: true, restart count 1 Aug 18 11:40:06.869: INFO: node-exporter-vq7d8 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:40:06.869: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:40:06.869: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:40:06.869: INFO: kube-controller-manager-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:06.869: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:40:06.869: INFO: kube-scheduler-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:06.869: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:40:06.869: INFO: kube-apiserver-master3 started at 2021-08-18 08:29:12 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:06.869: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:40:06.869: INFO: kube-proxy-sd5lc started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:06.869: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:40:06.869: INFO: kube-flannel-x6tlr started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:40:06.869: INFO: Init container install-cni ready: true, restart count 1 Aug 18 11:40:06.869: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:40:06.869: INFO: kube-multus-ds-amd64-bkw6c started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:06.869: INFO: Container kube-multus ready: true, restart count 1 W0818 11:40:06.881567 27 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:40:06.903: INFO: Latency metrics for node master3 Aug 18 11:40:06.904: INFO: Logging node info for node node1 Aug 18 11:40:06.906: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 84defabd-6ebf-43ec-a629-44c6713da9c9 66269 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"9a:87:55:36:7b:df"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:13 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:35 +0000 UTC,LastTransitionTime:2021-08-18 08:26:35 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:40:05 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:40:05 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:40:05 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:40:05 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:69946ff2b7bc462fa25eb7adb4703c23,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:736dc52f-f5e3-494e-86ca-01eedbea015c,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:a7cea43d9d2f67c38fbf0407786edbe660ee9072945f7bb272b55fd255e8eaca opnfv/barometer-collectd:stable],SizeBytes:1075746799,},ContainerImage{Names:[@ :],SizeBytes:1003788820,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[aquasec/kube-hunter@sha256:2be6820bc1d7e0f57193a9a27d5a3e16b2fd93c53747b03ce8ca48c6fc323781 aquasec/kube-hunter:0.3.1],SizeBytes:347611549,},ContainerImage{Names:[golang@sha256:db2475a1dbb2149508e5db31d7d77a75e6600d54be645f37681f03f2762169ba golang:alpine3.12],SizeBytes:301186719,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:de25c7fc6c4f3a27c7f0c2dff454e4671823a34d88abd533f210848d527e0fbb alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:40:06.907: INFO: Logging kubelet events for node node1 Aug 18 11:40:06.908: INFO: Logging pods the kubelet thinks is on node node1 Aug 18 11:40:06.923: INFO: test-webserver-8f4c0481-c94e-4c5f-93b9-b7833f265766 started at 2021-08-18 11:38:54 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:06.923: INFO: Container test-webserver ready: false, restart count 0 Aug 18 11:40:06.923: INFO: kube-flannel-q78nd started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:40:06.923: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:40:06.923: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:40:06.923: INFO: prometheus-k8s-0 started at 2021-08-18 08:34:03 +0000 UTC (0+5 container statuses recorded) Aug 18 11:40:06.923: INFO: Container custom-metrics-apiserver ready: true, restart count 0 Aug 18 11:40:06.923: INFO: Container grafana ready: true, restart count 0 Aug 18 11:40:06.923: INFO: Container prometheus ready: true, restart count 1 Aug 18 11:40:06.923: INFO: Container prometheus-config-reloader ready: true, restart count 0 Aug 18 11:40:06.923: INFO: Container rules-configmap-reloader ready: true, restart count 0 Aug 18 11:40:06.923: INFO: node-exporter-kcwvn started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:40:06.923: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:40:06.923: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:40:06.923: INFO: ss2-0 started at 2021-08-18 11:32:47 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:06.923: INFO: Container webserver ready: false, restart count 0 Aug 18 11:40:06.923: INFO: busybox-host-aliasesf99672e9-247c-4ef1-98b7-d10beeb0de14 started at 2021-08-18 11:35:06 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:06.923: INFO: Container busybox-host-aliasesf99672e9-247c-4ef1-98b7-d10beeb0de14 ready: false, restart count 0 Aug 18 11:40:06.923: INFO: var-expansion-6fae893b-fb11-45bd-9eb5-520674ef36fa started at 2021-08-18 11:38:19 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:06.923: INFO: Container dapi-container ready: false, restart count 0 Aug 18 11:40:06.923: INFO: kube-multus-ds-amd64-rrvmb started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:06.923: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:40:06.923: INFO: node-feature-discovery-worker-pflgw started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:06.923: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:40:06.923: INFO: cmk-init-discover-node1-bxznx started at 2021-08-18 08:32:10 +0000 UTC (0+3 container statuses recorded) Aug 18 11:40:06.923: INFO: Container discover ready: false, restart count 0 Aug 18 11:40:06.923: INFO: Container init ready: false, restart count 0 Aug 18 11:40:06.923: INFO: Container install ready: false, restart count 0 Aug 18 11:40:06.923: INFO: cmk-d8r27 started at 2021-08-18 08:32:52 +0000 UTC (0+2 container statuses recorded) Aug 18 11:40:06.923: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:40:06.923: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:40:06.923: INFO: collectd-xdprr started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:40:06.923: INFO: Container collectd ready: true, restart count 0 Aug 18 11:40:06.923: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:40:06.923: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:40:06.923: INFO: busybox-ca1d4157-6037-47c1-a37c-160e2dd5121c started at 2021-08-18 11:37:58 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:06.923: INFO: Container busybox ready: false, restart count 0 Aug 18 11:40:06.923: INFO: kube-proxy-p6jvp started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:06.923: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:40:06.923: INFO: kubernetes-metrics-scraper-678c97765c-9nsv5 started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:06.923: INFO: Container kubernetes-metrics-scraper ready: true, restart count 2 Aug 18 11:40:06.923: INFO: fail-once-local-8rxnh started at 2021-08-18 11:34:14 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:06.923: INFO: Container c ready: false, restart count 0 Aug 18 11:40:06.923: INFO: nginx-proxy-node1 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:06.923: INFO: Container nginx-proxy ready: true, restart count 2 Aug 18 11:40:06.923: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-vsxvg started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:06.923: INFO: Container kube-sriovdp ready: true, restart count 0 W0818 11:40:06.937012 27 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:40:06.970: INFO: Latency metrics for node node1 Aug 18 11:40:06.970: INFO: Logging node info for node node2 Aug 18 11:40:06.973: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 1d01177e-3dbb-48a1-a0bc-d18af27ab7f8 66265 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:d1:47:f8:1d:22"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:36 +0000 UTC,LastTransitionTime:2021-08-18 08:26:36 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:40:04 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:40:04 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:40:04 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:40:04 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:dc1f286135c145349b8a016880b65a2f,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:037e7e2d-94e9-42f4-a719-896e5005ac70,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:40:06.973: INFO: Logging kubelet events for node node2 Aug 18 11:40:06.975: INFO: Logging pods the kubelet thinks is on node node2 Aug 18 11:40:06.988: INFO: var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e started at 2021-08-18 11:39:31 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:06.988: INFO: Container dapi-container ready: false, restart count 0 Aug 18 11:40:06.988: INFO: nginx-proxy-node2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:06.988: INFO: Container nginx-proxy ready: true, restart count 1 Aug 18 11:40:06.988: INFO: cmk-init-discover-node2-6b2kz started at 2021-08-18 08:32:30 +0000 UTC (0+3 container statuses recorded) Aug 18 11:40:06.988: INFO: Container discover ready: false, restart count 0 Aug 18 11:40:06.988: INFO: Container init ready: false, restart count 0 Aug 18 11:40:06.988: INFO: Container install ready: false, restart count 0 Aug 18 11:40:06.988: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-7rn45 started at 2021-08-18 08:36:42 +0000 UTC (0+2 container statuses recorded) Aug 18 11:40:06.988: INFO: Container tas-controller ready: true, restart count 0 Aug 18 11:40:06.988: INFO: Container tas-extender ready: true, restart count 0 Aug 18 11:40:06.988: INFO: downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1 started at 2021-08-18 11:39:54 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:06.988: INFO: Container dapi-container ready: false, restart count 0 Aug 18 11:40:06.988: INFO: fail-once-local-pk5cs started at 2021-08-18 11:34:14 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:06.988: INFO: Container c ready: false, restart count 0 Aug 18 11:40:06.988: INFO: kubernetes-dashboard-86c6f9df5b-qrtdk started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:06.988: INFO: Container kubernetes-dashboard ready: true, restart count 2 Aug 18 11:40:06.988: INFO: cmk-748rz started at 2021-08-18 08:32:53 +0000 UTC (0+2 container statuses recorded) Aug 18 11:40:06.988: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:40:06.988: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:40:06.988: INFO: pod-configmaps-cf74abd4-bad1-4742-9696-0545d27eacc5 started at 2021-08-18 11:35:12 +0000 UTC (0+2 container statuses recorded) Aug 18 11:40:06.988: INFO: Container configmap-volume-binary-test ready: false, restart count 0 Aug 18 11:40:06.988: INFO: Container configmap-volume-data-test ready: false, restart count 0 Aug 18 11:40:06.988: INFO: pod-adoption started at 2021-08-18 11:36:15 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:06.988: INFO: Container pod-adoption ready: false, restart count 0 Aug 18 11:40:06.988: INFO: kube-proxy-qkj9c started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:06.988: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:40:06.988: INFO: node-feature-discovery-worker-hzpf5 started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:06.988: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:40:06.988: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-c82pt started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:06.988: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:40:06.988: INFO: prometheus-operator-5bb8cb9d8f-k97ws started at 2021-08-18 08:33:38 +0000 UTC (0+2 container statuses recorded) Aug 18 11:40:06.988: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:40:06.988: INFO: Container prometheus-operator ready: true, restart count 0 Aug 18 11:40:06.988: INFO: kube-multus-ds-amd64-rvzsg started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:06.988: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:40:06.988: INFO: collectd-67ntq started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:40:06.988: INFO: Container collectd ready: true, restart count 0 Aug 18 11:40:06.988: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:40:06.988: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:40:06.988: INFO: cmk-webhook-6c9d5f8578-7cxjr started at 2021-08-18 08:32:53 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:06.988: INFO: Container cmk-webhook ready: true, restart count 0 Aug 18 11:40:06.988: INFO: pod-init-c9a6ec62-328a-48d0-ad87-8e4a921066e8 started at 2021-08-18 11:37:42 +0000 UTC (2+1 container statuses recorded) Aug 18 11:40:06.989: INFO: Init container init1 ready: false, restart count 0 Aug 18 11:40:06.989: INFO: Init container init2 ready: false, restart count 0 Aug 18 11:40:06.989: INFO: Container run1 ready: false, restart count 0 Aug 18 11:40:06.989: INFO: kube-flannel-h7t5h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:40:06.989: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:40:06.989: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:40:06.989: INFO: node-exporter-lrrf2 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:40:06.989: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:40:06.989: INFO: Container node-exporter ready: true, restart count 0 W0818 11:40:07.002149 27 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:40:07.046: INFO: Latency metrics for node node2 Aug 18 11:40:07.046: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "kubelet-test-7368" for this suite. • Failure [300.368 seconds] [k8s.io] Kubelet /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 when scheduling a busybox Pod with hostAliases /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/kubelet.go:137 should write entries to /etc/hosts [LinuxOnly] [NodeConformance] [Conformance] [It] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:40:06.739: Unexpected error: <*errors.errorString | 0xc0003001f0>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:103 ------------------------------ {"msg":"FAILED [k8s.io] Kubelet when scheduling a busybox Pod with hostAliases should write entries to /etc/hosts [LinuxOnly] [NodeConformance] [Conformance]","total":-1,"completed":16,"skipped":169,"failed":2,"failures":["[sig-node] Downward API should provide host IP as an env var [NodeConformance] [Conformance]","[k8s.io] Kubelet when scheduling a busybox Pod with hostAliases should write entries to /etc/hosts [LinuxOnly] [NodeConformance] [Conformance]"]} SSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-storage] ConfigMap /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:35:12.457: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename configmap STEP: Waiting for a default service account to be provisioned in namespace [It] binary data should be reflected in volume [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating configMap with name configmap-test-upd-ebce1795-1ac0-4e2e-a527-3d0c8217d7a7 STEP: Creating the pod Aug 18 11:40:12.504: FAIL: Unexpected error: <*errors.errorString | 0xc0002801f0>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*PodClient).CreateSync(0xc0029b1920, 0xc0027fc000, 0x0) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:103 +0xfe k8s.io/kubernetes/test/e2e/common.glob..func2.11() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/configmap_volume.go:280 +0xc13 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc003602780) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc003602780) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc003602780, 0x4deb2c0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [sig-storage] ConfigMap /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "configmap-4198". STEP: Found 11 events. Aug 18 11:40:12.510: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for pod-configmaps-cf74abd4-bad1-4742-9696-0545d27eacc5: { } Scheduled: Successfully assigned configmap-4198/pod-configmaps-cf74abd4-bad1-4742-9696-0545d27eacc5 to node2 Aug 18 11:40:12.510: INFO: At 2021-08-18 11:35:14 +0000 UTC - event for pod-configmaps-cf74abd4-bad1-4742-9696-0545d27eacc5: {multus } AddedInterface: Add eth0 [10.244.3.26/24] Aug 18 11:40:12.510: INFO: At 2021-08-18 11:35:14 +0000 UTC - event for pod-configmaps-cf74abd4-bad1-4742-9696-0545d27eacc5: {kubelet node2} Pulling: Pulling image "k8s.gcr.io/e2e-test-images/agnhost:2.20" Aug 18 11:40:12.510: INFO: At 2021-08-18 11:35:14 +0000 UTC - event for pod-configmaps-cf74abd4-bad1-4742-9696-0545d27eacc5: {kubelet node2} Pulled: Successfully pulled image "k8s.gcr.io/e2e-test-images/agnhost:2.20" in 482.733893ms Aug 18 11:40:12.510: INFO: At 2021-08-18 11:35:14 +0000 UTC - event for pod-configmaps-cf74abd4-bad1-4742-9696-0545d27eacc5: {kubelet node2} Created: Created container configmap-volume-data-test Aug 18 11:40:12.510: INFO: At 2021-08-18 11:35:14 +0000 UTC - event for pod-configmaps-cf74abd4-bad1-4742-9696-0545d27eacc5: {kubelet node2} Started: Started container configmap-volume-data-test Aug 18 11:40:12.510: INFO: At 2021-08-18 11:35:14 +0000 UTC - event for pod-configmaps-cf74abd4-bad1-4742-9696-0545d27eacc5: {kubelet node2} Pulling: Pulling image "docker.io/library/busybox:1.29" Aug 18 11:40:12.510: INFO: At 2021-08-18 11:35:15 +0000 UTC - event for pod-configmaps-cf74abd4-bad1-4742-9696-0545d27eacc5: {kubelet node2} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit Aug 18 11:40:12.510: INFO: At 2021-08-18 11:35:15 +0000 UTC - event for pod-configmaps-cf74abd4-bad1-4742-9696-0545d27eacc5: {kubelet node2} Failed: Error: ErrImagePull Aug 18 11:40:12.510: INFO: At 2021-08-18 11:35:16 +0000 UTC - event for pod-configmaps-cf74abd4-bad1-4742-9696-0545d27eacc5: {kubelet node2} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" Aug 18 11:40:12.510: INFO: At 2021-08-18 11:35:16 +0000 UTC - event for pod-configmaps-cf74abd4-bad1-4742-9696-0545d27eacc5: {kubelet node2} Failed: Error: ImagePullBackOff Aug 18 11:40:12.512: INFO: POD NODE PHASE GRACE CONDITIONS Aug 18 11:40:12.512: INFO: pod-configmaps-cf74abd4-bad1-4742-9696-0545d27eacc5 node2 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:35:12 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:35:12 +0000 UTC ContainersNotReady containers with unready status: [configmap-volume-data-test configmap-volume-binary-test]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:35:12 +0000 UTC ContainersNotReady containers with unready status: [configmap-volume-data-test configmap-volume-binary-test]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:35:12 +0000 UTC }] Aug 18 11:40:12.512: INFO: Aug 18 11:40:12.516: INFO: Logging node info for node master1 Aug 18 11:40:12.518: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 ebb211fa-503f-4cfe-b1ed-c95d27a70e6e 66270 0 2021-08-18 08:20:52 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"3a:82:be:72:b5:15"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:20:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:20:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:25:59 +0000 UTC,LastTransitionTime:2021-08-18 08:25:59 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:40:05 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:40:05 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:40:05 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:40:05 +0000 UTC,LastTransitionTime:2021-08-18 08:25:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:58c3e57359b641ad92fa1959f2fecf5d,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:012cd796-2076-45d6-8b14-d3e0451b1e64,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[@ :],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:40:12.519: INFO: Logging kubelet events for node master1 Aug 18 11:40:12.521: INFO: Logging pods the kubelet thinks is on node master1 Aug 18 11:40:12.529: INFO: kube-proxy-vqk4v started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:12.529: INFO: Container kube-proxy ready: true, restart count 1 Aug 18 11:40:12.529: INFO: kube-flannel-q64cq started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:40:12.529: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:40:12.530: INFO: Container kube-flannel ready: true, restart count 3 Aug 18 11:40:12.530: INFO: coredns-7677f9bb54-kn2qg started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:12.530: INFO: Container coredns ready: true, restart count 2 Aug 18 11:40:12.530: INFO: kube-scheduler-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:12.530: INFO: Container kube-scheduler ready: true, restart count 0 Aug 18 11:40:12.530: INFO: kube-apiserver-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:12.530: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:40:12.530: INFO: kube-multus-ds-amd64-kbcp6 started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:12.530: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:40:12.530: INFO: docker-registry-docker-registry-56cbc7bc58-49kl2 started at 2021-08-18 08:26:23 +0000 UTC (0+2 container statuses recorded) Aug 18 11:40:12.530: INFO: Container docker-registry ready: true, restart count 0 Aug 18 11:40:12.530: INFO: Container nginx ready: true, restart count 0 Aug 18 11:40:12.530: INFO: node-exporter-5hwz9 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:40:12.530: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:40:12.530: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:40:12.530: INFO: kube-controller-manager-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:12.530: INFO: Container kube-controller-manager ready: true, restart count 2 W0818 11:40:12.541418 30 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:40:12.573: INFO: Latency metrics for node master1 Aug 18 11:40:12.573: INFO: Logging node info for node master2 Aug 18 11:40:12.575: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 78946293-3abe-4442-84d4-8ed6b1d15ce0 66259 0 2021-08-18 08:21:31 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"7e:f5:c2:cc:3a:b4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:21:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:21:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-08-18 08:29:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:40:04 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:40:04 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:40:04 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:40:04 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0c44122c7a7248c18d8571e1cc667258,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:0cd329f2-48e0-4c8f-b8b9-fa3ae0ed8406,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:40:12.576: INFO: Logging kubelet events for node master2 Aug 18 11:40:12.579: INFO: Logging pods the kubelet thinks is on node master2 Aug 18 11:40:12.587: INFO: kube-proxy-kh2l9 started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:12.587: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:40:12.587: INFO: kube-flannel-pp56h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:40:12.587: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:40:12.587: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:40:12.587: INFO: kube-controller-manager-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:12.587: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:40:12.587: INFO: kube-scheduler-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:12.587: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:40:12.587: INFO: kube-multus-ds-amd64-mld8g started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:12.587: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:40:12.587: INFO: dns-autoscaler-5b7b5c9b6f-hh47r started at 2021-08-18 08:23:57 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:12.587: INFO: Container autoscaler ready: true, restart count 2 Aug 18 11:40:12.587: INFO: node-feature-discovery-controller-5bf5c49849-mq57c started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:12.587: INFO: Container nfd-controller ready: true, restart count 0 Aug 18 11:40:12.587: INFO: node-exporter-48nfx started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:40:12.587: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:40:12.587: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:40:12.587: INFO: kube-apiserver-master2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:12.587: INFO: Container kube-apiserver ready: true, restart count 0 W0818 11:40:12.600880 30 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:40:12.633: INFO: Latency metrics for node master2 Aug 18 11:40:12.633: INFO: Logging node info for node master3 Aug 18 11:40:12.636: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 44feac2b-9447-4be2-9fcd-62f836d67c72 66298 0 2021-08-18 08:21:41 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"86:e4:31:99:58:40"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {kubelet Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:40:09 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:40:09 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:40:09 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:40:09 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1fae19ae59884c44899bcd08aa243244,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:5db926c5-6530-4635-a0d5-806974a3b732,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:40:12.636: INFO: Logging kubelet events for node master3 Aug 18 11:40:12.638: INFO: Logging pods the kubelet thinks is on node master3 Aug 18 11:40:12.647: INFO: kube-proxy-sd5lc started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:12.647: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:40:12.647: INFO: kube-flannel-x6tlr started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:40:12.647: INFO: Init container install-cni ready: true, restart count 1 Aug 18 11:40:12.647: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:40:12.647: INFO: kube-multus-ds-amd64-bkw6c started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:12.647: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:40:12.647: INFO: coredns-7677f9bb54-5hxfh started at 2021-08-18 08:23:54 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:12.647: INFO: Container coredns ready: true, restart count 1 Aug 18 11:40:12.647: INFO: node-exporter-vq7d8 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:40:12.647: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:40:12.647: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:40:12.647: INFO: kube-controller-manager-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:12.647: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:40:12.647: INFO: kube-scheduler-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:12.647: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:40:12.647: INFO: kube-apiserver-master3 started at 2021-08-18 08:29:12 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:12.647: INFO: Container kube-apiserver ready: true, restart count 0 W0818 11:40:12.660009 30 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:40:12.687: INFO: Latency metrics for node master3 Aug 18 11:40:12.687: INFO: Logging node info for node node1 Aug 18 11:40:12.690: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 84defabd-6ebf-43ec-a629-44c6713da9c9 66269 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"9a:87:55:36:7b:df"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:13 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:35 +0000 UTC,LastTransitionTime:2021-08-18 08:26:35 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:40:05 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:40:05 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:40:05 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:40:05 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:69946ff2b7bc462fa25eb7adb4703c23,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:736dc52f-f5e3-494e-86ca-01eedbea015c,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:a7cea43d9d2f67c38fbf0407786edbe660ee9072945f7bb272b55fd255e8eaca opnfv/barometer-collectd:stable],SizeBytes:1075746799,},ContainerImage{Names:[@ :],SizeBytes:1003788820,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[aquasec/kube-hunter@sha256:2be6820bc1d7e0f57193a9a27d5a3e16b2fd93c53747b03ce8ca48c6fc323781 aquasec/kube-hunter:0.3.1],SizeBytes:347611549,},ContainerImage{Names:[golang@sha256:db2475a1dbb2149508e5db31d7d77a75e6600d54be645f37681f03f2762169ba golang:alpine3.12],SizeBytes:301186719,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:de25c7fc6c4f3a27c7f0c2dff454e4671823a34d88abd533f210848d527e0fbb alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:40:12.691: INFO: Logging kubelet events for node node1 Aug 18 11:40:12.693: INFO: Logging pods the kubelet thinks is on node node1 Aug 18 11:40:12.709: INFO: busybox-host-aliasesf99672e9-247c-4ef1-98b7-d10beeb0de14 started at 2021-08-18 11:35:06 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:12.709: INFO: Container busybox-host-aliasesf99672e9-247c-4ef1-98b7-d10beeb0de14 ready: false, restart count 0 Aug 18 11:40:12.709: INFO: var-expansion-6fae893b-fb11-45bd-9eb5-520674ef36fa started at 2021-08-18 11:38:19 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:12.709: INFO: Container dapi-container ready: false, restart count 0 Aug 18 11:40:12.709: INFO: liveness-9f86b189-30bb-4aa3-9a67-0f9f1469431f started at 2021-08-18 11:40:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:12.709: INFO: Container liveness ready: true, restart count 0 Aug 18 11:40:12.709: INFO: kube-multus-ds-amd64-rrvmb started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:12.709: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:40:12.709: INFO: node-feature-discovery-worker-pflgw started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:12.709: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:40:12.709: INFO: node-exporter-kcwvn started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:40:12.709: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:40:12.709: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:40:12.709: INFO: ss2-0 started at 2021-08-18 11:32:47 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:12.709: INFO: Container webserver ready: false, restart count 0 Aug 18 11:40:12.709: INFO: collectd-xdprr started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:40:12.709: INFO: Container collectd ready: true, restart count 0 Aug 18 11:40:12.709: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:40:12.709: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:40:12.709: INFO: busybox-ca1d4157-6037-47c1-a37c-160e2dd5121c started at 2021-08-18 11:37:58 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:12.709: INFO: Container busybox ready: false, restart count 0 Aug 18 11:40:12.709: INFO: kube-proxy-p6jvp started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:12.709: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:40:12.709: INFO: kubernetes-metrics-scraper-678c97765c-9nsv5 started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:12.709: INFO: Container kubernetes-metrics-scraper ready: true, restart count 2 Aug 18 11:40:12.709: INFO: cmk-init-discover-node1-bxznx started at 2021-08-18 08:32:10 +0000 UTC (0+3 container statuses recorded) Aug 18 11:40:12.709: INFO: Container discover ready: false, restart count 0 Aug 18 11:40:12.709: INFO: Container init ready: false, restart count 0 Aug 18 11:40:12.709: INFO: Container install ready: false, restart count 0 Aug 18 11:40:12.709: INFO: cmk-d8r27 started at 2021-08-18 08:32:52 +0000 UTC (0+2 container statuses recorded) Aug 18 11:40:12.709: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:40:12.709: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:40:12.709: INFO: nginx-proxy-node1 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:12.709: INFO: Container nginx-proxy ready: true, restart count 2 Aug 18 11:40:12.709: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-vsxvg started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:12.709: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:40:12.709: INFO: fail-once-local-8rxnh started at 2021-08-18 11:34:14 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:12.709: INFO: Container c ready: false, restart count 0 Aug 18 11:40:12.709: INFO: kube-flannel-q78nd started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:40:12.709: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:40:12.709: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:40:12.709: INFO: prometheus-k8s-0 started at 2021-08-18 08:34:03 +0000 UTC (0+5 container statuses recorded) Aug 18 11:40:12.709: INFO: Container custom-metrics-apiserver ready: true, restart count 0 Aug 18 11:40:12.709: INFO: Container grafana ready: true, restart count 0 Aug 18 11:40:12.709: INFO: Container prometheus ready: true, restart count 1 Aug 18 11:40:12.709: INFO: Container prometheus-config-reloader ready: true, restart count 0 Aug 18 11:40:12.709: INFO: Container rules-configmap-reloader ready: true, restart count 0 W0818 11:40:12.720238 30 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:40:12.759: INFO: Latency metrics for node node1 Aug 18 11:40:12.759: INFO: Logging node info for node node2 Aug 18 11:40:12.762: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 1d01177e-3dbb-48a1-a0bc-d18af27ab7f8 66265 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:d1:47:f8:1d:22"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:36 +0000 UTC,LastTransitionTime:2021-08-18 08:26:36 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:40:04 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:40:04 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:40:04 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:40:04 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:dc1f286135c145349b8a016880b65a2f,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:037e7e2d-94e9-42f4-a719-896e5005ac70,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:40:12.763: INFO: Logging kubelet events for node node2 Aug 18 11:40:12.764: INFO: Logging pods the kubelet thinks is on node node2 Aug 18 11:40:12.778: INFO: kubernetes-dashboard-86c6f9df5b-qrtdk started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:12.778: INFO: Container kubernetes-dashboard ready: true, restart count 2 Aug 18 11:40:12.778: INFO: cmk-748rz started at 2021-08-18 08:32:53 +0000 UTC (0+2 container statuses recorded) Aug 18 11:40:12.778: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:40:12.778: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:40:12.778: INFO: pod-configmaps-cf74abd4-bad1-4742-9696-0545d27eacc5 started at 2021-08-18 11:35:12 +0000 UTC (0+2 container statuses recorded) Aug 18 11:40:12.778: INFO: Container configmap-volume-binary-test ready: false, restart count 0 Aug 18 11:40:12.778: INFO: Container configmap-volume-data-test ready: false, restart count 0 Aug 18 11:40:12.778: INFO: pod-adoption started at 2021-08-18 11:36:15 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:12.778: INFO: Container pod-adoption ready: false, restart count 0 Aug 18 11:40:12.778: INFO: kube-proxy-qkj9c started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:12.778: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:40:12.778: INFO: node-feature-discovery-worker-hzpf5 started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:12.778: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:40:12.778: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-c82pt started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:12.778: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:40:12.778: INFO: prometheus-operator-5bb8cb9d8f-k97ws started at 2021-08-18 08:33:38 +0000 UTC (0+2 container statuses recorded) Aug 18 11:40:12.778: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:40:12.778: INFO: Container prometheus-operator ready: true, restart count 0 Aug 18 11:40:12.778: INFO: kube-multus-ds-amd64-rvzsg started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:12.778: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:40:12.778: INFO: collectd-67ntq started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:40:12.778: INFO: Container collectd ready: true, restart count 0 Aug 18 11:40:12.778: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:40:12.778: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:40:12.778: INFO: cmk-webhook-6c9d5f8578-7cxjr started at 2021-08-18 08:32:53 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:12.778: INFO: Container cmk-webhook ready: true, restart count 0 Aug 18 11:40:12.778: INFO: pod-init-c9a6ec62-328a-48d0-ad87-8e4a921066e8 started at 2021-08-18 11:37:42 +0000 UTC (2+1 container statuses recorded) Aug 18 11:40:12.778: INFO: Init container init1 ready: false, restart count 0 Aug 18 11:40:12.778: INFO: Init container init2 ready: false, restart count 0 Aug 18 11:40:12.778: INFO: Container run1 ready: false, restart count 0 Aug 18 11:40:12.778: INFO: kube-flannel-h7t5h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:40:12.778: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:40:12.778: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:40:12.778: INFO: node-exporter-lrrf2 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:40:12.778: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:40:12.778: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:40:12.778: INFO: var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e started at 2021-08-18 11:39:31 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:12.778: INFO: Container dapi-container ready: false, restart count 0 Aug 18 11:40:12.778: INFO: fail-once-local-pk5cs started at 2021-08-18 11:34:14 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:12.778: INFO: Container c ready: false, restart count 0 Aug 18 11:40:12.778: INFO: nginx-proxy-node2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:12.778: INFO: Container nginx-proxy ready: true, restart count 1 Aug 18 11:40:12.778: INFO: cmk-init-discover-node2-6b2kz started at 2021-08-18 08:32:30 +0000 UTC (0+3 container statuses recorded) Aug 18 11:40:12.778: INFO: Container discover ready: false, restart count 0 Aug 18 11:40:12.778: INFO: Container init ready: false, restart count 0 Aug 18 11:40:12.778: INFO: Container install ready: false, restart count 0 Aug 18 11:40:12.778: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-7rn45 started at 2021-08-18 08:36:42 +0000 UTC (0+2 container statuses recorded) Aug 18 11:40:12.778: INFO: Container tas-controller ready: true, restart count 0 Aug 18 11:40:12.778: INFO: Container tas-extender ready: true, restart count 0 Aug 18 11:40:12.778: INFO: downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1 started at 2021-08-18 11:39:54 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:12.778: INFO: Container dapi-container ready: false, restart count 0 W0818 11:40:12.791806 30 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:40:12.821: INFO: Latency metrics for node node2 Aug 18 11:40:12.821: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "configmap-4198" for this suite. • Failure [300.372 seconds] [sig-storage] ConfigMap /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/configmap_volume.go:36 binary data should be reflected in volume [NodeConformance] [Conformance] [It] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:40:12.504: Unexpected error: <*errors.errorString | 0xc0002801f0>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:103 ------------------------------ {"msg":"FAILED [sig-storage] ConfigMap binary data should be reflected in volume [NodeConformance] [Conformance]","total":-1,"completed":18,"skipped":295,"failed":2,"failures":["[sig-apps] Deployment RollingUpdateDeployment should delete old pods and create new ones [Conformance]","[sig-storage] ConfigMap binary data should be reflected in volume [NodeConformance] [Conformance]"]} SSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-cli] Kubectl client /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:40:12.875: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename kubectl STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-cli] Kubectl client /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/kubectl.go:247 [It] should check if kubectl diff finds a difference for Deployments [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: create deployment with httpd image Aug 18 11:40:12.900: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-8235 create -f -' Aug 18 11:40:13.170: INFO: stderr: "" Aug 18 11:40:13.170: INFO: stdout: "deployment.apps/httpd-deployment created\n" STEP: verify diff finds difference between live and declared image Aug 18 11:40:13.170: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-8235 diff -f -' Aug 18 11:40:13.573: INFO: rc: 1 Aug 18 11:40:13.573: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-8235 delete -f -' Aug 18 11:40:13.713: INFO: stderr: "" Aug 18 11:40:13.713: INFO: stdout: "deployment.apps \"httpd-deployment\" deleted\n" [AfterEach] [sig-cli] Kubectl client /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:40:13.713: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "kubectl-8235" for this suite. • ------------------------------ {"msg":"PASSED [sig-cli] Kubectl client Kubectl diff should check if kubectl diff finds a difference for Deployments [Conformance]","total":-1,"completed":19,"skipped":312,"failed":2,"failures":["[sig-apps] Deployment RollingUpdateDeployment should delete old pods and create new ones [Conformance]","[sig-storage] ConfigMap binary data should be reflected in volume [NodeConformance] [Conformance]"]} SSSSS ------------------------------ [BeforeEach] [k8s.io] Variable Expansion /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:38:19.111: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename var-expansion STEP: Waiting for a default service account to be provisioned in namespace [It] should succeed in writing subpaths in container [sig-storage][Slow] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: creating the pod STEP: waiting for pod running Aug 18 11:40:19.172: FAIL: while waiting for pod to be running Unexpected error: <*errors.errorString | 0xc0003001f0>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/common.glob..func9.8() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/expansion.go:331 +0x4ad k8s.io/kubernetes/test/e2e.RunE2ETests(0xc001a9de00) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc001a9de00) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc001a9de00, 0x4deb2c0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] Variable Expansion /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "var-expansion-5807". STEP: Found 9 events. Aug 18 11:40:19.177: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for var-expansion-6fae893b-fb11-45bd-9eb5-520674ef36fa: { } Scheduled: Successfully assigned var-expansion-5807/var-expansion-6fae893b-fb11-45bd-9eb5-520674ef36fa to node1 Aug 18 11:40:19.177: INFO: At 2021-08-18 11:38:20 +0000 UTC - event for var-expansion-6fae893b-fb11-45bd-9eb5-520674ef36fa: {multus } AddedInterface: Add eth0 [10.244.4.38/24] Aug 18 11:40:19.177: INFO: At 2021-08-18 11:38:20 +0000 UTC - event for var-expansion-6fae893b-fb11-45bd-9eb5-520674ef36fa: {kubelet node1} Pulling: Pulling image "docker.io/library/busybox:1.29" Aug 18 11:40:19.177: INFO: At 2021-08-18 11:38:21 +0000 UTC - event for var-expansion-6fae893b-fb11-45bd-9eb5-520674ef36fa: {kubelet node1} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit Aug 18 11:40:19.177: INFO: At 2021-08-18 11:38:21 +0000 UTC - event for var-expansion-6fae893b-fb11-45bd-9eb5-520674ef36fa: {kubelet node1} Failed: Error: ErrImagePull Aug 18 11:40:19.177: INFO: At 2021-08-18 11:38:21 +0000 UTC - event for var-expansion-6fae893b-fb11-45bd-9eb5-520674ef36fa: {kubelet node1} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Aug 18 11:40:19.177: INFO: At 2021-08-18 11:38:23 +0000 UTC - event for var-expansion-6fae893b-fb11-45bd-9eb5-520674ef36fa: {multus } AddedInterface: Add eth0 [10.244.4.39/24] Aug 18 11:40:19.177: INFO: At 2021-08-18 11:38:23 +0000 UTC - event for var-expansion-6fae893b-fb11-45bd-9eb5-520674ef36fa: {kubelet node1} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" Aug 18 11:40:19.177: INFO: At 2021-08-18 11:38:23 +0000 UTC - event for var-expansion-6fae893b-fb11-45bd-9eb5-520674ef36fa: {kubelet node1} Failed: Error: ImagePullBackOff Aug 18 11:40:19.179: INFO: POD NODE PHASE GRACE CONDITIONS Aug 18 11:40:19.179: INFO: var-expansion-6fae893b-fb11-45bd-9eb5-520674ef36fa node1 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:38:19 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:38:19 +0000 UTC ContainersNotReady containers with unready status: [dapi-container]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:38:19 +0000 UTC ContainersNotReady containers with unready status: [dapi-container]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:38:19 +0000 UTC }] Aug 18 11:40:19.179: INFO: Aug 18 11:40:19.183: INFO: Logging node info for node master1 Aug 18 11:40:19.186: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 ebb211fa-503f-4cfe-b1ed-c95d27a70e6e 66374 0 2021-08-18 08:20:52 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"3a:82:be:72:b5:15"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:20:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:20:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:25:59 +0000 UTC,LastTransitionTime:2021-08-18 08:25:59 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:40:15 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:40:15 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:40:15 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:40:15 +0000 UTC,LastTransitionTime:2021-08-18 08:25:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:58c3e57359b641ad92fa1959f2fecf5d,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:012cd796-2076-45d6-8b14-d3e0451b1e64,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[@ :],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:40:19.186: INFO: Logging kubelet events for node master1 Aug 18 11:40:19.188: INFO: Logging pods the kubelet thinks is on node master1 Aug 18 11:40:19.196: INFO: kube-controller-manager-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:19.196: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:40:19.196: INFO: kube-multus-ds-amd64-kbcp6 started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:19.196: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:40:19.196: INFO: docker-registry-docker-registry-56cbc7bc58-49kl2 started at 2021-08-18 08:26:23 +0000 UTC (0+2 container statuses recorded) Aug 18 11:40:19.196: INFO: Container docker-registry ready: true, restart count 0 Aug 18 11:40:19.196: INFO: Container nginx ready: true, restart count 0 Aug 18 11:40:19.197: INFO: node-exporter-5hwz9 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:40:19.197: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:40:19.197: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:40:19.197: INFO: kube-apiserver-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:19.197: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:40:19.197: INFO: kube-proxy-vqk4v started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:19.197: INFO: Container kube-proxy ready: true, restart count 1 Aug 18 11:40:19.197: INFO: kube-flannel-q64cq started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:40:19.197: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:40:19.197: INFO: Container kube-flannel ready: true, restart count 3 Aug 18 11:40:19.197: INFO: coredns-7677f9bb54-kn2qg started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:19.197: INFO: Container coredns ready: true, restart count 2 Aug 18 11:40:19.197: INFO: kube-scheduler-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:19.197: INFO: Container kube-scheduler ready: true, restart count 0 W0818 11:40:19.210129 34 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:40:19.233: INFO: Latency metrics for node master1 Aug 18 11:40:19.233: INFO: Logging node info for node master2 Aug 18 11:40:19.237: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 78946293-3abe-4442-84d4-8ed6b1d15ce0 66356 0 2021-08-18 08:21:31 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"7e:f5:c2:cc:3a:b4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:21:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:21:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-08-18 08:29:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:40:14 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:40:14 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:40:14 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:40:14 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0c44122c7a7248c18d8571e1cc667258,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:0cd329f2-48e0-4c8f-b8b9-fa3ae0ed8406,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:40:19.238: INFO: Logging kubelet events for node master2 Aug 18 11:40:19.240: INFO: Logging pods the kubelet thinks is on node master2 Aug 18 11:40:19.248: INFO: kube-apiserver-master2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:19.248: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:40:19.248: INFO: kube-scheduler-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:19.248: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:40:19.248: INFO: kube-multus-ds-amd64-mld8g started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:19.248: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:40:19.248: INFO: dns-autoscaler-5b7b5c9b6f-hh47r started at 2021-08-18 08:23:57 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:19.248: INFO: Container autoscaler ready: true, restart count 2 Aug 18 11:40:19.248: INFO: node-feature-discovery-controller-5bf5c49849-mq57c started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:19.248: INFO: Container nfd-controller ready: true, restart count 0 Aug 18 11:40:19.248: INFO: node-exporter-48nfx started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:40:19.248: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:40:19.248: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:40:19.248: INFO: kube-controller-manager-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:19.248: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:40:19.248: INFO: kube-proxy-kh2l9 started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:19.248: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:40:19.248: INFO: kube-flannel-pp56h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:40:19.248: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:40:19.248: INFO: Container kube-flannel ready: true, restart count 1 W0818 11:40:19.261146 34 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:40:19.291: INFO: Latency metrics for node master2 Aug 18 11:40:19.291: INFO: Logging node info for node master3 Aug 18 11:40:19.294: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 44feac2b-9447-4be2-9fcd-62f836d67c72 66298 0 2021-08-18 08:21:41 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"86:e4:31:99:58:40"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {kubelet Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:40:09 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:40:09 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:40:09 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:40:09 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1fae19ae59884c44899bcd08aa243244,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:5db926c5-6530-4635-a0d5-806974a3b732,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:40:19.295: INFO: Logging kubelet events for node master3 Aug 18 11:40:19.298: INFO: Logging pods the kubelet thinks is on node master3 Aug 18 11:40:19.306: INFO: kube-proxy-sd5lc started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:19.306: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:40:19.306: INFO: kube-flannel-x6tlr started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:40:19.306: INFO: Init container install-cni ready: true, restart count 1 Aug 18 11:40:19.306: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:40:19.306: INFO: kube-multus-ds-amd64-bkw6c started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:19.306: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:40:19.306: INFO: coredns-7677f9bb54-5hxfh started at 2021-08-18 08:23:54 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:19.306: INFO: Container coredns ready: true, restart count 1 Aug 18 11:40:19.306: INFO: node-exporter-vq7d8 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:40:19.306: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:40:19.306: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:40:19.306: INFO: kube-controller-manager-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:19.306: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:40:19.306: INFO: kube-scheduler-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:19.306: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:40:19.306: INFO: kube-apiserver-master3 started at 2021-08-18 08:29:12 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:19.306: INFO: Container kube-apiserver ready: true, restart count 0 W0818 11:40:19.320175 34 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:40:19.342: INFO: Latency metrics for node master3 Aug 18 11:40:19.342: INFO: Logging node info for node node1 Aug 18 11:40:19.345: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 84defabd-6ebf-43ec-a629-44c6713da9c9 66373 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"9a:87:55:36:7b:df"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:13 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:35 +0000 UTC,LastTransitionTime:2021-08-18 08:26:35 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:40:15 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:40:15 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:40:15 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:40:15 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:69946ff2b7bc462fa25eb7adb4703c23,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:736dc52f-f5e3-494e-86ca-01eedbea015c,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:a7cea43d9d2f67c38fbf0407786edbe660ee9072945f7bb272b55fd255e8eaca opnfv/barometer-collectd:stable],SizeBytes:1075746799,},ContainerImage{Names:[@ :],SizeBytes:1003788820,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[aquasec/kube-hunter@sha256:2be6820bc1d7e0f57193a9a27d5a3e16b2fd93c53747b03ce8ca48c6fc323781 aquasec/kube-hunter:0.3.1],SizeBytes:347611549,},ContainerImage{Names:[golang@sha256:db2475a1dbb2149508e5db31d7d77a75e6600d54be645f37681f03f2762169ba golang:alpine3.12],SizeBytes:301186719,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:de25c7fc6c4f3a27c7f0c2dff454e4671823a34d88abd533f210848d527e0fbb alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:40:19.346: INFO: Logging kubelet events for node node1 Aug 18 11:40:19.348: INFO: Logging pods the kubelet thinks is on node node1 Aug 18 11:40:19.363: INFO: busybox-ca1d4157-6037-47c1-a37c-160e2dd5121c started at 2021-08-18 11:37:58 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:19.363: INFO: Container busybox ready: false, restart count 0 Aug 18 11:40:19.363: INFO: busybox-scheduling-f75e615f-f2c3-4e61-8ed7-848c386f63d3 started at 2021-08-18 11:40:13 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:19.363: INFO: Container busybox-scheduling-f75e615f-f2c3-4e61-8ed7-848c386f63d3 ready: false, restart count 0 Aug 18 11:40:19.363: INFO: kube-proxy-p6jvp started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:19.363: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:40:19.363: INFO: kubernetes-metrics-scraper-678c97765c-9nsv5 started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:19.363: INFO: Container kubernetes-metrics-scraper ready: true, restart count 2 Aug 18 11:40:19.363: INFO: cmk-init-discover-node1-bxznx started at 2021-08-18 08:32:10 +0000 UTC (0+3 container statuses recorded) Aug 18 11:40:19.363: INFO: Container discover ready: false, restart count 0 Aug 18 11:40:19.363: INFO: Container init ready: false, restart count 0 Aug 18 11:40:19.363: INFO: Container install ready: false, restart count 0 Aug 18 11:40:19.363: INFO: cmk-d8r27 started at 2021-08-18 08:32:52 +0000 UTC (0+2 container statuses recorded) Aug 18 11:40:19.363: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:40:19.363: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:40:19.363: INFO: collectd-xdprr started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:40:19.363: INFO: Container collectd ready: true, restart count 0 Aug 18 11:40:19.363: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:40:19.363: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:40:19.363: INFO: nginx-proxy-node1 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:19.363: INFO: Container nginx-proxy ready: true, restart count 2 Aug 18 11:40:19.363: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-vsxvg started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:19.363: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:40:19.363: INFO: fail-once-local-8rxnh started at 2021-08-18 11:34:14 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:19.363: INFO: Container c ready: false, restart count 0 Aug 18 11:40:19.363: INFO: kube-flannel-q78nd started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:40:19.363: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:40:19.363: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:40:19.363: INFO: prometheus-k8s-0 started at 2021-08-18 08:34:03 +0000 UTC (0+5 container statuses recorded) Aug 18 11:40:19.363: INFO: Container custom-metrics-apiserver ready: true, restart count 0 Aug 18 11:40:19.363: INFO: Container grafana ready: true, restart count 0 Aug 18 11:40:19.363: INFO: Container prometheus ready: true, restart count 1 Aug 18 11:40:19.363: INFO: Container prometheus-config-reloader ready: true, restart count 0 Aug 18 11:40:19.363: INFO: Container rules-configmap-reloader ready: true, restart count 0 Aug 18 11:40:19.363: INFO: var-expansion-6fae893b-fb11-45bd-9eb5-520674ef36fa started at 2021-08-18 11:38:19 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:19.363: INFO: Container dapi-container ready: false, restart count 0 Aug 18 11:40:19.363: INFO: liveness-9f86b189-30bb-4aa3-9a67-0f9f1469431f started at 2021-08-18 11:40:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:19.363: INFO: Container liveness ready: true, restart count 0 Aug 18 11:40:19.363: INFO: kube-multus-ds-amd64-rrvmb started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:19.363: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:40:19.363: INFO: node-feature-discovery-worker-pflgw started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:19.363: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:40:19.363: INFO: node-exporter-kcwvn started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:40:19.363: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:40:19.363: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:40:19.363: INFO: ss2-0 started at 2021-08-18 11:32:47 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:19.363: INFO: Container webserver ready: false, restart count 0 W0818 11:40:19.375188 34 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:40:19.418: INFO: Latency metrics for node node1 Aug 18 11:40:19.418: INFO: Logging node info for node node2 Aug 18 11:40:19.421: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 1d01177e-3dbb-48a1-a0bc-d18af27ab7f8 66372 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:d1:47:f8:1d:22"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:36 +0000 UTC,LastTransitionTime:2021-08-18 08:26:36 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:40:15 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:40:15 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:40:15 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:40:15 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:dc1f286135c145349b8a016880b65a2f,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:037e7e2d-94e9-42f4-a719-896e5005ac70,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:40:19.422: INFO: Logging kubelet events for node node2 Aug 18 11:40:19.424: INFO: Logging pods the kubelet thinks is on node node2 Aug 18 11:40:19.438: INFO: kubernetes-dashboard-86c6f9df5b-qrtdk started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:19.438: INFO: Container kubernetes-dashboard ready: true, restart count 2 Aug 18 11:40:19.438: INFO: cmk-748rz started at 2021-08-18 08:32:53 +0000 UTC (0+2 container statuses recorded) Aug 18 11:40:19.438: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:40:19.438: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:40:19.438: INFO: pod-configmaps-cf74abd4-bad1-4742-9696-0545d27eacc5 started at 2021-08-18 11:35:12 +0000 UTC (0+2 container statuses recorded) Aug 18 11:40:19.438: INFO: Container configmap-volume-binary-test ready: false, restart count 0 Aug 18 11:40:19.438: INFO: Container configmap-volume-data-test ready: false, restart count 0 Aug 18 11:40:19.438: INFO: pod-adoption started at 2021-08-18 11:36:15 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:19.438: INFO: Container pod-adoption ready: false, restart count 0 Aug 18 11:40:19.438: INFO: kube-proxy-qkj9c started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:19.438: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:40:19.438: INFO: node-feature-discovery-worker-hzpf5 started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:19.438: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:40:19.438: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-c82pt started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:19.438: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:40:19.438: INFO: prometheus-operator-5bb8cb9d8f-k97ws started at 2021-08-18 08:33:38 +0000 UTC (0+2 container statuses recorded) Aug 18 11:40:19.438: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:40:19.438: INFO: Container prometheus-operator ready: true, restart count 0 Aug 18 11:40:19.438: INFO: kube-multus-ds-amd64-rvzsg started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:19.438: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:40:19.438: INFO: collectd-67ntq started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:40:19.438: INFO: Container collectd ready: true, restart count 0 Aug 18 11:40:19.438: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:40:19.438: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:40:19.438: INFO: cmk-webhook-6c9d5f8578-7cxjr started at 2021-08-18 08:32:53 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:19.438: INFO: Container cmk-webhook ready: true, restart count 0 Aug 18 11:40:19.438: INFO: pod-init-c9a6ec62-328a-48d0-ad87-8e4a921066e8 started at 2021-08-18 11:37:42 +0000 UTC (2+1 container statuses recorded) Aug 18 11:40:19.438: INFO: Init container init1 ready: false, restart count 0 Aug 18 11:40:19.438: INFO: Init container init2 ready: false, restart count 0 Aug 18 11:40:19.438: INFO: Container run1 ready: false, restart count 0 Aug 18 11:40:19.438: INFO: kube-flannel-h7t5h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:40:19.439: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:40:19.439: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:40:19.439: INFO: node-exporter-lrrf2 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:40:19.439: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:40:19.439: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:40:19.439: INFO: var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e started at 2021-08-18 11:39:31 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:19.439: INFO: Container dapi-container ready: false, restart count 0 Aug 18 11:40:19.439: INFO: nginx-proxy-node2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:19.439: INFO: Container nginx-proxy ready: true, restart count 1 Aug 18 11:40:19.439: INFO: cmk-init-discover-node2-6b2kz started at 2021-08-18 08:32:30 +0000 UTC (0+3 container statuses recorded) Aug 18 11:40:19.439: INFO: Container discover ready: false, restart count 0 Aug 18 11:40:19.439: INFO: Container init ready: false, restart count 0 Aug 18 11:40:19.439: INFO: Container install ready: false, restart count 0 Aug 18 11:40:19.439: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-7rn45 started at 2021-08-18 08:36:42 +0000 UTC (0+2 container statuses recorded) Aug 18 11:40:19.439: INFO: Container tas-controller ready: true, restart count 0 Aug 18 11:40:19.439: INFO: Container tas-extender ready: true, restart count 0 Aug 18 11:40:19.439: INFO: downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1 started at 2021-08-18 11:39:54 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:19.439: INFO: Container dapi-container ready: false, restart count 0 Aug 18 11:40:19.439: INFO: fail-once-local-pk5cs started at 2021-08-18 11:34:14 +0000 UTC (0+1 container statuses recorded) Aug 18 11:40:19.439: INFO: Container c ready: false, restart count 0 W0818 11:40:19.451453 34 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:40:19.479: INFO: Latency metrics for node node2 Aug 18 11:40:19.479: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "var-expansion-5807" for this suite. • Failure [120.376 seconds] [k8s.io] Variable Expansion /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 should succeed in writing subpaths in container [sig-storage][Slow] [Conformance] [It] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:40:19.172: while waiting for pod to be running Unexpected error: <*errors.errorString | 0xc0003001f0>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/expansion.go:331 ------------------------------ {"msg":"FAILED [k8s.io] Variable Expansion should succeed in writing subpaths in container [sig-storage][Slow] [Conformance]","total":-1,"completed":10,"skipped":77,"failed":3,"failures":["[k8s.io] Variable Expansion should verify that a failing subpath expansion can be modified during the lifecycle of a container [sig-storage][Slow] [Conformance]","[sig-apps] Deployment deployment should delete old replica sets [Conformance]","[k8s.io] Variable Expansion should succeed in writing subpaths in container [sig-storage][Slow] [Conformance]"]} SSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-apps] ReplicationController /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:36:15.936: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename replication-controller STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-apps] ReplicationController /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/rc.go:54 [It] should adopt matching pods on creation [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Given a Pod with a 'name' label pod-adoption is created Aug 18 11:41:15.985: FAIL: Unexpected error: <*errors.errorString | 0xc0002c2200>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*PodClient).CreateSync(0xc004465d00, 0xc003100c00, 0x4bef98b) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:103 +0xfe k8s.io/kubernetes/test/e2e/apps.testRCAdoptMatchingOrphans(0xc0005d6c60) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/rc.go:561 +0x233 k8s.io/kubernetes/test/e2e/apps.glob..func8.5() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/rc.go:90 +0x2a k8s.io/kubernetes/test/e2e.RunE2ETests(0xc00359cc00) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc00359cc00) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc00359cc00, 0x4deb2c0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [sig-apps] ReplicationController /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "replication-controller-1314". STEP: Found 9 events. Aug 18 11:41:15.990: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for pod-adoption: { } Scheduled: Successfully assigned replication-controller-1314/pod-adoption to node2 Aug 18 11:41:15.990: INFO: At 2021-08-18 11:36:17 +0000 UTC - event for pod-adoption: {multus } AddedInterface: Add eth0 [10.244.3.28/24] Aug 18 11:41:15.990: INFO: At 2021-08-18 11:36:17 +0000 UTC - event for pod-adoption: {kubelet node2} Pulling: Pulling image "docker.io/library/httpd:2.4.38-alpine" Aug 18 11:41:15.990: INFO: At 2021-08-18 11:36:18 +0000 UTC - event for pod-adoption: {kubelet node2} Failed: Failed to pull image "docker.io/library/httpd:2.4.38-alpine": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit Aug 18 11:41:15.990: INFO: At 2021-08-18 11:36:18 +0000 UTC - event for pod-adoption: {kubelet node2} Failed: Error: ErrImagePull Aug 18 11:41:15.990: INFO: At 2021-08-18 11:36:19 +0000 UTC - event for pod-adoption: {kubelet node2} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Aug 18 11:41:15.990: INFO: At 2021-08-18 11:36:21 +0000 UTC - event for pod-adoption: {multus } AddedInterface: Add eth0 [10.244.3.29/24] Aug 18 11:41:15.990: INFO: At 2021-08-18 11:36:21 +0000 UTC - event for pod-adoption: {kubelet node2} BackOff: Back-off pulling image "docker.io/library/httpd:2.4.38-alpine" Aug 18 11:41:15.990: INFO: At 2021-08-18 11:36:21 +0000 UTC - event for pod-adoption: {kubelet node2} Failed: Error: ImagePullBackOff Aug 18 11:41:15.993: INFO: POD NODE PHASE GRACE CONDITIONS Aug 18 11:41:15.993: INFO: pod-adoption node2 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:36:15 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:36:15 +0000 UTC ContainersNotReady containers with unready status: [pod-adoption]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:36:15 +0000 UTC ContainersNotReady containers with unready status: [pod-adoption]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:36:15 +0000 UTC }] Aug 18 11:41:15.993: INFO: Aug 18 11:41:15.997: INFO: Logging node info for node master1 Aug 18 11:41:15.999: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 ebb211fa-503f-4cfe-b1ed-c95d27a70e6e 66845 0 2021-08-18 08:20:52 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"3a:82:be:72:b5:15"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:20:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:20:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:25:59 +0000 UTC,LastTransitionTime:2021-08-18 08:25:59 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:41:15 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:41:15 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:41:15 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:41:15 +0000 UTC,LastTransitionTime:2021-08-18 08:25:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:58c3e57359b641ad92fa1959f2fecf5d,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:012cd796-2076-45d6-8b14-d3e0451b1e64,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[@ :],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:41:16.000: INFO: Logging kubelet events for node master1 Aug 18 11:41:16.002: INFO: Logging pods the kubelet thinks is on node master1 Aug 18 11:41:16.011: INFO: kube-apiserver-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:41:16.011: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:41:16.011: INFO: kube-proxy-vqk4v started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:41:16.011: INFO: Container kube-proxy ready: true, restart count 1 Aug 18 11:41:16.011: INFO: kube-flannel-q64cq started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:41:16.012: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:41:16.012: INFO: Container kube-flannel ready: true, restart count 3 Aug 18 11:41:16.012: INFO: coredns-7677f9bb54-kn2qg started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:41:16.012: INFO: Container coredns ready: true, restart count 2 Aug 18 11:41:16.012: INFO: kube-scheduler-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:41:16.012: INFO: Container kube-scheduler ready: true, restart count 0 Aug 18 11:41:16.012: INFO: kube-controller-manager-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:41:16.012: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:41:16.012: INFO: kube-multus-ds-amd64-kbcp6 started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:41:16.012: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:41:16.012: INFO: docker-registry-docker-registry-56cbc7bc58-49kl2 started at 2021-08-18 08:26:23 +0000 UTC (0+2 container statuses recorded) Aug 18 11:41:16.012: INFO: Container docker-registry ready: true, restart count 0 Aug 18 11:41:16.012: INFO: Container nginx ready: true, restart count 0 Aug 18 11:41:16.012: INFO: node-exporter-5hwz9 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:41:16.012: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:41:16.012: INFO: Container node-exporter ready: true, restart count 0 W0818 11:41:16.023306 23 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:41:16.049: INFO: Latency metrics for node master1 Aug 18 11:41:16.049: INFO: Logging node info for node master2 Aug 18 11:41:16.052: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 78946293-3abe-4442-84d4-8ed6b1d15ce0 66838 0 2021-08-18 08:21:31 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"7e:f5:c2:cc:3a:b4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:21:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:21:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-08-18 08:29:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:41:14 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:41:14 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:41:14 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:41:14 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0c44122c7a7248c18d8571e1cc667258,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:0cd329f2-48e0-4c8f-b8b9-fa3ae0ed8406,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:41:16.052: INFO: Logging kubelet events for node master2 Aug 18 11:41:16.055: INFO: Logging pods the kubelet thinks is on node master2 Aug 18 11:41:16.066: INFO: kube-apiserver-master2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:41:16.066: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:41:16.066: INFO: kube-scheduler-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:41:16.066: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:41:16.066: INFO: kube-multus-ds-amd64-mld8g started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:41:16.066: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:41:16.066: INFO: dns-autoscaler-5b7b5c9b6f-hh47r started at 2021-08-18 08:23:57 +0000 UTC (0+1 container statuses recorded) Aug 18 11:41:16.066: INFO: Container autoscaler ready: true, restart count 2 Aug 18 11:41:16.066: INFO: node-feature-discovery-controller-5bf5c49849-mq57c started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:41:16.066: INFO: Container nfd-controller ready: true, restart count 0 Aug 18 11:41:16.066: INFO: node-exporter-48nfx started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:41:16.066: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:41:16.066: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:41:16.066: INFO: kube-controller-manager-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:41:16.066: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:41:16.066: INFO: kube-proxy-kh2l9 started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:41:16.066: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:41:16.066: INFO: kube-flannel-pp56h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:41:16.066: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:41:16.066: INFO: Container kube-flannel ready: true, restart count 1 W0818 11:41:16.078902 23 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:41:16.104: INFO: Latency metrics for node master2 Aug 18 11:41:16.104: INFO: Logging node info for node master3 Aug 18 11:41:16.106: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 44feac2b-9447-4be2-9fcd-62f836d67c72 66823 0 2021-08-18 08:21:41 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"86:e4:31:99:58:40"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {kubelet Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:41:09 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:41:09 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:41:09 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:41:09 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1fae19ae59884c44899bcd08aa243244,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:5db926c5-6530-4635-a0d5-806974a3b732,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:41:16.106: INFO: Logging kubelet events for node master3 Aug 18 11:41:16.109: INFO: Logging pods the kubelet thinks is on node master3 Aug 18 11:41:16.118: INFO: coredns-7677f9bb54-5hxfh started at 2021-08-18 08:23:54 +0000 UTC (0+1 container statuses recorded) Aug 18 11:41:16.118: INFO: Container coredns ready: true, restart count 1 Aug 18 11:41:16.118: INFO: node-exporter-vq7d8 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:41:16.118: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:41:16.118: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:41:16.118: INFO: kube-controller-manager-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:41:16.118: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:41:16.118: INFO: kube-scheduler-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:41:16.118: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:41:16.118: INFO: kube-apiserver-master3 started at 2021-08-18 08:29:12 +0000 UTC (0+1 container statuses recorded) Aug 18 11:41:16.118: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:41:16.118: INFO: kube-proxy-sd5lc started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:41:16.118: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:41:16.118: INFO: kube-flannel-x6tlr started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:41:16.118: INFO: Init container install-cni ready: true, restart count 1 Aug 18 11:41:16.118: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:41:16.118: INFO: kube-multus-ds-amd64-bkw6c started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:41:16.118: INFO: Container kube-multus ready: true, restart count 1 W0818 11:41:16.134687 23 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:41:16.159: INFO: Latency metrics for node master3 Aug 18 11:41:16.159: INFO: Logging node info for node node1 Aug 18 11:41:16.161: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 84defabd-6ebf-43ec-a629-44c6713da9c9 66813 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"9a:87:55:36:7b:df"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:13 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:35 +0000 UTC,LastTransitionTime:2021-08-18 08:26:35 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:41:07 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:41:07 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:41:07 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:41:07 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:69946ff2b7bc462fa25eb7adb4703c23,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:736dc52f-f5e3-494e-86ca-01eedbea015c,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:a7cea43d9d2f67c38fbf0407786edbe660ee9072945f7bb272b55fd255e8eaca opnfv/barometer-collectd:stable],SizeBytes:1075746799,},ContainerImage{Names:[@ :],SizeBytes:1003788820,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[aquasec/kube-hunter@sha256:2be6820bc1d7e0f57193a9a27d5a3e16b2fd93c53747b03ce8ca48c6fc323781 aquasec/kube-hunter:0.3.1],SizeBytes:347611549,},ContainerImage{Names:[golang@sha256:db2475a1dbb2149508e5db31d7d77a75e6600d54be645f37681f03f2762169ba golang:alpine3.12],SizeBytes:301186719,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:de25c7fc6c4f3a27c7f0c2dff454e4671823a34d88abd533f210848d527e0fbb alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:41:16.162: INFO: Logging kubelet events for node node1 Aug 18 11:41:16.164: INFO: Logging pods the kubelet thinks is on node node1 Aug 18 11:41:16.179: INFO: kube-flannel-q78nd started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:41:16.180: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:41:16.180: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:41:16.180: INFO: prometheus-k8s-0 started at 2021-08-18 08:34:03 +0000 UTC (0+5 container statuses recorded) Aug 18 11:41:16.180: INFO: Container custom-metrics-apiserver ready: true, restart count 0 Aug 18 11:41:16.180: INFO: Container grafana ready: true, restart count 0 Aug 18 11:41:16.180: INFO: Container prometheus ready: true, restart count 1 Aug 18 11:41:16.180: INFO: Container prometheus-config-reloader ready: true, restart count 0 Aug 18 11:41:16.180: INFO: Container rules-configmap-reloader ready: true, restart count 0 Aug 18 11:41:16.180: INFO: ss2-0 started at 2021-08-18 11:32:47 +0000 UTC (0+1 container statuses recorded) Aug 18 11:41:16.180: INFO: Container webserver ready: false, restart count 0 Aug 18 11:41:16.180: INFO: liveness-9f86b189-30bb-4aa3-9a67-0f9f1469431f started at 2021-08-18 11:40:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:41:16.180: INFO: Container liveness ready: true, restart count 3 Aug 18 11:41:16.180: INFO: kube-multus-ds-amd64-rrvmb started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:41:16.180: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:41:16.180: INFO: node-feature-discovery-worker-pflgw started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:41:16.180: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:41:16.180: INFO: node-exporter-kcwvn started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:41:16.180: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:41:16.180: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:41:16.180: INFO: cmk-d8r27 started at 2021-08-18 08:32:52 +0000 UTC (0+2 container statuses recorded) Aug 18 11:41:16.180: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:41:16.180: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:41:16.180: INFO: collectd-xdprr started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:41:16.180: INFO: Container collectd ready: true, restart count 0 Aug 18 11:41:16.180: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:41:16.180: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:41:16.180: INFO: busybox-ca1d4157-6037-47c1-a37c-160e2dd5121c started at 2021-08-18 11:37:58 +0000 UTC (0+1 container statuses recorded) Aug 18 11:41:16.180: INFO: Container busybox ready: false, restart count 0 Aug 18 11:41:16.180: INFO: busybox-scheduling-f75e615f-f2c3-4e61-8ed7-848c386f63d3 started at 2021-08-18 11:40:13 +0000 UTC (0+1 container statuses recorded) Aug 18 11:41:16.180: INFO: Container busybox-scheduling-f75e615f-f2c3-4e61-8ed7-848c386f63d3 ready: false, restart count 0 Aug 18 11:41:16.180: INFO: kube-proxy-p6jvp started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:41:16.180: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:41:16.180: INFO: kubernetes-metrics-scraper-678c97765c-9nsv5 started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:41:16.180: INFO: Container kubernetes-metrics-scraper ready: true, restart count 2 Aug 18 11:41:16.180: INFO: cmk-init-discover-node1-bxznx started at 2021-08-18 08:32:10 +0000 UTC (0+3 container statuses recorded) Aug 18 11:41:16.180: INFO: Container discover ready: false, restart count 0 Aug 18 11:41:16.180: INFO: Container init ready: false, restart count 0 Aug 18 11:41:16.180: INFO: Container install ready: false, restart count 0 Aug 18 11:41:16.180: INFO: nginx-proxy-node1 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:41:16.180: INFO: Container nginx-proxy ready: true, restart count 2 Aug 18 11:41:16.180: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-vsxvg started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:41:16.180: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:41:16.180: INFO: fail-once-local-8rxnh started at 2021-08-18 11:34:14 +0000 UTC (0+1 container statuses recorded) Aug 18 11:41:16.180: INFO: Container c ready: false, restart count 0 W0818 11:41:16.193251 23 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:41:16.531: INFO: Latency metrics for node node1 Aug 18 11:41:16.531: INFO: Logging node info for node node2 Aug 18 11:41:16.533: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 1d01177e-3dbb-48a1-a0bc-d18af27ab7f8 66848 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:d1:47:f8:1d:22"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:36 +0000 UTC,LastTransitionTime:2021-08-18 08:26:36 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:41:16 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:41:16 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:41:16 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:41:16 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:dc1f286135c145349b8a016880b65a2f,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:037e7e2d-94e9-42f4-a719-896e5005ac70,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:41:16.534: INFO: Logging kubelet events for node node2 Aug 18 11:41:16.536: INFO: Logging pods the kubelet thinks is on node node2 Aug 18 11:41:16.548: INFO: kubernetes-dashboard-86c6f9df5b-qrtdk started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:41:16.548: INFO: Container kubernetes-dashboard ready: true, restart count 2 Aug 18 11:41:16.548: INFO: cmk-748rz started at 2021-08-18 08:32:53 +0000 UTC (0+2 container statuses recorded) Aug 18 11:41:16.548: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:41:16.548: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:41:16.548: INFO: pod-adoption started at 2021-08-18 11:36:15 +0000 UTC (0+1 container statuses recorded) Aug 18 11:41:16.548: INFO: Container pod-adoption ready: false, restart count 0 Aug 18 11:41:16.548: INFO: kube-proxy-qkj9c started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:41:16.548: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:41:16.548: INFO: node-feature-discovery-worker-hzpf5 started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:41:16.548: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:41:16.548: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-c82pt started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:41:16.548: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:41:16.548: INFO: prometheus-operator-5bb8cb9d8f-k97ws started at 2021-08-18 08:33:38 +0000 UTC (0+2 container statuses recorded) Aug 18 11:41:16.548: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:41:16.548: INFO: Container prometheus-operator ready: true, restart count 0 Aug 18 11:41:16.548: INFO: kube-multus-ds-amd64-rvzsg started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:41:16.548: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:41:16.548: INFO: collectd-67ntq started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:41:16.548: INFO: Container collectd ready: true, restart count 0 Aug 18 11:41:16.548: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:41:16.548: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:41:16.548: INFO: cmk-webhook-6c9d5f8578-7cxjr started at 2021-08-18 08:32:53 +0000 UTC (0+1 container statuses recorded) Aug 18 11:41:16.548: INFO: Container cmk-webhook ready: true, restart count 0 Aug 18 11:41:16.548: INFO: pod-init-c9a6ec62-328a-48d0-ad87-8e4a921066e8 started at 2021-08-18 11:37:42 +0000 UTC (2+1 container statuses recorded) Aug 18 11:41:16.548: INFO: Init container init1 ready: false, restart count 0 Aug 18 11:41:16.548: INFO: Init container init2 ready: false, restart count 0 Aug 18 11:41:16.548: INFO: Container run1 ready: false, restart count 0 Aug 18 11:41:16.548: INFO: kube-flannel-h7t5h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:41:16.548: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:41:16.548: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:41:16.548: INFO: node-exporter-lrrf2 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:41:16.548: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:41:16.548: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:41:16.548: INFO: var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e started at 2021-08-18 11:39:31 +0000 UTC (0+1 container statuses recorded) Aug 18 11:41:16.548: INFO: Container dapi-container ready: false, restart count 0 Aug 18 11:41:16.548: INFO: nginx-proxy-node2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:41:16.548: INFO: Container nginx-proxy ready: true, restart count 1 Aug 18 11:41:16.548: INFO: cmk-init-discover-node2-6b2kz started at 2021-08-18 08:32:30 +0000 UTC (0+3 container statuses recorded) Aug 18 11:41:16.548: INFO: Container discover ready: false, restart count 0 Aug 18 11:41:16.548: INFO: Container init ready: false, restart count 0 Aug 18 11:41:16.548: INFO: Container install ready: false, restart count 0 Aug 18 11:41:16.548: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-7rn45 started at 2021-08-18 08:36:42 +0000 UTC (0+2 container statuses recorded) Aug 18 11:41:16.548: INFO: Container tas-controller ready: true, restart count 0 Aug 18 11:41:16.548: INFO: Container tas-extender ready: true, restart count 0 Aug 18 11:41:16.548: INFO: downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1 started at 2021-08-18 11:39:54 +0000 UTC (0+1 container statuses recorded) Aug 18 11:41:16.548: INFO: Container dapi-container ready: false, restart count 0 Aug 18 11:41:16.548: INFO: fail-once-local-pk5cs started at 2021-08-18 11:34:14 +0000 UTC (0+1 container statuses recorded) Aug 18 11:41:16.548: INFO: Container c ready: false, restart count 0 W0818 11:41:16.559976 23 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:41:16.612: INFO: Latency metrics for node node2 Aug 18 11:41:16.612: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "replication-controller-1314" for this suite. • Failure [300.684 seconds] [sig-apps] ReplicationController /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/framework.go:23 should adopt matching pods on creation [Conformance] [It] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:41:15.985: Unexpected error: <*errors.errorString | 0xc0002c2200>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:103 ------------------------------ {"msg":"FAILED [sig-apps] ReplicationController should adopt matching pods on creation [Conformance]","total":-1,"completed":3,"skipped":116,"failed":3,"failures":["[sig-apps] StatefulSet [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] Should recreate evicted statefulset [Conformance]","[sig-node] Downward API should provide pod UID as env vars [NodeConformance] [Conformance]","[sig-apps] ReplicationController should adopt matching pods on creation [Conformance]"]} SSS ------------------------------ [BeforeEach] [sig-api-machinery] Garbage collector /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:40:19.525: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename gc STEP: Waiting for a default service account to be provisioned in namespace [It] should keep the rc around until all its pods are deleted if the deleteOptions says so [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: create the rc STEP: delete the rc STEP: wait for the rc to be deleted STEP: Gathering metrics W0818 11:40:25.584170 34 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:41:27.599: INFO: MetricsGrabber failed grab metrics. Skipping metrics gathering. [AfterEach] [sig-api-machinery] Garbage collector /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:41:27.599: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "gc-2249" for this suite. • [SLOW TEST:68.082 seconds] [sig-api-machinery] Garbage collector /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23 should keep the rc around until all its pods are deleted if the deleteOptions says so [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-api-machinery] Garbage collector should keep the rc around until all its pods are deleted if the deleteOptions says so [Conformance]","total":-1,"completed":11,"skipped":91,"failed":3,"failures":["[k8s.io] Variable Expansion should verify that a failing subpath expansion can be modified during the lifecycle of a container [sig-storage][Slow] [Conformance]","[sig-apps] Deployment deployment should delete old replica sets [Conformance]","[k8s.io] Variable Expansion should succeed in writing subpaths in container [sig-storage][Slow] [Conformance]"]} SSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-api-machinery] CustomResourceConversionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:41:16.634: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename crd-webhook STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-api-machinery] CustomResourceConversionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/crd_conversion_webhook.go:126 STEP: Setting up server cert STEP: Create role binding to let cr conversion webhook read extension-apiserver-authentication STEP: Deploying the custom resource conversion webhook pod STEP: Wait for the deployment to be ready Aug 18 11:41:17.398: INFO: deployment "sample-crd-conversion-webhook-deployment" doesn't have the required revision set Aug 18 11:41:19.408: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764883677, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764883677, loc:(*time.Location)(0x77169a0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764883677, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764883677, loc:(*time.Location)(0x77169a0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-85d57b96d6\" is progressing."}}, CollisionCount:(*int32)(nil)} STEP: Deploying the webhook service STEP: Verifying the service has paired with the endpoint Aug 18 11:41:22.420: INFO: Waiting for amount of service:e2e-test-crd-conversion-webhook endpoints to be 1 [It] should be able to convert a non homogeneous list of CRs [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:41:22.423: INFO: >>> kubeConfig: /root/.kube/config STEP: Creating a v1 custom resource STEP: Create a v2 custom resource STEP: List CRs in v1 STEP: List CRs in v2 [AfterEach] [sig-api-machinery] CustomResourceConversionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:41:28.564: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "crd-webhook-6650" for this suite. [AfterEach] [sig-api-machinery] CustomResourceConversionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/crd_conversion_webhook.go:137 • [SLOW TEST:11.966 seconds] [sig-api-machinery] CustomResourceConversionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23 should be able to convert a non homogeneous list of CRs [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-api-machinery] CustomResourceConversionWebhook [Privileged:ClusterAdmin] should be able to convert a non homogeneous list of CRs [Conformance]","total":-1,"completed":4,"skipped":119,"failed":3,"failures":["[sig-apps] StatefulSet [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] Should recreate evicted statefulset [Conformance]","[sig-node] Downward API should provide pod UID as env vars [NodeConformance] [Conformance]","[sig-apps] ReplicationController should adopt matching pods on creation [Conformance]"]} SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-api-machinery] CustomResourceDefinition resources [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:41:27.643: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename custom-resource-definition STEP: Waiting for a default service account to be provisioned in namespace [It] creating/deleting custom resource definition objects works [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:41:27.665: INFO: >>> kubeConfig: /root/.kube/config [AfterEach] [sig-api-machinery] CustomResourceDefinition resources [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:41:33.682: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "custom-resource-definition-4413" for this suite. • [SLOW TEST:6.047 seconds] [sig-api-machinery] CustomResourceDefinition resources [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23 Simple CustomResourceDefinition /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/custom_resource_definition.go:48 creating/deleting custom resource definition objects works [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-api-machinery] CustomResourceDefinition resources [Privileged:ClusterAdmin] Simple CustomResourceDefinition creating/deleting custom resource definition objects works [Conformance]","total":-1,"completed":12,"skipped":104,"failed":3,"failures":["[k8s.io] Variable Expansion should verify that a failing subpath expansion can be modified during the lifecycle of a container [sig-storage][Slow] [Conformance]","[sig-apps] Deployment deployment should delete old replica sets [Conformance]","[k8s.io] Variable Expansion should succeed in writing subpaths in container [sig-storage][Slow] [Conformance]"]} SSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [k8s.io] Container Lifecycle Hook /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:41:28.682: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename container-lifecycle-hook STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] when create a pod with lifecycle hook /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/lifecycle_hook.go:64 STEP: create the container to handle the HTTPGet hook request. [It] should execute prestop http hook properly [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: create the pod with lifecycle hook STEP: delete the pod with lifecycle hook Aug 18 11:41:36.744: INFO: Waiting for pod pod-with-prestop-http-hook to disappear Aug 18 11:41:36.747: INFO: Pod pod-with-prestop-http-hook still exists Aug 18 11:41:38.747: INFO: Waiting for pod pod-with-prestop-http-hook to disappear Aug 18 11:41:38.750: INFO: Pod pod-with-prestop-http-hook still exists Aug 18 11:41:40.747: INFO: Waiting for pod pod-with-prestop-http-hook to disappear Aug 18 11:41:40.750: INFO: Pod pod-with-prestop-http-hook no longer exists STEP: check prestop hook [AfterEach] [k8s.io] Container Lifecycle Hook /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:41:40.757: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "container-lifecycle-hook-5186" for this suite. • [SLOW TEST:12.085 seconds] [k8s.io] Container Lifecycle Hook /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 when create a pod with lifecycle hook /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/lifecycle_hook.go:42 should execute prestop http hook properly [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [k8s.io] Container Lifecycle Hook when create a pod with lifecycle hook should execute prestop http hook properly [NodeConformance] [Conformance]","total":-1,"completed":5,"skipped":154,"failed":3,"failures":["[sig-apps] StatefulSet [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] Should recreate evicted statefulset [Conformance]","[sig-node] Downward API should provide pod UID as env vars [NodeConformance] [Conformance]","[sig-apps] ReplicationController should adopt matching pods on creation [Conformance]"]} SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-api-machinery] ResourceQuota /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:41:40.834: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename resourcequota STEP: Waiting for a default service account to be provisioned in namespace [It] should create a ResourceQuota and ensure its status is promptly calculated. [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Counting existing ResourceQuota STEP: Creating a ResourceQuota STEP: Ensuring resource quota status is calculated [AfterEach] [sig-api-machinery] ResourceQuota /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:41:47.865: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "resourcequota-4280" for this suite. • [SLOW TEST:7.043 seconds] [sig-api-machinery] ResourceQuota /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23 should create a ResourceQuota and ensure its status is promptly calculated. [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-api-machinery] ResourceQuota should create a ResourceQuota and ensure its status is promptly calculated. [Conformance]","total":-1,"completed":6,"skipped":185,"failed":3,"failures":["[sig-apps] StatefulSet [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] Should recreate evicted statefulset [Conformance]","[sig-node] Downward API should provide pod UID as env vars [NodeConformance] [Conformance]","[sig-apps] ReplicationController should adopt matching pods on creation [Conformance]"]} SSSSSSSS ------------------------------ [BeforeEach] [k8s.io] Probing container /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:40:07.128: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename container-probe STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [k8s.io] Probing container /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:54 [It] should have monotonically increasing restart count [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating pod liveness-9f86b189-30bb-4aa3-9a67-0f9f1469431f in namespace container-probe-8626 Aug 18 11:40:11.169: INFO: Started pod liveness-9f86b189-30bb-4aa3-9a67-0f9f1469431f in namespace container-probe-8626 STEP: checking the pod's current state and verifying that restartCount is present Aug 18 11:40:11.171: INFO: Initial restart count of pod liveness-9f86b189-30bb-4aa3-9a67-0f9f1469431f is 0 Aug 18 11:40:25.194: INFO: Restart count of pod container-probe-8626/liveness-9f86b189-30bb-4aa3-9a67-0f9f1469431f is now 1 (14.023194063s elapsed) Aug 18 11:40:43.232: INFO: Restart count of pod container-probe-8626/liveness-9f86b189-30bb-4aa3-9a67-0f9f1469431f is now 2 (32.060851397s elapsed) Aug 18 11:41:05.273: INFO: Restart count of pod container-probe-8626/liveness-9f86b189-30bb-4aa3-9a67-0f9f1469431f is now 3 (54.102411214s elapsed) Aug 18 11:41:23.307: INFO: Restart count of pod container-probe-8626/liveness-9f86b189-30bb-4aa3-9a67-0f9f1469431f is now 4 (1m12.136372342s elapsed) Aug 18 11:42:31.436: INFO: Restart count of pod container-probe-8626/liveness-9f86b189-30bb-4aa3-9a67-0f9f1469431f is now 5 (2m20.265079962s elapsed) STEP: deleting the pod [AfterEach] [k8s.io] Probing container /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:42:31.445: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "container-probe-8626" for this suite. • [SLOW TEST:144.325 seconds] [k8s.io] Probing container /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 should have monotonically increasing restart count [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [k8s.io] Probing container should have monotonically increasing restart count [NodeConformance] [Conformance]","total":-1,"completed":17,"skipped":197,"failed":2,"failures":["[sig-node] Downward API should provide host IP as an env var [NodeConformance] [Conformance]","[k8s.io] Kubelet when scheduling a busybox Pod with hostAliases should write entries to /etc/hosts [LinuxOnly] [NodeConformance] [Conformance]"]} SSSSSSSSSS ------------------------------ [BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:42:31.478: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename webhook STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:87 STEP: Setting up server cert STEP: Create role binding to let webhook read extension-apiserver-authentication STEP: Deploying the webhook pod STEP: Wait for the deployment to be ready Aug 18 11:42:31.730: INFO: deployment "sample-webhook-deployment" doesn't have the required revision set Aug 18 11:42:33.740: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764883751, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764883751, loc:(*time.Location)(0x77169a0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764883751, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764883751, loc:(*time.Location)(0x77169a0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-cbccbf6bb\" is progressing."}}, CollisionCount:(*int32)(nil)} STEP: Deploying the webhook service STEP: Verifying the service has paired with the endpoint Aug 18 11:42:36.756: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1 [It] listing mutating webhooks should work [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Listing all of the created validation webhooks STEP: Creating a configMap that should be mutated STEP: Deleting the collection of validation webhooks STEP: Creating a configMap that should not be mutated [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:42:36.868: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "webhook-6161" for this suite. STEP: Destroying namespace "webhook-6161-markers" for this suite. [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:102 • [SLOW TEST:5.422 seconds] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23 listing mutating webhooks should work [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] listing mutating webhooks should work [Conformance]","total":-1,"completed":18,"skipped":207,"failed":2,"failures":["[sig-node] Downward API should provide host IP as an env var [NodeConformance] [Conformance]","[k8s.io] Kubelet when scheduling a busybox Pod with hostAliases should write entries to /etc/hosts [LinuxOnly] [NodeConformance] [Conformance]"]} SSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-cli] Kubectl client /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:42:36.940: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename kubectl STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-cli] Kubectl client /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/kubectl.go:247 [It] should check if kubectl describe prints relevant information for rc and pods [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:42:36.960: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-2919 create -f -' Aug 18 11:42:37.292: INFO: stderr: "" Aug 18 11:42:37.292: INFO: stdout: "replicationcontroller/agnhost-primary created\n" Aug 18 11:42:37.292: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-2919 create -f -' Aug 18 11:42:37.570: INFO: stderr: "" Aug 18 11:42:37.570: INFO: stdout: "service/agnhost-primary created\n" STEP: Waiting for Agnhost primary to start. Aug 18 11:42:38.574: INFO: Selector matched 1 pods for map[app:agnhost] Aug 18 11:42:38.574: INFO: Found 0 / 1 Aug 18 11:42:39.573: INFO: Selector matched 1 pods for map[app:agnhost] Aug 18 11:42:39.573: INFO: Found 0 / 1 Aug 18 11:42:40.573: INFO: Selector matched 1 pods for map[app:agnhost] Aug 18 11:42:40.573: INFO: Found 1 / 1 Aug 18 11:42:40.573: INFO: WaitFor completed with timeout 5m0s. Pods found = 1 out of 1 Aug 18 11:42:40.575: INFO: Selector matched 1 pods for map[app:agnhost] Aug 18 11:42:40.575: INFO: ForEach: Found 1 pods from the filter. Now looping through them. Aug 18 11:42:40.575: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-2919 describe pod agnhost-primary-8wtnx' Aug 18 11:42:40.768: INFO: stderr: "" Aug 18 11:42:40.768: INFO: stdout: "Name: agnhost-primary-8wtnx\nNamespace: kubectl-2919\nPriority: 0\nNode: node1/10.10.190.207\nStart Time: Wed, 18 Aug 2021 11:42:37 +0000\nLabels: app=agnhost\n role=primary\nAnnotations: k8s.v1.cni.cncf.io/network-status:\n [{\n \"name\": \"default-cni-network\",\n \"interface\": \"eth0\",\n \"ips\": [\n \"10.244.4.55\"\n ],\n \"mac\": \"0e:0d:b5:4f:7b:7f\",\n \"default\": true,\n \"dns\": {}\n }]\n k8s.v1.cni.cncf.io/networks-status:\n [{\n \"name\": \"default-cni-network\",\n \"interface\": \"eth0\",\n \"ips\": [\n \"10.244.4.55\"\n ],\n \"mac\": \"0e:0d:b5:4f:7b:7f\",\n \"default\": true,\n \"dns\": {}\n }]\n kubernetes.io/psp: collectd\nStatus: Running\nIP: 10.244.4.55\nIPs:\n IP: 10.244.4.55\nControlled By: ReplicationController/agnhost-primary\nContainers:\n agnhost-primary:\n Container ID: docker://c90c84612fd0a82031513228f35618ec6a8cf06b9c2233c558ae04ef3d50bdda\n Image: k8s.gcr.io/e2e-test-images/agnhost:2.20\n Image ID: docker-pullable://k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0\n Port: 6379/TCP\n Host Port: 0/TCP\n State: Running\n Started: Wed, 18 Aug 2021 11:42:39 +0000\n Ready: True\n Restart Count: 0\n Environment: \n Mounts:\n /var/run/secrets/kubernetes.io/serviceaccount from default-token-nnkfh (ro)\nConditions:\n Type Status\n Initialized True \n Ready True \n ContainersReady True \n PodScheduled True \nVolumes:\n default-token-nnkfh:\n Type: Secret (a volume populated by a Secret)\n SecretName: default-token-nnkfh\n Optional: false\nQoS Class: BestEffort\nNode-Selectors: \nTolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s\n node.kubernetes.io/unreachable:NoExecute op=Exists for 300s\nEvents:\n Type Reason Age From Message\n ---- ------ ---- ---- -------\n Normal Scheduled 3s default-scheduler Successfully assigned kubectl-2919/agnhost-primary-8wtnx to node1\n Normal AddedInterface 2s multus Add eth0 [10.244.4.55/24]\n Normal Pulling 2s kubelet Pulling image \"k8s.gcr.io/e2e-test-images/agnhost:2.20\"\n Normal Pulled 1s kubelet Successfully pulled image \"k8s.gcr.io/e2e-test-images/agnhost:2.20\" in 475.200342ms\n Normal Created 1s kubelet Created container agnhost-primary\n Normal Started 1s kubelet Started container agnhost-primary\n" Aug 18 11:42:40.768: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-2919 describe rc agnhost-primary' Aug 18 11:42:40.950: INFO: stderr: "" Aug 18 11:42:40.950: INFO: stdout: "Name: agnhost-primary\nNamespace: kubectl-2919\nSelector: app=agnhost,role=primary\nLabels: app=agnhost\n role=primary\nAnnotations: \nReplicas: 1 current / 1 desired\nPods Status: 1 Running / 0 Waiting / 0 Succeeded / 0 Failed\nPod Template:\n Labels: app=agnhost\n role=primary\n Containers:\n agnhost-primary:\n Image: k8s.gcr.io/e2e-test-images/agnhost:2.20\n Port: 6379/TCP\n Host Port: 0/TCP\n Environment: \n Mounts: \n Volumes: \nEvents:\n Type Reason Age From Message\n ---- ------ ---- ---- -------\n Normal SuccessfulCreate 3s replication-controller Created pod: agnhost-primary-8wtnx\n" Aug 18 11:42:40.950: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-2919 describe service agnhost-primary' Aug 18 11:42:41.121: INFO: stderr: "" Aug 18 11:42:41.121: INFO: stdout: "Name: agnhost-primary\nNamespace: kubectl-2919\nLabels: app=agnhost\n role=primary\nAnnotations: \nSelector: app=agnhost,role=primary\nType: ClusterIP\nIP: 10.233.51.36\nPort: 6379/TCP\nTargetPort: agnhost-server/TCP\nEndpoints: 10.244.4.55:6379\nSession Affinity: None\nEvents: \n" Aug 18 11:42:41.126: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-2919 describe node master1' Aug 18 11:42:41.332: INFO: stderr: "" Aug 18 11:42:41.332: INFO: stdout: "Name: master1\nRoles: master\nLabels: beta.kubernetes.io/arch=amd64\n beta.kubernetes.io/os=linux\n kubernetes.io/arch=amd64\n kubernetes.io/hostname=master1\n kubernetes.io/os=linux\n node-role.kubernetes.io/master=\nAnnotations: flannel.alpha.coreos.com/backend-data: {\"VtepMAC\":\"3a:82:be:72:b5:15\"}\n flannel.alpha.coreos.com/backend-type: vxlan\n flannel.alpha.coreos.com/kube-subnet-manager: true\n flannel.alpha.coreos.com/public-ip: 10.10.190.202\n kubeadm.alpha.kubernetes.io/cri-socket: /var/run/dockershim.sock\n node.alpha.kubernetes.io/ttl: 0\n volumes.kubernetes.io/controller-managed-attach-detach: true\nCreationTimestamp: Wed, 18 Aug 2021 08:20:52 +0000\nTaints: node-role.kubernetes.io/master:NoSchedule\nUnschedulable: false\nLease:\n HolderIdentity: master1\n AcquireTime: \n RenewTime: Wed, 18 Aug 2021 11:42:35 +0000\nConditions:\n Type Status LastHeartbeatTime LastTransitionTime Reason Message\n ---- ------ ----------------- ------------------ ------ -------\n NetworkUnavailable False Wed, 18 Aug 2021 08:25:59 +0000 Wed, 18 Aug 2021 08:25:59 +0000 FlannelIsUp Flannel is running on this node\n MemoryPressure False Wed, 18 Aug 2021 11:42:35 +0000 Wed, 18 Aug 2021 08:20:52 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available\n DiskPressure False Wed, 18 Aug 2021 11:42:35 +0000 Wed, 18 Aug 2021 08:20:52 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure\n PIDPressure False Wed, 18 Aug 2021 11:42:35 +0000 Wed, 18 Aug 2021 08:20:52 +0000 KubeletHasSufficientPID kubelet has sufficient PID available\n Ready True Wed, 18 Aug 2021 11:42:35 +0000 Wed, 18 Aug 2021 08:25:08 +0000 KubeletReady kubelet is posting ready status\nAddresses:\n InternalIP: 10.10.190.202\n Hostname: master1\nCapacity:\n cpu: 80\n ephemeral-storage: 439913340Ki\n hugepages-1Gi: 0\n hugepages-2Mi: 0\n memory: 196518324Ki\n pods: 110\nAllocatable:\n cpu: 79550m\n ephemeral-storage: 405424133473\n hugepages-1Gi: 0\n hugepages-2Mi: 0\n memory: 195629492Ki\n pods: 110\nSystem Info:\n Machine ID: 58c3e57359b641ad92fa1959f2fecf5d\n System UUID: 00ACFB60-0631-E711-906E-0017A4403562\n Boot ID: 012cd796-2076-45d6-8b14-d3e0451b1e64\n Kernel Version: 3.10.0-1160.36.2.el7.x86_64\n OS Image: CentOS Linux 7 (Core)\n Operating System: linux\n Architecture: amd64\n Container Runtime Version: docker://19.3.14\n Kubelet Version: v1.19.8\n Kube-Proxy Version: v1.19.8\nPodCIDR: 10.244.0.0/24\nPodCIDRs: 10.244.0.0/24\nNon-terminated Pods: (9 in total)\n Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits AGE\n --------- ---- ------------ ---------- --------------- ------------- ---\n kube-system coredns-7677f9bb54-kn2qg 100m (0%) 0 (0%) 70Mi (0%) 170Mi (0%) 3h18m\n kube-system docker-registry-docker-registry-56cbc7bc58-49kl2 0 (0%) 0 (0%) 0 (0%) 0 (0%) 3h16m\n kube-system kube-apiserver-master1 250m (0%) 0 (0%) 0 (0%) 0 (0%) 3h13m\n kube-system kube-controller-manager-master1 200m (0%) 0 (0%) 0 (0%) 0 (0%) 3h20m\n kube-system kube-flannel-q64cq 150m (0%) 300m (0%) 64M (0%) 500M (0%) 3h19m\n kube-system kube-multus-ds-amd64-kbcp6 100m (0%) 100m (0%) 90Mi (0%) 90Mi (0%) 3h19m\n kube-system kube-proxy-vqk4v 0 (0%) 0 (0%) 0 (0%) 0 (0%) 3h19m\n kube-system kube-scheduler-master1 100m (0%) 0 (0%) 0 (0%) 0 (0%) 3h5m\n monitoring node-exporter-5hwz9 112m (0%) 270m (0%) 200Mi (0%) 220Mi (0%) 3h8m\nAllocated resources:\n (Total limits may be over 100 percent, i.e., overcommitted.)\n Resource Requests Limits\n -------- -------- ------\n cpu 1012m (1%) 670m (0%)\n memory 431140Ki (0%) 1003316480 (0%)\n ephemeral-storage 0 (0%) 0 (0%)\n hugepages-1Gi 0 (0%) 0 (0%)\n hugepages-2Mi 0 (0%) 0 (0%)\nEvents: \n" Aug 18 11:42:41.332: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-2919 describe namespace kubectl-2919' Aug 18 11:42:41.496: INFO: stderr: "" Aug 18 11:42:41.496: INFO: stdout: "Name: kubectl-2919\nLabels: e2e-framework=kubectl\n e2e-run=95270261-1918-45ca-9aac-1cc5cbb87fe5\nAnnotations: \nStatus: Active\n\nNo resource quota.\n\nNo LimitRange resource.\n" [AfterEach] [sig-cli] Kubectl client /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:42:41.496: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "kubectl-2919" for this suite. • ------------------------------ {"msg":"PASSED [sig-cli] Kubectl client Kubectl describe should check if kubectl describe prints relevant information for rc and pods [Conformance]","total":-1,"completed":19,"skipped":223,"failed":2,"failures":["[sig-node] Downward API should provide host IP as an env var [NodeConformance] [Conformance]","[k8s.io] Kubelet when scheduling a busybox Pod with hostAliases should write entries to /etc/hosts [LinuxOnly] [NodeConformance] [Conformance]"]} SSS ------------------------------ [BeforeEach] [k8s.io] InitContainer [NodeConformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:37:42.611: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename init-container STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [k8s.io] InitContainer [NodeConformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/init_container.go:162 [It] should not start app containers if init containers fail on a RestartAlways pod [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: creating the pod Aug 18 11:37:42.632: INFO: PodSpec: initContainers in spec.initContainers Aug 18 11:42:42.652: FAIL: Expected <*errors.errorString | 0xc000340200>: { s: "timed out waiting for the condition", } to be nil Full Stack Trace k8s.io/kubernetes/test/e2e/common.glob..func11.4() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/init_container.go:432 +0xcaf k8s.io/kubernetes/test/e2e.RunE2ETests(0xc002593080) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc002593080) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc002593080, 0x4deb2c0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] InitContainer [NodeConformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "init-container-5553". STEP: Found 7 events. Aug 18 11:42:42.656: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for pod-init-c9a6ec62-328a-48d0-ad87-8e4a921066e8: { } Scheduled: Successfully assigned init-container-5553/pod-init-c9a6ec62-328a-48d0-ad87-8e4a921066e8 to node2 Aug 18 11:42:42.656: INFO: At 2021-08-18 11:37:45 +0000 UTC - event for pod-init-c9a6ec62-328a-48d0-ad87-8e4a921066e8: {multus } AddedInterface: Add eth0 [10.244.3.31/24] Aug 18 11:42:42.656: INFO: At 2021-08-18 11:37:45 +0000 UTC - event for pod-init-c9a6ec62-328a-48d0-ad87-8e4a921066e8: {kubelet node2} Pulling: Pulling image "docker.io/library/busybox:1.29" Aug 18 11:42:42.656: INFO: At 2021-08-18 11:37:46 +0000 UTC - event for pod-init-c9a6ec62-328a-48d0-ad87-8e4a921066e8: {kubelet node2} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit Aug 18 11:42:42.656: INFO: At 2021-08-18 11:37:46 +0000 UTC - event for pod-init-c9a6ec62-328a-48d0-ad87-8e4a921066e8: {kubelet node2} Failed: Error: ErrImagePull Aug 18 11:42:42.656: INFO: At 2021-08-18 11:37:47 +0000 UTC - event for pod-init-c9a6ec62-328a-48d0-ad87-8e4a921066e8: {kubelet node2} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" Aug 18 11:42:42.656: INFO: At 2021-08-18 11:37:47 +0000 UTC - event for pod-init-c9a6ec62-328a-48d0-ad87-8e4a921066e8: {kubelet node2} Failed: Error: ImagePullBackOff Aug 18 11:42:42.658: INFO: POD NODE PHASE GRACE CONDITIONS Aug 18 11:42:42.658: INFO: pod-init-c9a6ec62-328a-48d0-ad87-8e4a921066e8 node2 Pending [{Initialized False 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:37:42 +0000 UTC ContainersNotInitialized containers with incomplete status: [init1 init2]} {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:37:42 +0000 UTC ContainersNotReady containers with unready status: [run1]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:37:42 +0000 UTC ContainersNotReady containers with unready status: [run1]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:37:42 +0000 UTC }] Aug 18 11:42:42.658: INFO: Aug 18 11:42:42.662: INFO: Logging node info for node master1 Aug 18 11:42:42.665: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 ebb211fa-503f-4cfe-b1ed-c95d27a70e6e 67509 0 2021-08-18 08:20:52 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"3a:82:be:72:b5:15"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:20:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:20:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:25:59 +0000 UTC,LastTransitionTime:2021-08-18 08:25:59 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:42:35 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:42:35 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:42:35 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:42:35 +0000 UTC,LastTransitionTime:2021-08-18 08:25:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:58c3e57359b641ad92fa1959f2fecf5d,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:012cd796-2076-45d6-8b14-d3e0451b1e64,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[@ :],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:42:42.665: INFO: Logging kubelet events for node master1 Aug 18 11:42:42.668: INFO: Logging pods the kubelet thinks is on node master1 Aug 18 11:42:42.676: INFO: kube-controller-manager-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:42.676: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:42:42.676: INFO: kube-multus-ds-amd64-kbcp6 started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:42.676: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:42:42.676: INFO: docker-registry-docker-registry-56cbc7bc58-49kl2 started at 2021-08-18 08:26:23 +0000 UTC (0+2 container statuses recorded) Aug 18 11:42:42.676: INFO: Container docker-registry ready: true, restart count 0 Aug 18 11:42:42.676: INFO: Container nginx ready: true, restart count 0 Aug 18 11:42:42.676: INFO: node-exporter-5hwz9 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:42:42.676: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:42:42.676: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:42:42.676: INFO: kube-apiserver-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:42.676: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:42:42.676: INFO: kube-proxy-vqk4v started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:42.676: INFO: Container kube-proxy ready: true, restart count 1 Aug 18 11:42:42.676: INFO: kube-flannel-q64cq started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:42:42.676: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:42:42.676: INFO: Container kube-flannel ready: true, restart count 3 Aug 18 11:42:42.676: INFO: coredns-7677f9bb54-kn2qg started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:42.676: INFO: Container coredns ready: true, restart count 2 Aug 18 11:42:42.676: INFO: kube-scheduler-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:42.676: INFO: Container kube-scheduler ready: true, restart count 0 W0818 11:42:42.687974 36 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:42:42.717: INFO: Latency metrics for node master1 Aug 18 11:42:42.717: INFO: Logging node info for node master2 Aug 18 11:42:42.719: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 78946293-3abe-4442-84d4-8ed6b1d15ce0 67495 0 2021-08-18 08:21:31 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"7e:f5:c2:cc:3a:b4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:21:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:21:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-08-18 08:29:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:42:34 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:42:34 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:42:34 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:42:34 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0c44122c7a7248c18d8571e1cc667258,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:0cd329f2-48e0-4c8f-b8b9-fa3ae0ed8406,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:42:42.720: INFO: Logging kubelet events for node master2 Aug 18 11:42:42.722: INFO: Logging pods the kubelet thinks is on node master2 Aug 18 11:42:42.730: INFO: kube-controller-manager-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:42.730: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:42:42.730: INFO: kube-proxy-kh2l9 started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:42.730: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:42:42.730: INFO: kube-flannel-pp56h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:42:42.730: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:42:42.730: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:42:42.730: INFO: kube-apiserver-master2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:42.730: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:42:42.730: INFO: kube-scheduler-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:42.730: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:42:42.730: INFO: kube-multus-ds-amd64-mld8g started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:42.730: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:42:42.730: INFO: dns-autoscaler-5b7b5c9b6f-hh47r started at 2021-08-18 08:23:57 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:42.730: INFO: Container autoscaler ready: true, restart count 2 Aug 18 11:42:42.730: INFO: node-feature-discovery-controller-5bf5c49849-mq57c started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:42.730: INFO: Container nfd-controller ready: true, restart count 0 Aug 18 11:42:42.730: INFO: node-exporter-48nfx started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:42:42.730: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:42:42.730: INFO: Container node-exporter ready: true, restart count 0 W0818 11:42:42.742685 36 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:42:42.771: INFO: Latency metrics for node master2 Aug 18 11:42:42.771: INFO: Logging node info for node master3 Aug 18 11:42:42.774: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 44feac2b-9447-4be2-9fcd-62f836d67c72 67597 0 2021-08-18 08:21:41 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"86:e4:31:99:58:40"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {kubelet Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:42:39 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:42:39 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:42:39 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:42:39 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1fae19ae59884c44899bcd08aa243244,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:5db926c5-6530-4635-a0d5-806974a3b732,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:42:42.774: INFO: Logging kubelet events for node master3 Aug 18 11:42:42.777: INFO: Logging pods the kubelet thinks is on node master3 Aug 18 11:42:42.785: INFO: coredns-7677f9bb54-5hxfh started at 2021-08-18 08:23:54 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:42.785: INFO: Container coredns ready: true, restart count 1 Aug 18 11:42:42.785: INFO: node-exporter-vq7d8 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:42:42.785: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:42:42.785: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:42:42.785: INFO: kube-controller-manager-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:42.785: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:42:42.785: INFO: kube-scheduler-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:42.785: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:42:42.785: INFO: kube-apiserver-master3 started at 2021-08-18 08:29:12 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:42.785: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:42:42.785: INFO: kube-proxy-sd5lc started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:42.785: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:42:42.785: INFO: kube-flannel-x6tlr started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:42:42.785: INFO: Init container install-cni ready: true, restart count 1 Aug 18 11:42:42.785: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:42:42.785: INFO: kube-multus-ds-amd64-bkw6c started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:42.785: INFO: Container kube-multus ready: true, restart count 1 W0818 11:42:42.795976 36 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:42:42.822: INFO: Latency metrics for node master3 Aug 18 11:42:42.822: INFO: Logging node info for node node1 Aug 18 11:42:42.825: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 84defabd-6ebf-43ec-a629-44c6713da9c9 67583 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"9a:87:55:36:7b:df"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:13 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:35 +0000 UTC,LastTransitionTime:2021-08-18 08:26:35 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:42:37 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:42:37 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:42:37 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:42:37 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:69946ff2b7bc462fa25eb7adb4703c23,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:736dc52f-f5e3-494e-86ca-01eedbea015c,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:a7cea43d9d2f67c38fbf0407786edbe660ee9072945f7bb272b55fd255e8eaca opnfv/barometer-collectd:stable],SizeBytes:1075746799,},ContainerImage{Names:[@ :],SizeBytes:1003788820,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[aquasec/kube-hunter@sha256:2be6820bc1d7e0f57193a9a27d5a3e16b2fd93c53747b03ce8ca48c6fc323781 aquasec/kube-hunter:0.3.1],SizeBytes:347611549,},ContainerImage{Names:[golang@sha256:db2475a1dbb2149508e5db31d7d77a75e6600d54be645f37681f03f2762169ba golang:alpine3.12],SizeBytes:301186719,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:de25c7fc6c4f3a27c7f0c2dff454e4671823a34d88abd533f210848d527e0fbb alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:42:42.825: INFO: Logging kubelet events for node node1 Aug 18 11:42:42.828: INFO: Logging pods the kubelet thinks is on node node1 Aug 18 11:42:42.842: INFO: kube-flannel-q78nd started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:42:42.842: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:42:42.842: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:42:42.842: INFO: prometheus-k8s-0 started at 2021-08-18 08:34:03 +0000 UTC (0+5 container statuses recorded) Aug 18 11:42:42.842: INFO: Container custom-metrics-apiserver ready: true, restart count 0 Aug 18 11:42:42.842: INFO: Container grafana ready: true, restart count 0 Aug 18 11:42:42.842: INFO: Container prometheus ready: true, restart count 1 Aug 18 11:42:42.842: INFO: Container prometheus-config-reloader ready: true, restart count 0 Aug 18 11:42:42.842: INFO: Container rules-configmap-reloader ready: true, restart count 0 Aug 18 11:42:42.842: INFO: kube-multus-ds-amd64-rrvmb started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:42.842: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:42:42.842: INFO: node-feature-discovery-worker-pflgw started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:42.843: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:42:42.843: INFO: node-exporter-kcwvn started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:42:42.843: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:42:42.843: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:42:42.843: INFO: ss2-0 started at 2021-08-18 11:32:47 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:42.843: INFO: Container webserver ready: false, restart count 0 Aug 18 11:42:42.843: INFO: pod-adoption-release started at 2021-08-18 11:41:47 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:42.843: INFO: Container pod-adoption-release ready: false, restart count 0 Aug 18 11:42:42.843: INFO: kube-proxy-p6jvp started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:42.843: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:42:42.843: INFO: kubernetes-metrics-scraper-678c97765c-9nsv5 started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:42.843: INFO: Container kubernetes-metrics-scraper ready: true, restart count 2 Aug 18 11:42:42.843: INFO: cmk-init-discover-node1-bxznx started at 2021-08-18 08:32:10 +0000 UTC (0+3 container statuses recorded) Aug 18 11:42:42.843: INFO: Container discover ready: false, restart count 0 Aug 18 11:42:42.843: INFO: Container init ready: false, restart count 0 Aug 18 11:42:42.843: INFO: Container install ready: false, restart count 0 Aug 18 11:42:42.843: INFO: cmk-d8r27 started at 2021-08-18 08:32:52 +0000 UTC (0+2 container statuses recorded) Aug 18 11:42:42.843: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:42:42.843: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:42:42.843: INFO: collectd-xdprr started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:42:42.843: INFO: Container collectd ready: true, restart count 0 Aug 18 11:42:42.843: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:42:42.843: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:42:42.843: INFO: busybox-ca1d4157-6037-47c1-a37c-160e2dd5121c started at 2021-08-18 11:37:58 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:42.843: INFO: Container busybox ready: false, restart count 0 Aug 18 11:42:42.843: INFO: busybox-scheduling-f75e615f-f2c3-4e61-8ed7-848c386f63d3 started at 2021-08-18 11:40:13 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:42.843: INFO: Container busybox-scheduling-f75e615f-f2c3-4e61-8ed7-848c386f63d3 ready: false, restart count 0 Aug 18 11:42:42.843: INFO: nginx-proxy-node1 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:42.843: INFO: Container nginx-proxy ready: true, restart count 2 Aug 18 11:42:42.843: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-vsxvg started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:42.843: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:42:42.843: INFO: fail-once-local-8rxnh started at 2021-08-18 11:34:14 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:42.843: INFO: Container c ready: false, restart count 0 Aug 18 11:42:42.843: INFO: busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665 started at 2021-08-18 11:41:33 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:42.843: INFO: Container busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665 ready: false, restart count 0 Aug 18 11:42:42.843: INFO: agnhost-primary-8wtnx started at 2021-08-18 11:42:37 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:42.843: INFO: Container agnhost-primary ready: true, restart count 0 W0818 11:42:42.855826 36 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:42:42.895: INFO: Latency metrics for node node1 Aug 18 11:42:42.895: INFO: Logging node info for node node2 Aug 18 11:42:42.897: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 1d01177e-3dbb-48a1-a0bc-d18af27ab7f8 67523 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:d1:47:f8:1d:22"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:36 +0000 UTC,LastTransitionTime:2021-08-18 08:26:36 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:42:36 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:42:36 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:42:36 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:42:36 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:dc1f286135c145349b8a016880b65a2f,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:037e7e2d-94e9-42f4-a719-896e5005ac70,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:42:42.897: INFO: Logging kubelet events for node node2 Aug 18 11:42:42.899: INFO: Logging pods the kubelet thinks is on node node2 Aug 18 11:42:42.915: INFO: kube-flannel-h7t5h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:42:42.915: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:42:42.915: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:42:42.915: INFO: node-exporter-lrrf2 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:42:42.915: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:42:42.915: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:42:42.915: INFO: var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e started at 2021-08-18 11:39:31 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:42.915: INFO: Container dapi-container ready: false, restart count 0 Aug 18 11:42:42.915: INFO: fail-once-local-pk5cs started at 2021-08-18 11:34:14 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:42.915: INFO: Container c ready: false, restart count 0 Aug 18 11:42:42.915: INFO: nginx-proxy-node2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:42.915: INFO: Container nginx-proxy ready: true, restart count 1 Aug 18 11:42:42.915: INFO: cmk-init-discover-node2-6b2kz started at 2021-08-18 08:32:30 +0000 UTC (0+3 container statuses recorded) Aug 18 11:42:42.915: INFO: Container discover ready: false, restart count 0 Aug 18 11:42:42.915: INFO: Container init ready: false, restart count 0 Aug 18 11:42:42.915: INFO: Container install ready: false, restart count 0 Aug 18 11:42:42.915: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-7rn45 started at 2021-08-18 08:36:42 +0000 UTC (0+2 container statuses recorded) Aug 18 11:42:42.915: INFO: Container tas-controller ready: true, restart count 0 Aug 18 11:42:42.915: INFO: Container tas-extender ready: true, restart count 0 Aug 18 11:42:42.915: INFO: downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1 started at 2021-08-18 11:39:54 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:42.915: INFO: Container dapi-container ready: false, restart count 0 Aug 18 11:42:42.915: INFO: kubernetes-dashboard-86c6f9df5b-qrtdk started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:42.915: INFO: Container kubernetes-dashboard ready: true, restart count 2 Aug 18 11:42:42.915: INFO: cmk-748rz started at 2021-08-18 08:32:53 +0000 UTC (0+2 container statuses recorded) Aug 18 11:42:42.915: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:42:42.915: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:42:42.915: INFO: kube-proxy-qkj9c started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:42.915: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:42:42.915: INFO: node-feature-discovery-worker-hzpf5 started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:42.915: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:42:42.915: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-c82pt started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:42.915: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:42:42.915: INFO: prometheus-operator-5bb8cb9d8f-k97ws started at 2021-08-18 08:33:38 +0000 UTC (0+2 container statuses recorded) Aug 18 11:42:42.915: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:42:42.915: INFO: Container prometheus-operator ready: true, restart count 0 Aug 18 11:42:42.915: INFO: kube-multus-ds-amd64-rvzsg started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:42.915: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:42:42.915: INFO: collectd-67ntq started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:42:42.915: INFO: Container collectd ready: true, restart count 0 Aug 18 11:42:42.915: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:42:42.915: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:42:42.915: INFO: sample-webhook-deployment-cbccbf6bb-2zmzr started at 2021-08-18 11:42:42 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:42.915: INFO: Container sample-webhook ready: false, restart count 0 Aug 18 11:42:42.915: INFO: cmk-webhook-6c9d5f8578-7cxjr started at 2021-08-18 08:32:53 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:42.915: INFO: Container cmk-webhook ready: true, restart count 0 Aug 18 11:42:42.915: INFO: pod-init-c9a6ec62-328a-48d0-ad87-8e4a921066e8 started at 2021-08-18 11:37:42 +0000 UTC (2+1 container statuses recorded) Aug 18 11:42:42.915: INFO: Init container init1 ready: false, restart count 0 Aug 18 11:42:42.915: INFO: Init container init2 ready: false, restart count 0 Aug 18 11:42:42.915: INFO: Container run1 ready: false, restart count 0 W0818 11:42:42.927958 36 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:42:43.004: INFO: Latency metrics for node node2 Aug 18 11:42:43.004: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "init-container-5553" for this suite. • Failure [300.400 seconds] [k8s.io] InitContainer [NodeConformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 should not start app containers if init containers fail on a RestartAlways pod [Conformance] [It] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:42:42.652: Expected <*errors.errorString | 0xc000340200>: { s: "timed out waiting for the condition", } to be nil /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/init_container.go:432 ------------------------------ {"msg":"FAILED [k8s.io] InitContainer [NodeConformance] should not start app containers if init containers fail on a RestartAlways pod [Conformance]","total":-1,"completed":20,"skipped":503,"failed":3,"failures":["[sig-network] Services should be able to create a functioning NodePort service [Conformance]","[k8s.io] Pods should support retrieving logs from the container over websockets [NodeConformance] [Conformance]","[k8s.io] InitContainer [NodeConformance] should not start app containers if init containers fail on a RestartAlways pod [Conformance]"]} SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:42:41.518: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename webhook STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:87 STEP: Setting up server cert STEP: Create role binding to let webhook read extension-apiserver-authentication STEP: Deploying the webhook pod STEP: Wait for the deployment to be ready Aug 18 11:42:42.054: INFO: deployment "sample-webhook-deployment" doesn't have the required revision set Aug 18 11:42:44.065: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764883762, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764883762, loc:(*time.Location)(0x77169a0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764883762, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764883762, loc:(*time.Location)(0x77169a0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-cbccbf6bb\" is progressing."}}, CollisionCount:(*int32)(nil)} STEP: Deploying the webhook service STEP: Verifying the service has paired with the endpoint Aug 18 11:42:47.076: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1 [It] patching/updating a mutating webhook should work [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating a mutating webhook configuration STEP: Updating a mutating webhook configuration's rules to not include the create operation STEP: Creating a configMap that should not be mutated STEP: Patching a mutating webhook configuration's rules to include the create operation STEP: Creating a configMap that should be mutated [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:42:47.121: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "webhook-8452" for this suite. STEP: Destroying namespace "webhook-8452-markers" for this suite. [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:102 • [SLOW TEST:5.636 seconds] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23 patching/updating a mutating webhook should work [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] patching/updating a mutating webhook should work [Conformance]","total":-1,"completed":20,"skipped":226,"failed":2,"failures":["[sig-node] Downward API should provide host IP as an env var [NodeConformance] [Conformance]","[k8s.io] Kubelet when scheduling a busybox Pod with hostAliases should write entries to /etc/hosts [LinuxOnly] [NodeConformance] [Conformance]"]} SSSSSSSSSS ------------------------------ [BeforeEach] [sig-storage] ConfigMap /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:42:43.106: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename configmap STEP: Waiting for a default service account to be provisioned in namespace [It] should be consumable from pods in volume with mappings [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating configMap with name configmap-test-volume-map-d6936b5c-6fe1-4043-9831-b628edee9017 STEP: Creating a pod to test consume configMaps Aug 18 11:42:43.142: INFO: Waiting up to 5m0s for pod "pod-configmaps-dfb117f0-4b9d-4011-920c-7539ee46027d" in namespace "configmap-2357" to be "Succeeded or Failed" Aug 18 11:42:43.150: INFO: Pod "pod-configmaps-dfb117f0-4b9d-4011-920c-7539ee46027d": Phase="Pending", Reason="", readiness=false. Elapsed: 7.766073ms Aug 18 11:42:45.154: INFO: Pod "pod-configmaps-dfb117f0-4b9d-4011-920c-7539ee46027d": Phase="Pending", Reason="", readiness=false. Elapsed: 2.012019222s Aug 18 11:42:47.157: INFO: Pod "pod-configmaps-dfb117f0-4b9d-4011-920c-7539ee46027d": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.014979422s STEP: Saw pod success Aug 18 11:42:47.157: INFO: Pod "pod-configmaps-dfb117f0-4b9d-4011-920c-7539ee46027d" satisfied condition "Succeeded or Failed" Aug 18 11:42:47.159: INFO: Trying to get logs from node node2 pod pod-configmaps-dfb117f0-4b9d-4011-920c-7539ee46027d container configmap-volume-test: STEP: delete the pod Aug 18 11:42:47.172: INFO: Waiting for pod pod-configmaps-dfb117f0-4b9d-4011-920c-7539ee46027d to disappear Aug 18 11:42:47.174: INFO: Pod pod-configmaps-dfb117f0-4b9d-4011-920c-7539ee46027d no longer exists [AfterEach] [sig-storage] ConfigMap /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:42:47.174: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "configmap-2357" for this suite. •S ------------------------------ {"msg":"PASSED [sig-storage] ConfigMap should be consumable from pods in volume with mappings [NodeConformance] [Conformance]","total":-1,"completed":21,"skipped":540,"failed":3,"failures":["[sig-network] Services should be able to create a functioning NodePort service [Conformance]","[k8s.io] Pods should support retrieving logs from the container over websockets [NodeConformance] [Conformance]","[k8s.io] InitContainer [NodeConformance] should not start app containers if init containers fail on a RestartAlways pod [Conformance]"]} SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-storage] Downward API volume /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:42:47.264: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename downward-api STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-storage] Downward API volume /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/downwardapi_volume.go:42 [It] should set mode on item file [LinuxOnly] [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating a pod to test downward API volume plugin Aug 18 11:42:47.299: INFO: Waiting up to 5m0s for pod "downwardapi-volume-fa245750-6563-4e5c-9946-a19512250300" in namespace "downward-api-5221" to be "Succeeded or Failed" Aug 18 11:42:47.302: INFO: Pod "downwardapi-volume-fa245750-6563-4e5c-9946-a19512250300": Phase="Pending", Reason="", readiness=false. Elapsed: 3.756821ms Aug 18 11:42:49.306: INFO: Pod "downwardapi-volume-fa245750-6563-4e5c-9946-a19512250300": Phase="Pending", Reason="", readiness=false. Elapsed: 2.007154218s Aug 18 11:42:51.313: INFO: Pod "downwardapi-volume-fa245750-6563-4e5c-9946-a19512250300": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.01462863s STEP: Saw pod success Aug 18 11:42:51.313: INFO: Pod "downwardapi-volume-fa245750-6563-4e5c-9946-a19512250300" satisfied condition "Succeeded or Failed" Aug 18 11:42:51.316: INFO: Trying to get logs from node node2 pod downwardapi-volume-fa245750-6563-4e5c-9946-a19512250300 container client-container: STEP: delete the pod Aug 18 11:42:51.332: INFO: Waiting for pod downwardapi-volume-fa245750-6563-4e5c-9946-a19512250300 to disappear Aug 18 11:42:51.334: INFO: Pod downwardapi-volume-fa245750-6563-4e5c-9946-a19512250300 no longer exists [AfterEach] [sig-storage] Downward API volume /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:42:51.334: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "downward-api-5221" for this suite. • ------------------------------ {"msg":"PASSED [sig-storage] Downward API volume should set mode on item file [LinuxOnly] [NodeConformance] [Conformance]","total":-1,"completed":22,"skipped":576,"failed":3,"failures":["[sig-network] Services should be able to create a functioning NodePort service [Conformance]","[k8s.io] Pods should support retrieving logs from the container over websockets [NodeConformance] [Conformance]","[k8s.io] InitContainer [NodeConformance] should not start app containers if init containers fail on a RestartAlways pod [Conformance]"]} SSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-storage] Projected configMap /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:42:47.359: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename projected STEP: Waiting for a default service account to be provisioned in namespace [It] should be consumable from pods in volume with defaultMode set [LinuxOnly] [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating configMap with name projected-configmap-test-volume-5acaf2ab-f0d9-4b02-9afe-96f270bda315 STEP: Creating a pod to test consume configMaps Aug 18 11:42:47.399: INFO: Waiting up to 5m0s for pod "pod-projected-configmaps-127d6d16-8949-4166-b62c-d2074f6a3621" in namespace "projected-9042" to be "Succeeded or Failed" Aug 18 11:42:47.401: INFO: Pod "pod-projected-configmaps-127d6d16-8949-4166-b62c-d2074f6a3621": Phase="Pending", Reason="", readiness=false. Elapsed: 1.965891ms Aug 18 11:42:49.403: INFO: Pod "pod-projected-configmaps-127d6d16-8949-4166-b62c-d2074f6a3621": Phase="Pending", Reason="", readiness=false. Elapsed: 2.004465584s Aug 18 11:42:51.406: INFO: Pod "pod-projected-configmaps-127d6d16-8949-4166-b62c-d2074f6a3621": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.006660643s STEP: Saw pod success Aug 18 11:42:51.406: INFO: Pod "pod-projected-configmaps-127d6d16-8949-4166-b62c-d2074f6a3621" satisfied condition "Succeeded or Failed" Aug 18 11:42:51.408: INFO: Trying to get logs from node node1 pod pod-projected-configmaps-127d6d16-8949-4166-b62c-d2074f6a3621 container projected-configmap-volume-test: STEP: delete the pod Aug 18 11:42:51.419: INFO: Waiting for pod pod-projected-configmaps-127d6d16-8949-4166-b62c-d2074f6a3621 to disappear Aug 18 11:42:51.421: INFO: Pod pod-projected-configmaps-127d6d16-8949-4166-b62c-d2074f6a3621 no longer exists [AfterEach] [sig-storage] Projected configMap /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:42:51.421: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "projected-9042" for this suite. • ------------------------------ {"msg":"PASSED [sig-storage] Projected configMap should be consumable from pods in volume with defaultMode set [LinuxOnly] [NodeConformance] [Conformance]","total":-1,"completed":21,"skipped":316,"failed":2,"failures":["[sig-node] Downward API should provide host IP as an env var [NodeConformance] [Conformance]","[k8s.io] Kubelet when scheduling a busybox Pod with hostAliases should write entries to /etc/hosts [LinuxOnly] [NodeConformance] [Conformance]"]} SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-apps] StatefulSet /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:32:47.638: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename statefulset STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-apps] StatefulSet /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/statefulset.go:88 [BeforeEach] [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/statefulset.go:103 STEP: Creating service test in namespace statefulset-256 [It] should perform canary updates and phased rolling updates of template modifications [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating a new StatefulSet Aug 18 11:32:47.667: INFO: Found 0 stateful pods, waiting for 3 Aug 18 11:32:57.671: INFO: Found 1 stateful pods, waiting for 3 Aug 18 11:33:07.670: INFO: Found 1 stateful pods, waiting for 3 Aug 18 11:33:17.670: INFO: Found 1 stateful pods, waiting for 3 Aug 18 11:33:27.672: INFO: Found 1 stateful pods, waiting for 3 Aug 18 11:33:37.671: INFO: Found 1 stateful pods, waiting for 3 Aug 18 11:33:47.671: INFO: Found 1 stateful pods, waiting for 3 Aug 18 11:33:57.672: INFO: Found 1 stateful pods, waiting for 3 Aug 18 11:34:07.671: INFO: Found 1 stateful pods, waiting for 3 Aug 18 11:34:17.671: INFO: Found 1 stateful pods, waiting for 3 Aug 18 11:34:27.670: INFO: Found 1 stateful pods, waiting for 3 Aug 18 11:34:37.671: INFO: Found 1 stateful pods, waiting for 3 Aug 18 11:34:47.671: INFO: Found 1 stateful pods, waiting for 3 Aug 18 11:34:57.671: INFO: Found 1 stateful pods, waiting for 3 Aug 18 11:35:07.671: INFO: Found 1 stateful pods, waiting for 3 Aug 18 11:35:17.671: INFO: Found 1 stateful pods, waiting for 3 Aug 18 11:35:27.671: INFO: Found 1 stateful pods, waiting for 3 Aug 18 11:35:37.671: INFO: Found 1 stateful pods, waiting for 3 Aug 18 11:35:47.671: INFO: Found 1 stateful pods, waiting for 3 Aug 18 11:35:57.671: INFO: Found 1 stateful pods, waiting for 3 Aug 18 11:36:07.671: INFO: Found 1 stateful pods, waiting for 3 Aug 18 11:36:17.672: INFO: Found 1 stateful pods, waiting for 3 Aug 18 11:36:27.672: INFO: Found 1 stateful pods, waiting for 3 Aug 18 11:36:37.672: INFO: Found 1 stateful pods, waiting for 3 Aug 18 11:36:47.671: INFO: Found 1 stateful pods, waiting for 3 Aug 18 11:36:57.671: INFO: Found 1 stateful pods, waiting for 3 Aug 18 11:37:07.671: INFO: Found 1 stateful pods, waiting for 3 Aug 18 11:37:17.671: INFO: Found 1 stateful pods, waiting for 3 Aug 18 11:37:27.671: INFO: Found 1 stateful pods, waiting for 3 Aug 18 11:37:37.671: INFO: Found 1 stateful pods, waiting for 3 Aug 18 11:37:47.671: INFO: Found 1 stateful pods, waiting for 3 Aug 18 11:37:57.671: INFO: Found 1 stateful pods, waiting for 3 Aug 18 11:38:07.671: INFO: Found 1 stateful pods, waiting for 3 Aug 18 11:38:17.671: INFO: Found 1 stateful pods, waiting for 3 Aug 18 11:38:27.671: INFO: Found 1 stateful pods, waiting for 3 Aug 18 11:38:37.671: INFO: Found 1 stateful pods, waiting for 3 Aug 18 11:38:47.671: INFO: Found 1 stateful pods, waiting for 3 Aug 18 11:38:57.672: INFO: Found 1 stateful pods, waiting for 3 Aug 18 11:39:07.671: INFO: Found 1 stateful pods, waiting for 3 Aug 18 11:39:17.671: INFO: Found 1 stateful pods, waiting for 3 Aug 18 11:39:27.671: INFO: Found 1 stateful pods, waiting for 3 Aug 18 11:39:37.672: INFO: Found 1 stateful pods, waiting for 3 Aug 18 11:39:47.671: INFO: Found 1 stateful pods, waiting for 3 Aug 18 11:39:57.671: INFO: Found 1 stateful pods, waiting for 3 Aug 18 11:40:07.671: INFO: Found 1 stateful pods, waiting for 3 Aug 18 11:40:17.671: INFO: Found 1 stateful pods, waiting for 3 Aug 18 11:40:27.671: INFO: Found 1 stateful pods, waiting for 3 Aug 18 11:40:37.671: INFO: Found 1 stateful pods, waiting for 3 Aug 18 11:40:47.671: INFO: Found 1 stateful pods, waiting for 3 Aug 18 11:40:57.671: INFO: Found 1 stateful pods, waiting for 3 Aug 18 11:41:07.672: INFO: Found 1 stateful pods, waiting for 3 Aug 18 11:41:17.671: INFO: Found 1 stateful pods, waiting for 3 Aug 18 11:41:27.670: INFO: Found 1 stateful pods, waiting for 3 Aug 18 11:41:37.671: INFO: Found 1 stateful pods, waiting for 3 Aug 18 11:41:47.671: INFO: Found 1 stateful pods, waiting for 3 Aug 18 11:41:57.670: INFO: Found 1 stateful pods, waiting for 3 Aug 18 11:42:07.672: INFO: Found 1 stateful pods, waiting for 3 Aug 18 11:42:17.671: INFO: Found 1 stateful pods, waiting for 3 Aug 18 11:42:27.671: INFO: Found 1 stateful pods, waiting for 3 Aug 18 11:42:37.671: INFO: Found 1 stateful pods, waiting for 3 Aug 18 11:42:47.670: INFO: Found 1 stateful pods, waiting for 3 Aug 18 11:42:47.673: INFO: Found 1 stateful pods, waiting for 3 Aug 18 11:42:47.673: FAIL: Failed waiting for pods to enter running: timed out waiting for the condition Full Stack Trace k8s.io/kubernetes/test/e2e/framework/statefulset.WaitForRunning(0x5410260, 0xc00165cdc0, 0x300000003, 0xc0015f5900) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/statefulset/wait.go:58 +0x10e k8s.io/kubernetes/test/e2e/framework/statefulset.WaitForRunningAndReady(...) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/statefulset/wait.go:80 k8s.io/kubernetes/test/e2e/apps.glob..func10.2.8() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/statefulset.go:323 +0x2b8 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc003198780) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc003198780) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc003198780, 0x4deb2c0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/statefulset.go:114 Aug 18 11:42:47.678: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=statefulset-256 describe po ss2-0' Aug 18 11:42:47.867: INFO: stderr: "" Aug 18 11:42:47.867: INFO: stdout: "Name: ss2-0\nNamespace: statefulset-256\nPriority: 0\nNode: node1/10.10.190.207\nStart Time: Wed, 18 Aug 2021 11:32:47 +0000\nLabels: baz=blah\n controller-revision-hash=ss2-65c7964b94\n foo=bar\n statefulset.kubernetes.io/pod-name=ss2-0\nAnnotations: k8s.v1.cni.cncf.io/network-status:\n [{\n \"name\": \"default-cni-network\",\n \"interface\": \"eth0\",\n \"ips\": [\n \"10.244.4.22\"\n ],\n \"mac\": \"a6:b3:84:46:0d:87\",\n \"default\": true,\n \"dns\": {}\n }]\n k8s.v1.cni.cncf.io/networks-status:\n [{\n \"name\": \"default-cni-network\",\n \"interface\": \"eth0\",\n \"ips\": [\n \"10.244.4.22\"\n ],\n \"mac\": \"a6:b3:84:46:0d:87\",\n \"default\": true,\n \"dns\": {}\n }]\n kubernetes.io/psp: collectd\nStatus: Pending\nIP: 10.244.4.22\nIPs:\n IP: 10.244.4.22\nControlled By: StatefulSet/ss2\nContainers:\n webserver:\n Container ID: \n Image: docker.io/library/httpd:2.4.38-alpine\n Image ID: \n Port: \n Host Port: \n State: Waiting\n Reason: ImagePullBackOff\n Ready: False\n Restart Count: 0\n Readiness: http-get http://:80/index.html delay=0s timeout=1s period=1s #success=1 #failure=1\n Environment: \n Mounts:\n /var/run/secrets/kubernetes.io/serviceaccount from default-token-q28jf (ro)\nConditions:\n Type Status\n Initialized True \n Ready False \n ContainersReady False \n PodScheduled True \nVolumes:\n default-token-q28jf:\n Type: Secret (a volume populated by a Secret)\n SecretName: default-token-q28jf\n Optional: false\nQoS Class: BestEffort\nNode-Selectors: \nTolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s\n node.kubernetes.io/unreachable:NoExecute op=Exists for 300s\nEvents:\n Type Reason Age From Message\n ---- ------ ---- ---- -------\n Normal Scheduled 10m default-scheduler Successfully assigned statefulset-256/ss2-0 to node1\n Normal AddedInterface 9m58s multus Add eth0 [10.244.4.22/24]\n Normal Pulling 8m36s (x4 over 9m58s) kubelet Pulling image \"docker.io/library/httpd:2.4.38-alpine\"\n Warning Failed 8m35s (x4 over 9m57s) kubelet Failed to pull image \"docker.io/library/httpd:2.4.38-alpine\": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit\n Warning Failed 8m35s (x4 over 9m57s) kubelet Error: ErrImagePull\n Normal BackOff 8m9s (x6 over 9m57s) kubelet Back-off pulling image \"docker.io/library/httpd:2.4.38-alpine\"\n Warning Failed 4m55s (x20 over 9m57s) kubelet Error: ImagePullBackOff\n" Aug 18 11:42:47.867: INFO: Output of kubectl describe ss2-0: Name: ss2-0 Namespace: statefulset-256 Priority: 0 Node: node1/10.10.190.207 Start Time: Wed, 18 Aug 2021 11:32:47 +0000 Labels: baz=blah controller-revision-hash=ss2-65c7964b94 foo=bar statefulset.kubernetes.io/pod-name=ss2-0 Annotations: k8s.v1.cni.cncf.io/network-status: [{ "name": "default-cni-network", "interface": "eth0", "ips": [ "10.244.4.22" ], "mac": "a6:b3:84:46:0d:87", "default": true, "dns": {} }] k8s.v1.cni.cncf.io/networks-status: [{ "name": "default-cni-network", "interface": "eth0", "ips": [ "10.244.4.22" ], "mac": "a6:b3:84:46:0d:87", "default": true, "dns": {} }] kubernetes.io/psp: collectd Status: Pending IP: 10.244.4.22 IPs: IP: 10.244.4.22 Controlled By: StatefulSet/ss2 Containers: webserver: Container ID: Image: docker.io/library/httpd:2.4.38-alpine Image ID: Port: Host Port: State: Waiting Reason: ImagePullBackOff Ready: False Restart Count: 0 Readiness: http-get http://:80/index.html delay=0s timeout=1s period=1s #success=1 #failure=1 Environment: Mounts: /var/run/secrets/kubernetes.io/serviceaccount from default-token-q28jf (ro) Conditions: Type Status Initialized True Ready False ContainersReady False PodScheduled True Volumes: default-token-q28jf: Type: Secret (a volume populated by a Secret) SecretName: default-token-q28jf Optional: false QoS Class: BestEffort Node-Selectors: Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s node.kubernetes.io/unreachable:NoExecute op=Exists for 300s Events: Type Reason Age From Message ---- ------ ---- ---- ------- Normal Scheduled 10m default-scheduler Successfully assigned statefulset-256/ss2-0 to node1 Normal AddedInterface 9m58s multus Add eth0 [10.244.4.22/24] Normal Pulling 8m36s (x4 over 9m58s) kubelet Pulling image "docker.io/library/httpd:2.4.38-alpine" Warning Failed 8m35s (x4 over 9m57s) kubelet Failed to pull image "docker.io/library/httpd:2.4.38-alpine": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit Warning Failed 8m35s (x4 over 9m57s) kubelet Error: ErrImagePull Normal BackOff 8m9s (x6 over 9m57s) kubelet Back-off pulling image "docker.io/library/httpd:2.4.38-alpine" Warning Failed 4m55s (x20 over 9m57s) kubelet Error: ImagePullBackOff Aug 18 11:42:47.868: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=statefulset-256 logs ss2-0 --tail=100' Aug 18 11:42:48.042: INFO: rc: 1 Aug 18 11:42:48.042: INFO: Last 100 log lines of ss2-0: Aug 18 11:42:48.042: INFO: Deleting all statefulset in ns statefulset-256 Aug 18 11:42:48.044: INFO: Scaling statefulset ss2 to 0 Aug 18 11:42:58.057: INFO: Waiting for statefulset status.replicas updated to 0 Aug 18 11:42:58.059: INFO: Deleting statefulset ss2 [AfterEach] [sig-apps] StatefulSet /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "statefulset-256". STEP: Found 9 events. Aug 18 11:42:58.072: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for ss2-0: { } Scheduled: Successfully assigned statefulset-256/ss2-0 to node1 Aug 18 11:42:58.072: INFO: At 2021-08-18 11:32:47 +0000 UTC - event for ss2: {statefulset-controller } SuccessfulCreate: create Pod ss2-0 in StatefulSet ss2 successful Aug 18 11:42:58.072: INFO: At 2021-08-18 11:32:49 +0000 UTC - event for ss2-0: {kubelet node1} Pulling: Pulling image "docker.io/library/httpd:2.4.38-alpine" Aug 18 11:42:58.072: INFO: At 2021-08-18 11:32:49 +0000 UTC - event for ss2-0: {multus } AddedInterface: Add eth0 [10.244.4.22/24] Aug 18 11:42:58.072: INFO: At 2021-08-18 11:32:50 +0000 UTC - event for ss2-0: {kubelet node1} Failed: Failed to pull image "docker.io/library/httpd:2.4.38-alpine": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit Aug 18 11:42:58.072: INFO: At 2021-08-18 11:32:50 +0000 UTC - event for ss2-0: {kubelet node1} Failed: Error: ErrImagePull Aug 18 11:42:58.072: INFO: At 2021-08-18 11:32:50 +0000 UTC - event for ss2-0: {kubelet node1} BackOff: Back-off pulling image "docker.io/library/httpd:2.4.38-alpine" Aug 18 11:42:58.072: INFO: At 2021-08-18 11:32:50 +0000 UTC - event for ss2-0: {kubelet node1} Failed: Error: ImagePullBackOff Aug 18 11:42:58.072: INFO: At 2021-08-18 11:42:48 +0000 UTC - event for ss2: {statefulset-controller } SuccessfulDelete: delete Pod ss2-0 in StatefulSet ss2 successful Aug 18 11:42:58.074: INFO: POD NODE PHASE GRACE CONDITIONS Aug 18 11:42:58.074: INFO: Aug 18 11:42:58.078: INFO: Logging node info for node master1 Aug 18 11:42:58.081: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 ebb211fa-503f-4cfe-b1ed-c95d27a70e6e 67902 0 2021-08-18 08:20:52 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"3a:82:be:72:b5:15"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:20:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:20:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:25:59 +0000 UTC,LastTransitionTime:2021-08-18 08:25:59 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:42:55 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:42:55 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:42:55 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:42:55 +0000 UTC,LastTransitionTime:2021-08-18 08:25:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:58c3e57359b641ad92fa1959f2fecf5d,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:012cd796-2076-45d6-8b14-d3e0451b1e64,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[@ :],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:42:58.082: INFO: Logging kubelet events for node master1 Aug 18 11:42:58.084: INFO: Logging pods the kubelet thinks is on node master1 Aug 18 11:42:58.092: INFO: kube-multus-ds-amd64-kbcp6 started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.092: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:42:58.092: INFO: docker-registry-docker-registry-56cbc7bc58-49kl2 started at 2021-08-18 08:26:23 +0000 UTC (0+2 container statuses recorded) Aug 18 11:42:58.092: INFO: Container docker-registry ready: true, restart count 0 Aug 18 11:42:58.092: INFO: Container nginx ready: true, restart count 0 Aug 18 11:42:58.092: INFO: node-exporter-5hwz9 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:42:58.092: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:42:58.092: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:42:58.092: INFO: kube-controller-manager-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.092: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:42:58.092: INFO: kube-flannel-q64cq started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:42:58.092: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:42:58.092: INFO: Container kube-flannel ready: true, restart count 3 Aug 18 11:42:58.092: INFO: coredns-7677f9bb54-kn2qg started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.092: INFO: Container coredns ready: true, restart count 2 Aug 18 11:42:58.092: INFO: kube-scheduler-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.092: INFO: Container kube-scheduler ready: true, restart count 0 Aug 18 11:42:58.092: INFO: kube-apiserver-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.092: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:42:58.092: INFO: kube-proxy-vqk4v started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.092: INFO: Container kube-proxy ready: true, restart count 1 W0818 11:42:58.104230 28 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:42:58.129: INFO: Latency metrics for node master1 Aug 18 11:42:58.129: INFO: Logging node info for node master2 Aug 18 11:42:58.131: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 78946293-3abe-4442-84d4-8ed6b1d15ce0 67891 0 2021-08-18 08:21:31 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"7e:f5:c2:cc:3a:b4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:21:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:21:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-08-18 08:29:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:42:54 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:42:54 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:42:54 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:42:54 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0c44122c7a7248c18d8571e1cc667258,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:0cd329f2-48e0-4c8f-b8b9-fa3ae0ed8406,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:42:58.131: INFO: Logging kubelet events for node master2 Aug 18 11:42:58.133: INFO: Logging pods the kubelet thinks is on node master2 Aug 18 11:42:58.141: INFO: kube-controller-manager-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.141: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:42:58.141: INFO: kube-proxy-kh2l9 started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.141: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:42:58.141: INFO: kube-flannel-pp56h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:42:58.141: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:42:58.141: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:42:58.141: INFO: kube-apiserver-master2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.141: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:42:58.141: INFO: kube-scheduler-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.141: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:42:58.141: INFO: kube-multus-ds-amd64-mld8g started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.141: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:42:58.141: INFO: dns-autoscaler-5b7b5c9b6f-hh47r started at 2021-08-18 08:23:57 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.141: INFO: Container autoscaler ready: true, restart count 2 Aug 18 11:42:58.141: INFO: node-feature-discovery-controller-5bf5c49849-mq57c started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.141: INFO: Container nfd-controller ready: true, restart count 0 Aug 18 11:42:58.141: INFO: node-exporter-48nfx started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:42:58.141: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:42:58.141: INFO: Container node-exporter ready: true, restart count 0 W0818 11:42:58.153053 28 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:42:58.179: INFO: Latency metrics for node master2 Aug 18 11:42:58.179: INFO: Logging node info for node master3 Aug 18 11:42:58.182: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 44feac2b-9447-4be2-9fcd-62f836d67c72 67806 0 2021-08-18 08:21:41 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"86:e4:31:99:58:40"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {kubelet Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:42:50 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:42:50 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:42:50 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:42:50 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1fae19ae59884c44899bcd08aa243244,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:5db926c5-6530-4635-a0d5-806974a3b732,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:42:58.183: INFO: Logging kubelet events for node master3 Aug 18 11:42:58.185: INFO: Logging pods the kubelet thinks is on node master3 Aug 18 11:42:58.193: INFO: kube-apiserver-master3 started at 2021-08-18 08:29:12 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.193: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:42:58.193: INFO: kube-proxy-sd5lc started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.193: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:42:58.193: INFO: kube-flannel-x6tlr started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:42:58.193: INFO: Init container install-cni ready: true, restart count 1 Aug 18 11:42:58.193: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:42:58.193: INFO: kube-multus-ds-amd64-bkw6c started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.193: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:42:58.193: INFO: coredns-7677f9bb54-5hxfh started at 2021-08-18 08:23:54 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.193: INFO: Container coredns ready: true, restart count 1 Aug 18 11:42:58.193: INFO: node-exporter-vq7d8 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:42:58.193: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:42:58.193: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:42:58.193: INFO: kube-controller-manager-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.193: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:42:58.193: INFO: kube-scheduler-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.193: INFO: Container kube-scheduler ready: true, restart count 2 W0818 11:42:58.206501 28 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:42:58.230: INFO: Latency metrics for node master3 Aug 18 11:42:58.230: INFO: Logging node info for node node1 Aug 18 11:42:58.232: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 84defabd-6ebf-43ec-a629-44c6713da9c9 67766 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"9a:87:55:36:7b:df"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:13 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:35 +0000 UTC,LastTransitionTime:2021-08-18 08:26:35 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:42:47 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:42:47 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:42:47 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:42:47 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:69946ff2b7bc462fa25eb7adb4703c23,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:736dc52f-f5e3-494e-86ca-01eedbea015c,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:a7cea43d9d2f67c38fbf0407786edbe660ee9072945f7bb272b55fd255e8eaca opnfv/barometer-collectd:stable],SizeBytes:1075746799,},ContainerImage{Names:[@ :],SizeBytes:1003788820,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[aquasec/kube-hunter@sha256:2be6820bc1d7e0f57193a9a27d5a3e16b2fd93c53747b03ce8ca48c6fc323781 aquasec/kube-hunter:0.3.1],SizeBytes:347611549,},ContainerImage{Names:[golang@sha256:db2475a1dbb2149508e5db31d7d77a75e6600d54be645f37681f03f2762169ba golang:alpine3.12],SizeBytes:301186719,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:de25c7fc6c4f3a27c7f0c2dff454e4671823a34d88abd533f210848d527e0fbb alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:42:58.233: INFO: Logging kubelet events for node node1 Aug 18 11:42:58.235: INFO: Logging pods the kubelet thinks is on node node1 Aug 18 11:42:58.249: INFO: kube-flannel-q78nd started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:42:58.249: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:42:58.249: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:42:58.249: INFO: prometheus-k8s-0 started at 2021-08-18 08:34:03 +0000 UTC (0+5 container statuses recorded) Aug 18 11:42:58.249: INFO: Container custom-metrics-apiserver ready: true, restart count 0 Aug 18 11:42:58.249: INFO: Container grafana ready: true, restart count 0 Aug 18 11:42:58.249: INFO: Container prometheus ready: true, restart count 1 Aug 18 11:42:58.249: INFO: Container prometheus-config-reloader ready: true, restart count 0 Aug 18 11:42:58.249: INFO: Container rules-configmap-reloader ready: true, restart count 0 Aug 18 11:42:58.249: INFO: node-exporter-kcwvn started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:42:58.249: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:42:58.249: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:42:58.249: INFO: pod-adoption-release started at 2021-08-18 11:41:47 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.249: INFO: Container pod-adoption-release ready: false, restart count 0 Aug 18 11:42:58.249: INFO: kube-multus-ds-amd64-rrvmb started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.249: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:42:58.249: INFO: node-feature-discovery-worker-pflgw started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.249: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:42:58.249: INFO: cmk-init-discover-node1-bxznx started at 2021-08-18 08:32:10 +0000 UTC (0+3 container statuses recorded) Aug 18 11:42:58.249: INFO: Container discover ready: false, restart count 0 Aug 18 11:42:58.249: INFO: Container init ready: false, restart count 0 Aug 18 11:42:58.249: INFO: Container install ready: false, restart count 0 Aug 18 11:42:58.249: INFO: cmk-d8r27 started at 2021-08-18 08:32:52 +0000 UTC (0+2 container statuses recorded) Aug 18 11:42:58.249: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:42:58.249: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:42:58.249: INFO: collectd-xdprr started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:42:58.249: INFO: Container collectd ready: true, restart count 0 Aug 18 11:42:58.249: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:42:58.249: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:42:58.249: INFO: busybox-scheduling-f75e615f-f2c3-4e61-8ed7-848c386f63d3 started at 2021-08-18 11:40:13 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.249: INFO: Container busybox-scheduling-f75e615f-f2c3-4e61-8ed7-848c386f63d3 ready: false, restart count 0 Aug 18 11:42:58.249: INFO: kube-proxy-p6jvp started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.249: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:42:58.249: INFO: kubernetes-metrics-scraper-678c97765c-9nsv5 started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.249: INFO: Container kubernetes-metrics-scraper ready: true, restart count 2 Aug 18 11:42:58.249: INFO: fail-once-local-8rxnh started at 2021-08-18 11:34:14 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.249: INFO: Container c ready: false, restart count 0 Aug 18 11:42:58.249: INFO: busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665 started at 2021-08-18 11:41:33 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.249: INFO: Container busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665 ready: false, restart count 0 Aug 18 11:42:58.249: INFO: nginx-proxy-node1 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.249: INFO: Container nginx-proxy ready: true, restart count 2 Aug 18 11:42:58.249: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-vsxvg started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.249: INFO: Container kube-sriovdp ready: true, restart count 0 W0818 11:42:58.261541 28 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:42:58.357: INFO: Latency metrics for node node1 Aug 18 11:42:58.357: INFO: Logging node info for node node2 Aug 18 11:42:58.360: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 1d01177e-3dbb-48a1-a0bc-d18af27ab7f8 67925 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:d1:47:f8:1d:22"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:36 +0000 UTC,LastTransitionTime:2021-08-18 08:26:36 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:42:56 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:42:56 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:42:56 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:42:56 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:dc1f286135c145349b8a016880b65a2f,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:037e7e2d-94e9-42f4-a719-896e5005ac70,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:42:58.360: INFO: Logging kubelet events for node node2 Aug 18 11:42:58.362: INFO: Logging pods the kubelet thinks is on node node2 Aug 18 11:42:58.375: INFO: cmk-748rz started at 2021-08-18 08:32:53 +0000 UTC (0+2 container statuses recorded) Aug 18 11:42:58.375: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:42:58.375: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:42:58.375: INFO: kube-proxy-qkj9c started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.375: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:42:58.375: INFO: node-feature-discovery-worker-hzpf5 started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.375: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:42:58.375: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-c82pt started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.375: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:42:58.375: INFO: prometheus-operator-5bb8cb9d8f-k97ws started at 2021-08-18 08:33:38 +0000 UTC (0+2 container statuses recorded) Aug 18 11:42:58.375: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:42:58.375: INFO: Container prometheus-operator ready: true, restart count 0 Aug 18 11:42:58.375: INFO: kube-multus-ds-amd64-rvzsg started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.375: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:42:58.375: INFO: collectd-67ntq started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:42:58.375: INFO: Container collectd ready: true, restart count 0 Aug 18 11:42:58.375: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:42:58.375: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:42:58.375: INFO: cmk-webhook-6c9d5f8578-7cxjr started at 2021-08-18 08:32:53 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.375: INFO: Container cmk-webhook ready: true, restart count 0 Aug 18 11:42:58.375: INFO: kube-flannel-h7t5h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:42:58.375: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:42:58.375: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:42:58.375: INFO: node-exporter-lrrf2 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:42:58.375: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:42:58.375: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:42:58.375: INFO: var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e started at 2021-08-18 11:39:31 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.375: INFO: Container dapi-container ready: false, restart count 0 Aug 18 11:42:58.375: INFO: pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5 started at 2021-08-18 11:42:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.375: INFO: Container env-test ready: false, restart count 0 Aug 18 11:42:58.375: INFO: fail-once-local-pk5cs started at 2021-08-18 11:34:14 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.375: INFO: Container c ready: false, restart count 0 Aug 18 11:42:58.375: INFO: nginx-proxy-node2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.375: INFO: Container nginx-proxy ready: true, restart count 1 Aug 18 11:42:58.375: INFO: cmk-init-discover-node2-6b2kz started at 2021-08-18 08:32:30 +0000 UTC (0+3 container statuses recorded) Aug 18 11:42:58.375: INFO: Container discover ready: false, restart count 0 Aug 18 11:42:58.375: INFO: Container init ready: false, restart count 0 Aug 18 11:42:58.375: INFO: Container install ready: false, restart count 0 Aug 18 11:42:58.375: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-7rn45 started at 2021-08-18 08:36:42 +0000 UTC (0+2 container statuses recorded) Aug 18 11:42:58.375: INFO: Container tas-controller ready: true, restart count 0 Aug 18 11:42:58.375: INFO: Container tas-extender ready: true, restart count 0 Aug 18 11:42:58.375: INFO: downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1 started at 2021-08-18 11:39:54 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.375: INFO: Container dapi-container ready: false, restart count 0 Aug 18 11:42:58.375: INFO: kubernetes-dashboard-86c6f9df5b-qrtdk started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.375: INFO: Container kubernetes-dashboard ready: true, restart count 2 W0818 11:42:58.388128 28 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:42:58.431: INFO: Latency metrics for node node2 Aug 18 11:42:58.431: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "statefulset-256" for this suite. • Failure [610.801 seconds] [sig-apps] StatefulSet /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/framework.go:23 [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 should perform canary updates and phased rolling updates of template modifications [Conformance] [It] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:42:47.673: Failed waiting for pods to enter running: timed out waiting for the condition /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/statefulset/wait.go:58 ------------------------------ {"msg":"FAILED [sig-apps] StatefulSet [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] should perform canary updates and phased rolling updates of template modifications [Conformance]","total":-1,"completed":5,"skipped":147,"failed":2,"failures":["[k8s.io] Variable Expansion should allow substituting values in a volume subpath [sig-storage] [Conformance]","[sig-apps] StatefulSet [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] should perform canary updates and phased rolling updates of template modifications [Conformance]"]} SSSS ------------------------------ [BeforeEach] [k8s.io] Probing container /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:37:58.050: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename container-probe STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [k8s.io] Probing container /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:54 [It] should be restarted with a exec "cat /tmp/health" liveness probe [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating pod busybox-ca1d4157-6037-47c1-a37c-160e2dd5121c in namespace container-probe-9572 Aug 18 11:42:58.090: FAIL: starting pod busybox-ca1d4157-6037-47c1-a37c-160e2dd5121c in namespace container-probe-9572 Unexpected error: <*errors.errorString | 0xc0002c2200>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/common.RunLivenessTest(0xc00042c420, 0xc004290800, 0x1, 0x37e11d6000) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:426 +0x4b9 k8s.io/kubernetes/test/e2e/common.glob..func3.4() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:130 +0x197 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc001b28d80) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc001b28d80) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc001b28d80, 0x4deb2c0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 STEP: deleting the pod [AfterEach] [k8s.io] Probing container /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "container-probe-9572". STEP: Found 9 events. Aug 18 11:42:58.101: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for busybox-ca1d4157-6037-47c1-a37c-160e2dd5121c: { } Scheduled: Successfully assigned container-probe-9572/busybox-ca1d4157-6037-47c1-a37c-160e2dd5121c to node1 Aug 18 11:42:58.101: INFO: At 2021-08-18 11:37:59 +0000 UTC - event for busybox-ca1d4157-6037-47c1-a37c-160e2dd5121c: {multus } AddedInterface: Add eth0 [10.244.4.35/24] Aug 18 11:42:58.101: INFO: At 2021-08-18 11:37:59 +0000 UTC - event for busybox-ca1d4157-6037-47c1-a37c-160e2dd5121c: {kubelet node1} Pulling: Pulling image "docker.io/library/busybox:1.29" Aug 18 11:42:58.101: INFO: At 2021-08-18 11:38:00 +0000 UTC - event for busybox-ca1d4157-6037-47c1-a37c-160e2dd5121c: {kubelet node1} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit Aug 18 11:42:58.101: INFO: At 2021-08-18 11:38:00 +0000 UTC - event for busybox-ca1d4157-6037-47c1-a37c-160e2dd5121c: {kubelet node1} Failed: Error: ErrImagePull Aug 18 11:42:58.101: INFO: At 2021-08-18 11:38:01 +0000 UTC - event for busybox-ca1d4157-6037-47c1-a37c-160e2dd5121c: {kubelet node1} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Aug 18 11:42:58.101: INFO: At 2021-08-18 11:38:03 +0000 UTC - event for busybox-ca1d4157-6037-47c1-a37c-160e2dd5121c: {multus } AddedInterface: Add eth0 [10.244.4.36/24] Aug 18 11:42:58.101: INFO: At 2021-08-18 11:38:03 +0000 UTC - event for busybox-ca1d4157-6037-47c1-a37c-160e2dd5121c: {kubelet node1} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" Aug 18 11:42:58.101: INFO: At 2021-08-18 11:38:03 +0000 UTC - event for busybox-ca1d4157-6037-47c1-a37c-160e2dd5121c: {kubelet node1} Failed: Error: ImagePullBackOff Aug 18 11:42:58.103: INFO: POD NODE PHASE GRACE CONDITIONS Aug 18 11:42:58.103: INFO: Aug 18 11:42:58.107: INFO: Logging node info for node master1 Aug 18 11:42:58.110: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 ebb211fa-503f-4cfe-b1ed-c95d27a70e6e 67902 0 2021-08-18 08:20:52 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"3a:82:be:72:b5:15"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:20:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:20:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:25:59 +0000 UTC,LastTransitionTime:2021-08-18 08:25:59 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:42:55 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:42:55 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:42:55 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:42:55 +0000 UTC,LastTransitionTime:2021-08-18 08:25:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:58c3e57359b641ad92fa1959f2fecf5d,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:012cd796-2076-45d6-8b14-d3e0451b1e64,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[@ :],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:42:58.110: INFO: Logging kubelet events for node master1 Aug 18 11:42:58.112: INFO: Logging pods the kubelet thinks is on node master1 Aug 18 11:42:58.121: INFO: kube-flannel-q64cq started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:42:58.121: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:42:58.121: INFO: Container kube-flannel ready: true, restart count 3 Aug 18 11:42:58.121: INFO: coredns-7677f9bb54-kn2qg started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.121: INFO: Container coredns ready: true, restart count 2 Aug 18 11:42:58.121: INFO: kube-scheduler-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.121: INFO: Container kube-scheduler ready: true, restart count 0 Aug 18 11:42:58.121: INFO: kube-apiserver-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.121: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:42:58.121: INFO: kube-proxy-vqk4v started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.121: INFO: Container kube-proxy ready: true, restart count 1 Aug 18 11:42:58.121: INFO: kube-multus-ds-amd64-kbcp6 started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.121: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:42:58.121: INFO: docker-registry-docker-registry-56cbc7bc58-49kl2 started at 2021-08-18 08:26:23 +0000 UTC (0+2 container statuses recorded) Aug 18 11:42:58.121: INFO: Container docker-registry ready: true, restart count 0 Aug 18 11:42:58.121: INFO: Container nginx ready: true, restart count 0 Aug 18 11:42:58.121: INFO: node-exporter-5hwz9 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:42:58.121: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:42:58.121: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:42:58.121: INFO: kube-controller-manager-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.121: INFO: Container kube-controller-manager ready: true, restart count 2 W0818 11:42:58.134131 31 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:42:58.158: INFO: Latency metrics for node master1 Aug 18 11:42:58.158: INFO: Logging node info for node master2 Aug 18 11:42:58.160: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 78946293-3abe-4442-84d4-8ed6b1d15ce0 67891 0 2021-08-18 08:21:31 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"7e:f5:c2:cc:3a:b4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:21:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:21:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-08-18 08:29:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:42:54 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:42:54 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:42:54 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:42:54 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0c44122c7a7248c18d8571e1cc667258,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:0cd329f2-48e0-4c8f-b8b9-fa3ae0ed8406,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:42:58.161: INFO: Logging kubelet events for node master2 Aug 18 11:42:58.163: INFO: Logging pods the kubelet thinks is on node master2 Aug 18 11:42:58.171: INFO: kube-scheduler-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.171: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:42:58.171: INFO: kube-multus-ds-amd64-mld8g started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.171: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:42:58.171: INFO: dns-autoscaler-5b7b5c9b6f-hh47r started at 2021-08-18 08:23:57 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.171: INFO: Container autoscaler ready: true, restart count 2 Aug 18 11:42:58.171: INFO: node-feature-discovery-controller-5bf5c49849-mq57c started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.171: INFO: Container nfd-controller ready: true, restart count 0 Aug 18 11:42:58.171: INFO: node-exporter-48nfx started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:42:58.171: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:42:58.171: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:42:58.171: INFO: kube-apiserver-master2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.171: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:42:58.171: INFO: kube-proxy-kh2l9 started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.171: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:42:58.171: INFO: kube-flannel-pp56h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:42:58.171: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:42:58.171: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:42:58.171: INFO: kube-controller-manager-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.171: INFO: Container kube-controller-manager ready: true, restart count 2 W0818 11:42:58.183294 31 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:42:58.206: INFO: Latency metrics for node master2 Aug 18 11:42:58.206: INFO: Logging node info for node master3 Aug 18 11:42:58.208: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 44feac2b-9447-4be2-9fcd-62f836d67c72 67806 0 2021-08-18 08:21:41 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"86:e4:31:99:58:40"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {kubelet Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:42:50 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:42:50 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:42:50 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:42:50 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1fae19ae59884c44899bcd08aa243244,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:5db926c5-6530-4635-a0d5-806974a3b732,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:42:58.209: INFO: Logging kubelet events for node master3 Aug 18 11:42:58.210: INFO: Logging pods the kubelet thinks is on node master3 Aug 18 11:42:58.221: INFO: node-exporter-vq7d8 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:42:58.221: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:42:58.221: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:42:58.221: INFO: kube-controller-manager-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.221: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:42:58.221: INFO: kube-scheduler-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.221: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:42:58.221: INFO: kube-apiserver-master3 started at 2021-08-18 08:29:12 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.221: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:42:58.221: INFO: kube-proxy-sd5lc started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.221: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:42:58.221: INFO: kube-flannel-x6tlr started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:42:58.221: INFO: Init container install-cni ready: true, restart count 1 Aug 18 11:42:58.221: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:42:58.221: INFO: kube-multus-ds-amd64-bkw6c started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.221: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:42:58.221: INFO: coredns-7677f9bb54-5hxfh started at 2021-08-18 08:23:54 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.221: INFO: Container coredns ready: true, restart count 1 W0818 11:42:58.233847 31 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:42:58.255: INFO: Latency metrics for node master3 Aug 18 11:42:58.255: INFO: Logging node info for node node1 Aug 18 11:42:58.257: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 84defabd-6ebf-43ec-a629-44c6713da9c9 67766 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"9a:87:55:36:7b:df"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:13 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:35 +0000 UTC,LastTransitionTime:2021-08-18 08:26:35 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:42:47 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:42:47 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:42:47 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:42:47 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:69946ff2b7bc462fa25eb7adb4703c23,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:736dc52f-f5e3-494e-86ca-01eedbea015c,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:a7cea43d9d2f67c38fbf0407786edbe660ee9072945f7bb272b55fd255e8eaca opnfv/barometer-collectd:stable],SizeBytes:1075746799,},ContainerImage{Names:[@ :],SizeBytes:1003788820,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[aquasec/kube-hunter@sha256:2be6820bc1d7e0f57193a9a27d5a3e16b2fd93c53747b03ce8ca48c6fc323781 aquasec/kube-hunter:0.3.1],SizeBytes:347611549,},ContainerImage{Names:[golang@sha256:db2475a1dbb2149508e5db31d7d77a75e6600d54be645f37681f03f2762169ba golang:alpine3.12],SizeBytes:301186719,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:de25c7fc6c4f3a27c7f0c2dff454e4671823a34d88abd533f210848d527e0fbb alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:42:58.258: INFO: Logging kubelet events for node node1 Aug 18 11:42:58.260: INFO: Logging pods the kubelet thinks is on node node1 Aug 18 11:42:58.272: INFO: nginx-proxy-node1 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.272: INFO: Container nginx-proxy ready: true, restart count 2 Aug 18 11:42:58.272: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-vsxvg started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.272: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:42:58.272: INFO: fail-once-local-8rxnh started at 2021-08-18 11:34:14 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.272: INFO: Container c ready: false, restart count 0 Aug 18 11:42:58.272: INFO: busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665 started at 2021-08-18 11:41:33 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.272: INFO: Container busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665 ready: false, restart count 0 Aug 18 11:42:58.272: INFO: kube-flannel-q78nd started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:42:58.272: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:42:58.272: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:42:58.272: INFO: prometheus-k8s-0 started at 2021-08-18 08:34:03 +0000 UTC (0+5 container statuses recorded) Aug 18 11:42:58.272: INFO: Container custom-metrics-apiserver ready: true, restart count 0 Aug 18 11:42:58.272: INFO: Container grafana ready: true, restart count 0 Aug 18 11:42:58.272: INFO: Container prometheus ready: true, restart count 1 Aug 18 11:42:58.272: INFO: Container prometheus-config-reloader ready: true, restart count 0 Aug 18 11:42:58.272: INFO: Container rules-configmap-reloader ready: true, restart count 0 Aug 18 11:42:58.272: INFO: pod-adoption-release started at 2021-08-18 11:41:47 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.272: INFO: Container pod-adoption-release ready: false, restart count 0 Aug 18 11:42:58.272: INFO: kube-multus-ds-amd64-rrvmb started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.272: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:42:58.272: INFO: node-feature-discovery-worker-pflgw started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.272: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:42:58.272: INFO: node-exporter-kcwvn started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:42:58.272: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:42:58.272: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:42:58.272: INFO: collectd-xdprr started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:42:58.272: INFO: Container collectd ready: true, restart count 0 Aug 18 11:42:58.272: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:42:58.272: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:42:58.272: INFO: busybox-scheduling-f75e615f-f2c3-4e61-8ed7-848c386f63d3 started at 2021-08-18 11:40:13 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.272: INFO: Container busybox-scheduling-f75e615f-f2c3-4e61-8ed7-848c386f63d3 ready: false, restart count 0 Aug 18 11:42:58.272: INFO: kube-proxy-p6jvp started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.272: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:42:58.272: INFO: kubernetes-metrics-scraper-678c97765c-9nsv5 started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.272: INFO: Container kubernetes-metrics-scraper ready: true, restart count 2 Aug 18 11:42:58.272: INFO: cmk-init-discover-node1-bxznx started at 2021-08-18 08:32:10 +0000 UTC (0+3 container statuses recorded) Aug 18 11:42:58.272: INFO: Container discover ready: false, restart count 0 Aug 18 11:42:58.272: INFO: Container init ready: false, restart count 0 Aug 18 11:42:58.272: INFO: Container install ready: false, restart count 0 Aug 18 11:42:58.272: INFO: cmk-d8r27 started at 2021-08-18 08:32:52 +0000 UTC (0+2 container statuses recorded) Aug 18 11:42:58.272: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:42:58.272: INFO: Container reconcile ready: true, restart count 0 W0818 11:42:58.285877 31 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:42:58.427: INFO: Latency metrics for node node1 Aug 18 11:42:58.427: INFO: Logging node info for node node2 Aug 18 11:42:58.431: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 1d01177e-3dbb-48a1-a0bc-d18af27ab7f8 67925 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:d1:47:f8:1d:22"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:36 +0000 UTC,LastTransitionTime:2021-08-18 08:26:36 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:42:56 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:42:56 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:42:56 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:42:56 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:dc1f286135c145349b8a016880b65a2f,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:037e7e2d-94e9-42f4-a719-896e5005ac70,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:42:58.432: INFO: Logging kubelet events for node node2 Aug 18 11:42:58.434: INFO: Logging pods the kubelet thinks is on node node2 Aug 18 11:42:58.447: INFO: fail-once-local-pk5cs started at 2021-08-18 11:34:14 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.447: INFO: Container c ready: false, restart count 0 Aug 18 11:42:58.447: INFO: nginx-proxy-node2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.447: INFO: Container nginx-proxy ready: true, restart count 1 Aug 18 11:42:58.447: INFO: cmk-init-discover-node2-6b2kz started at 2021-08-18 08:32:30 +0000 UTC (0+3 container statuses recorded) Aug 18 11:42:58.447: INFO: Container discover ready: false, restart count 0 Aug 18 11:42:58.447: INFO: Container init ready: false, restart count 0 Aug 18 11:42:58.447: INFO: Container install ready: false, restart count 0 Aug 18 11:42:58.447: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-7rn45 started at 2021-08-18 08:36:42 +0000 UTC (0+2 container statuses recorded) Aug 18 11:42:58.447: INFO: Container tas-controller ready: true, restart count 0 Aug 18 11:42:58.447: INFO: Container tas-extender ready: true, restart count 0 Aug 18 11:42:58.447: INFO: downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1 started at 2021-08-18 11:39:54 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.447: INFO: Container dapi-container ready: false, restart count 0 Aug 18 11:42:58.447: INFO: kubernetes-dashboard-86c6f9df5b-qrtdk started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.447: INFO: Container kubernetes-dashboard ready: true, restart count 2 Aug 18 11:42:58.447: INFO: cmk-748rz started at 2021-08-18 08:32:53 +0000 UTC (0+2 container statuses recorded) Aug 18 11:42:58.447: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:42:58.447: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:42:58.447: INFO: kube-proxy-qkj9c started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.447: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:42:58.447: INFO: node-feature-discovery-worker-hzpf5 started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.447: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:42:58.447: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-c82pt started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.447: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:42:58.447: INFO: prometheus-operator-5bb8cb9d8f-k97ws started at 2021-08-18 08:33:38 +0000 UTC (0+2 container statuses recorded) Aug 18 11:42:58.447: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:42:58.447: INFO: Container prometheus-operator ready: true, restart count 0 Aug 18 11:42:58.447: INFO: kube-multus-ds-amd64-rvzsg started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.447: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:42:58.447: INFO: collectd-67ntq started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:42:58.447: INFO: Container collectd ready: true, restart count 0 Aug 18 11:42:58.447: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:42:58.447: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:42:58.447: INFO: cmk-webhook-6c9d5f8578-7cxjr started at 2021-08-18 08:32:53 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.447: INFO: Container cmk-webhook ready: true, restart count 0 Aug 18 11:42:58.447: INFO: kube-flannel-h7t5h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:42:58.447: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:42:58.447: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:42:58.447: INFO: node-exporter-lrrf2 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:42:58.447: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:42:58.447: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:42:58.447: INFO: var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e started at 2021-08-18 11:39:31 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.447: INFO: Container dapi-container ready: false, restart count 0 Aug 18 11:42:58.447: INFO: pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5 started at 2021-08-18 11:42:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:42:58.447: INFO: Container env-test ready: false, restart count 0 W0818 11:42:58.458758 31 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:42:58.488: INFO: Latency metrics for node node2 Aug 18 11:42:58.488: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "container-probe-9572" for this suite. • Failure [300.446 seconds] [k8s.io] Probing container /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 should be restarted with a exec "cat /tmp/health" liveness probe [NodeConformance] [Conformance] [It] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:42:58.090: starting pod busybox-ca1d4157-6037-47c1-a37c-160e2dd5121c in namespace container-probe-9572 Unexpected error: <*errors.errorString | 0xc0002c2200>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:426 ------------------------------ {"msg":"FAILED [k8s.io] Probing container should be restarted with a exec \"cat /tmp/health\" liveness probe [NodeConformance] [Conformance]","total":-1,"completed":0,"skipped":53,"failed":2,"failures":["[sig-apps] StatefulSet [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] should perform rolling updates and roll backs of template modifications [Conformance]","[k8s.io] Probing container should be restarted with a exec \"cat /tmp/health\" liveness probe [NodeConformance] [Conformance]"]} SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-api-machinery] Watchers /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:42:51.380: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename watch STEP: Waiting for a default service account to be provisioned in namespace [It] should observe an object deletion if it stops meeting the requirements of the selector [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: creating a watch on configmaps with a certain label STEP: creating a new configmap STEP: modifying the configmap once STEP: changing the label value of the configmap STEP: Expecting to observe a delete notification for the watched object Aug 18 11:42:51.415: INFO: Got : ADDED &ConfigMap{ObjectMeta:{e2e-watch-test-label-changed watch-1894 /api/v1/namespaces/watch-1894/configmaps/e2e-watch-test-label-changed c566568e-711c-4e6d-9e52-8caee399df95 67821 0 2021-08-18 11:42:51 +0000 UTC map[watch-this-configmap:label-changed-and-restored] map[] [] [] [{e2e.test Update v1 2021-08-18 11:42:51 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{".":{},"f:watch-this-configmap":{}}}}}]},Data:map[string]string{},BinaryData:map[string][]byte{},Immutable:nil,} Aug 18 11:42:51.415: INFO: Got : MODIFIED &ConfigMap{ObjectMeta:{e2e-watch-test-label-changed watch-1894 /api/v1/namespaces/watch-1894/configmaps/e2e-watch-test-label-changed c566568e-711c-4e6d-9e52-8caee399df95 67822 0 2021-08-18 11:42:51 +0000 UTC map[watch-this-configmap:label-changed-and-restored] map[] [] [] [{e2e.test Update v1 2021-08-18 11:42:51 +0000 UTC FieldsV1 {"f:data":{".":{},"f:mutation":{}},"f:metadata":{"f:labels":{".":{},"f:watch-this-configmap":{}}}}}]},Data:map[string]string{mutation: 1,},BinaryData:map[string][]byte{},Immutable:nil,} Aug 18 11:42:51.415: INFO: Got : DELETED &ConfigMap{ObjectMeta:{e2e-watch-test-label-changed watch-1894 /api/v1/namespaces/watch-1894/configmaps/e2e-watch-test-label-changed c566568e-711c-4e6d-9e52-8caee399df95 67823 0 2021-08-18 11:42:51 +0000 UTC map[watch-this-configmap:label-changed-and-restored] map[] [] [] [{e2e.test Update v1 2021-08-18 11:42:51 +0000 UTC FieldsV1 {"f:data":{".":{},"f:mutation":{}},"f:metadata":{"f:labels":{".":{},"f:watch-this-configmap":{}}}}}]},Data:map[string]string{mutation: 1,},BinaryData:map[string][]byte{},Immutable:nil,} STEP: modifying the configmap a second time STEP: Expecting not to observe a notification because the object no longer meets the selector's requirements STEP: changing the label value of the configmap back STEP: modifying the configmap a third time STEP: deleting the configmap STEP: Expecting to observe an add notification for the watched object when the label value was restored Aug 18 11:43:01.439: INFO: Got : ADDED &ConfigMap{ObjectMeta:{e2e-watch-test-label-changed watch-1894 /api/v1/namespaces/watch-1894/configmaps/e2e-watch-test-label-changed c566568e-711c-4e6d-9e52-8caee399df95 67982 0 2021-08-18 11:42:51 +0000 UTC map[watch-this-configmap:label-changed-and-restored] map[] [] [] [{e2e.test Update v1 2021-08-18 11:42:51 +0000 UTC FieldsV1 {"f:data":{".":{},"f:mutation":{}},"f:metadata":{"f:labels":{".":{},"f:watch-this-configmap":{}}}}}]},Data:map[string]string{mutation: 2,},BinaryData:map[string][]byte{},Immutable:nil,} Aug 18 11:43:01.440: INFO: Got : MODIFIED &ConfigMap{ObjectMeta:{e2e-watch-test-label-changed watch-1894 /api/v1/namespaces/watch-1894/configmaps/e2e-watch-test-label-changed c566568e-711c-4e6d-9e52-8caee399df95 67983 0 2021-08-18 11:42:51 +0000 UTC map[watch-this-configmap:label-changed-and-restored] map[] [] [] [{e2e.test Update v1 2021-08-18 11:42:51 +0000 UTC FieldsV1 {"f:data":{".":{},"f:mutation":{}},"f:metadata":{"f:labels":{".":{},"f:watch-this-configmap":{}}}}}]},Data:map[string]string{mutation: 3,},BinaryData:map[string][]byte{},Immutable:nil,} Aug 18 11:43:01.440: INFO: Got : DELETED &ConfigMap{ObjectMeta:{e2e-watch-test-label-changed watch-1894 /api/v1/namespaces/watch-1894/configmaps/e2e-watch-test-label-changed c566568e-711c-4e6d-9e52-8caee399df95 67984 0 2021-08-18 11:42:51 +0000 UTC map[watch-this-configmap:label-changed-and-restored] map[] [] [] [{e2e.test Update v1 2021-08-18 11:42:51 +0000 UTC FieldsV1 {"f:data":{".":{},"f:mutation":{}},"f:metadata":{"f:labels":{".":{},"f:watch-this-configmap":{}}}}}]},Data:map[string]string{mutation: 3,},BinaryData:map[string][]byte{},Immutable:nil,} [AfterEach] [sig-api-machinery] Watchers /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:43:01.440: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "watch-1894" for this suite. • [SLOW TEST:10.069 seconds] [sig-api-machinery] Watchers /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23 should observe an object deletion if it stops meeting the requirements of the selector [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-api-machinery] Watchers should observe an object deletion if it stops meeting the requirements of the selector [Conformance]","total":-1,"completed":23,"skipped":591,"failed":3,"failures":["[sig-network] Services should be able to create a functioning NodePort service [Conformance]","[k8s.io] Pods should support retrieving logs from the container over websockets [NodeConformance] [Conformance]","[k8s.io] InitContainer [NodeConformance] should not start app containers if init containers fail on a RestartAlways pod [Conformance]"]} SSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-auth] ServiceAccounts /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:43:01.479: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename svcaccounts STEP: Waiting for a default service account to be provisioned in namespace [It] should allow opting out of API token automount [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: getting the auto-created API token Aug 18 11:43:02.023: INFO: created pod pod-service-account-defaultsa Aug 18 11:43:02.023: INFO: pod pod-service-account-defaultsa service account token volume mount: true Aug 18 11:43:02.032: INFO: created pod pod-service-account-mountsa Aug 18 11:43:02.032: INFO: pod pod-service-account-mountsa service account token volume mount: true Aug 18 11:43:02.042: INFO: created pod pod-service-account-nomountsa Aug 18 11:43:02.042: INFO: pod pod-service-account-nomountsa service account token volume mount: false Aug 18 11:43:02.052: INFO: created pod pod-service-account-defaultsa-mountspec Aug 18 11:43:02.052: INFO: pod pod-service-account-defaultsa-mountspec service account token volume mount: true Aug 18 11:43:02.061: INFO: created pod pod-service-account-mountsa-mountspec Aug 18 11:43:02.061: INFO: pod pod-service-account-mountsa-mountspec service account token volume mount: true Aug 18 11:43:02.069: INFO: created pod pod-service-account-nomountsa-mountspec Aug 18 11:43:02.069: INFO: pod pod-service-account-nomountsa-mountspec service account token volume mount: true Aug 18 11:43:02.078: INFO: created pod pod-service-account-defaultsa-nomountspec Aug 18 11:43:02.078: INFO: pod pod-service-account-defaultsa-nomountspec service account token volume mount: false Aug 18 11:43:02.086: INFO: created pod pod-service-account-mountsa-nomountspec Aug 18 11:43:02.086: INFO: pod pod-service-account-mountsa-nomountspec service account token volume mount: false Aug 18 11:43:02.095: INFO: created pod pod-service-account-nomountsa-nomountspec Aug 18 11:43:02.095: INFO: pod pod-service-account-nomountsa-nomountspec service account token volume mount: false [AfterEach] [sig-auth] ServiceAccounts /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:43:02.095: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "svcaccounts-4800" for this suite. • ------------------------------ {"msg":"PASSED [sig-auth] ServiceAccounts should allow opting out of API token automount [Conformance]","total":-1,"completed":24,"skipped":604,"failed":3,"failures":["[sig-network] Services should be able to create a functioning NodePort service [Conformance]","[k8s.io] Pods should support retrieving logs from the container over websockets [NodeConformance] [Conformance]","[k8s.io] InitContainer [NodeConformance] should not start app containers if init containers fail on a RestartAlways pod [Conformance]"]} SSSSSSSSS ------------------------------ [BeforeEach] [sig-cli] Kubectl client /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:43:02.125: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename kubectl STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-cli] Kubectl client /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/kubectl.go:247 [BeforeEach] Kubectl logs /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/kubectl.go:1385 STEP: creating an pod Aug 18 11:43:02.144: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-121 run logs-generator --image=k8s.gcr.io/e2e-test-images/agnhost:2.20 --restart=Never -- logs-generator --log-lines-total 100 --run-duration 20s' Aug 18 11:43:02.305: INFO: stderr: "" Aug 18 11:43:02.305: INFO: stdout: "pod/logs-generator created\n" [It] should be able to retrieve and filter logs [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Waiting for log generator to start. Aug 18 11:43:02.305: INFO: Waiting up to 5m0s for 1 pods to be running and ready, or succeeded: [logs-generator] Aug 18 11:43:02.305: INFO: Waiting up to 5m0s for pod "logs-generator" in namespace "kubectl-121" to be "running and ready, or succeeded" Aug 18 11:43:02.307: INFO: Pod "logs-generator": Phase="Pending", Reason="", readiness=false. Elapsed: 2.045539ms Aug 18 11:43:04.311: INFO: Pod "logs-generator": Phase="Pending", Reason="", readiness=false. Elapsed: 2.00618744s Aug 18 11:43:06.316: INFO: Pod "logs-generator": Phase="Pending", Reason="", readiness=false. Elapsed: 4.010632771s Aug 18 11:43:08.319: INFO: Pod "logs-generator": Phase="Pending", Reason="", readiness=false. Elapsed: 6.013689492s Aug 18 11:43:10.324: INFO: Pod "logs-generator": Phase="Pending", Reason="", readiness=false. Elapsed: 8.019175294s Aug 18 11:43:12.330: INFO: Pod "logs-generator": Phase="Pending", Reason="", readiness=false. Elapsed: 10.025197376s Aug 18 11:43:14.334: INFO: Pod "logs-generator": Phase="Running", Reason="", readiness=true. Elapsed: 12.028724327s Aug 18 11:43:14.334: INFO: Pod "logs-generator" satisfied condition "running and ready, or succeeded" Aug 18 11:43:14.334: INFO: Wanted all 1 pods to be running and ready, or succeeded. Result: true. Pods: [logs-generator] STEP: checking for a matching strings Aug 18 11:43:14.334: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-121 logs logs-generator logs-generator' Aug 18 11:43:14.490: INFO: stderr: "" Aug 18 11:43:14.490: INFO: stdout: "I0818 11:43:10.550666 1 logs_generator.go:76] 0 POST /api/v1/namespaces/default/pods/nvgd 547\nI0818 11:43:10.750814 1 logs_generator.go:76] 1 POST /api/v1/namespaces/ns/pods/jd8r 200\nI0818 11:43:10.950802 1 logs_generator.go:76] 2 PUT /api/v1/namespaces/kube-system/pods/x296 223\nI0818 11:43:11.150732 1 logs_generator.go:76] 3 GET /api/v1/namespaces/ns/pods/sjl 450\nI0818 11:43:11.350852 1 logs_generator.go:76] 4 PUT /api/v1/namespaces/default/pods/wt9j 236\nI0818 11:43:11.550863 1 logs_generator.go:76] 5 PUT /api/v1/namespaces/kube-system/pods/k65 557\nI0818 11:43:11.750708 1 logs_generator.go:76] 6 POST /api/v1/namespaces/default/pods/crm 374\nI0818 11:43:11.951004 1 logs_generator.go:76] 7 GET /api/v1/namespaces/kube-system/pods/nlkd 332\nI0818 11:43:12.151150 1 logs_generator.go:76] 8 POST /api/v1/namespaces/default/pods/clnn 579\nI0818 11:43:12.350903 1 logs_generator.go:76] 9 PUT /api/v1/namespaces/ns/pods/kbb 497\nI0818 11:43:12.550896 1 logs_generator.go:76] 10 GET /api/v1/namespaces/default/pods/smhg 583\nI0818 11:43:12.750850 1 logs_generator.go:76] 11 POST /api/v1/namespaces/ns/pods/llfd 379\nI0818 11:43:12.950854 1 logs_generator.go:76] 12 POST /api/v1/namespaces/ns/pods/f54 219\nI0818 11:43:13.150840 1 logs_generator.go:76] 13 PUT /api/v1/namespaces/ns/pods/c9c 368\nI0818 11:43:13.350803 1 logs_generator.go:76] 14 GET /api/v1/namespaces/kube-system/pods/dk6b 271\nI0818 11:43:13.550858 1 logs_generator.go:76] 15 POST /api/v1/namespaces/ns/pods/xc4 380\nI0818 11:43:13.751226 1 logs_generator.go:76] 16 POST /api/v1/namespaces/ns/pods/87j 337\nI0818 11:43:13.951101 1 logs_generator.go:76] 17 POST /api/v1/namespaces/default/pods/8h2 465\nI0818 11:43:14.150958 1 logs_generator.go:76] 18 PUT /api/v1/namespaces/default/pods/tcz8 387\nI0818 11:43:14.350810 1 logs_generator.go:76] 19 PUT /api/v1/namespaces/default/pods/28q 275\n" STEP: limiting log lines Aug 18 11:43:14.491: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-121 logs logs-generator logs-generator --tail=1' Aug 18 11:43:14.658: INFO: stderr: "" Aug 18 11:43:14.658: INFO: stdout: "I0818 11:43:14.551065 1 logs_generator.go:76] 20 POST /api/v1/namespaces/kube-system/pods/w8mb 473\n" Aug 18 11:43:14.658: INFO: got output "I0818 11:43:14.551065 1 logs_generator.go:76] 20 POST /api/v1/namespaces/kube-system/pods/w8mb 473\n" STEP: limiting log bytes Aug 18 11:43:14.659: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-121 logs logs-generator logs-generator --limit-bytes=1' Aug 18 11:43:14.798: INFO: stderr: "" Aug 18 11:43:14.798: INFO: stdout: "I" Aug 18 11:43:14.798: INFO: got output "I" STEP: exposing timestamps Aug 18 11:43:14.798: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-121 logs logs-generator logs-generator --tail=1 --timestamps' Aug 18 11:43:14.938: INFO: stderr: "" Aug 18 11:43:14.938: INFO: stdout: "2021-08-18T11:43:14.750860667Z I0818 11:43:14.750719 1 logs_generator.go:76] 21 PUT /api/v1/namespaces/ns/pods/w78n 507\n" Aug 18 11:43:14.938: INFO: got output "2021-08-18T11:43:14.750860667Z I0818 11:43:14.750719 1 logs_generator.go:76] 21 PUT /api/v1/namespaces/ns/pods/w78n 507\n" STEP: restricting to a time range Aug 18 11:43:17.439: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-121 logs logs-generator logs-generator --since=1s' Aug 18 11:43:17.599: INFO: stderr: "" Aug 18 11:43:17.599: INFO: stdout: "I0818 11:43:16.750844 1 logs_generator.go:76] 31 PUT /api/v1/namespaces/kube-system/pods/f9t 382\nI0818 11:43:16.950704 1 logs_generator.go:76] 32 POST /api/v1/namespaces/kube-system/pods/phzh 571\nI0818 11:43:17.151169 1 logs_generator.go:76] 33 PUT /api/v1/namespaces/default/pods/b8k 453\nI0818 11:43:17.350893 1 logs_generator.go:76] 34 PUT /api/v1/namespaces/default/pods/whkn 522\nI0818 11:43:17.550840 1 logs_generator.go:76] 35 PUT /api/v1/namespaces/kube-system/pods/kcvd 444\n" Aug 18 11:43:17.599: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-121 logs logs-generator logs-generator --since=24h' Aug 18 11:43:17.753: INFO: stderr: "" Aug 18 11:43:17.753: INFO: stdout: "I0818 11:43:10.550666 1 logs_generator.go:76] 0 POST /api/v1/namespaces/default/pods/nvgd 547\nI0818 11:43:10.750814 1 logs_generator.go:76] 1 POST /api/v1/namespaces/ns/pods/jd8r 200\nI0818 11:43:10.950802 1 logs_generator.go:76] 2 PUT /api/v1/namespaces/kube-system/pods/x296 223\nI0818 11:43:11.150732 1 logs_generator.go:76] 3 GET /api/v1/namespaces/ns/pods/sjl 450\nI0818 11:43:11.350852 1 logs_generator.go:76] 4 PUT /api/v1/namespaces/default/pods/wt9j 236\nI0818 11:43:11.550863 1 logs_generator.go:76] 5 PUT /api/v1/namespaces/kube-system/pods/k65 557\nI0818 11:43:11.750708 1 logs_generator.go:76] 6 POST /api/v1/namespaces/default/pods/crm 374\nI0818 11:43:11.951004 1 logs_generator.go:76] 7 GET /api/v1/namespaces/kube-system/pods/nlkd 332\nI0818 11:43:12.151150 1 logs_generator.go:76] 8 POST /api/v1/namespaces/default/pods/clnn 579\nI0818 11:43:12.350903 1 logs_generator.go:76] 9 PUT /api/v1/namespaces/ns/pods/kbb 497\nI0818 11:43:12.550896 1 logs_generator.go:76] 10 GET /api/v1/namespaces/default/pods/smhg 583\nI0818 11:43:12.750850 1 logs_generator.go:76] 11 POST /api/v1/namespaces/ns/pods/llfd 379\nI0818 11:43:12.950854 1 logs_generator.go:76] 12 POST /api/v1/namespaces/ns/pods/f54 219\nI0818 11:43:13.150840 1 logs_generator.go:76] 13 PUT /api/v1/namespaces/ns/pods/c9c 368\nI0818 11:43:13.350803 1 logs_generator.go:76] 14 GET /api/v1/namespaces/kube-system/pods/dk6b 271\nI0818 11:43:13.550858 1 logs_generator.go:76] 15 POST /api/v1/namespaces/ns/pods/xc4 380\nI0818 11:43:13.751226 1 logs_generator.go:76] 16 POST /api/v1/namespaces/ns/pods/87j 337\nI0818 11:43:13.951101 1 logs_generator.go:76] 17 POST /api/v1/namespaces/default/pods/8h2 465\nI0818 11:43:14.150958 1 logs_generator.go:76] 18 PUT /api/v1/namespaces/default/pods/tcz8 387\nI0818 11:43:14.350810 1 logs_generator.go:76] 19 PUT /api/v1/namespaces/default/pods/28q 275\nI0818 11:43:14.551065 1 logs_generator.go:76] 20 POST /api/v1/namespaces/kube-system/pods/w8mb 473\nI0818 11:43:14.750719 1 logs_generator.go:76] 21 PUT /api/v1/namespaces/ns/pods/w78n 507\nI0818 11:43:14.951301 1 logs_generator.go:76] 22 PUT /api/v1/namespaces/kube-system/pods/gdfv 293\nI0818 11:43:15.150984 1 logs_generator.go:76] 23 GET /api/v1/namespaces/kube-system/pods/hh7w 422\nI0818 11:43:15.350816 1 logs_generator.go:76] 24 PUT /api/v1/namespaces/ns/pods/bpdv 579\nI0818 11:43:15.550755 1 logs_generator.go:76] 25 POST /api/v1/namespaces/default/pods/f85 502\nI0818 11:43:15.750940 1 logs_generator.go:76] 26 POST /api/v1/namespaces/kube-system/pods/4zt 575\nI0818 11:43:15.951017 1 logs_generator.go:76] 27 GET /api/v1/namespaces/kube-system/pods/wl9z 457\nI0818 11:43:16.151358 1 logs_generator.go:76] 28 GET /api/v1/namespaces/kube-system/pods/7dd2 446\nI0818 11:43:16.350752 1 logs_generator.go:76] 29 GET /api/v1/namespaces/kube-system/pods/gm6 270\nI0818 11:43:16.551162 1 logs_generator.go:76] 30 GET /api/v1/namespaces/default/pods/rt6 551\nI0818 11:43:16.750844 1 logs_generator.go:76] 31 PUT /api/v1/namespaces/kube-system/pods/f9t 382\nI0818 11:43:16.950704 1 logs_generator.go:76] 32 POST /api/v1/namespaces/kube-system/pods/phzh 571\nI0818 11:43:17.151169 1 logs_generator.go:76] 33 PUT /api/v1/namespaces/default/pods/b8k 453\nI0818 11:43:17.350893 1 logs_generator.go:76] 34 PUT /api/v1/namespaces/default/pods/whkn 522\nI0818 11:43:17.550840 1 logs_generator.go:76] 35 PUT /api/v1/namespaces/kube-system/pods/kcvd 444\n" [AfterEach] Kubectl logs /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/kubectl.go:1390 Aug 18 11:43:17.754: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-121 delete pod logs-generator' Aug 18 11:43:31.173: INFO: stderr: "" Aug 18 11:43:31.173: INFO: stdout: "pod \"logs-generator\" deleted\n" [AfterEach] [sig-cli] Kubectl client /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:43:31.173: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "kubectl-121" for this suite. • [SLOW TEST:29.059 seconds] [sig-cli] Kubectl client /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/framework.go:23 Kubectl logs /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/kubectl.go:1382 should be able to retrieve and filter logs [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-cli] Kubectl client Kubectl logs should be able to retrieve and filter logs [Conformance]","total":-1,"completed":25,"skipped":613,"failed":3,"failures":["[sig-network] Services should be able to create a functioning NodePort service [Conformance]","[k8s.io] Pods should support retrieving logs from the container over websockets [NodeConformance] [Conformance]","[k8s.io] InitContainer [NodeConformance] should not start app containers if init containers fail on a RestartAlways pod [Conformance]"]} SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [k8s.io] Variable Expansion /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:39:31.673: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename var-expansion STEP: Waiting for a default service account to be provisioned in namespace [It] should allow substituting values in a container's args [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating a pod to test substitution in container's args Aug 18 11:39:31.706: INFO: Waiting up to 5m0s for pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e" in namespace "var-expansion-7502" to be "Succeeded or Failed" Aug 18 11:39:31.709: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 2.43774ms Aug 18 11:39:33.712: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 2.005425961s Aug 18 11:39:35.716: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 4.009431653s Aug 18 11:39:37.719: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 6.012604423s Aug 18 11:39:39.722: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 8.015717011s Aug 18 11:39:41.725: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 10.018944917s Aug 18 11:39:43.728: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 12.022217712s Aug 18 11:39:45.733: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 14.02636079s Aug 18 11:39:47.736: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 16.02965956s Aug 18 11:39:49.740: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 18.03332341s Aug 18 11:39:51.744: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 20.037520483s Aug 18 11:39:53.747: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 22.040440012s Aug 18 11:39:55.751: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 24.04512365s Aug 18 11:39:57.755: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 26.048611519s Aug 18 11:39:59.758: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 28.051495115s Aug 18 11:40:01.760: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 30.054156889s Aug 18 11:40:03.764: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 32.05741919s Aug 18 11:40:05.766: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 34.06009667s Aug 18 11:40:07.770: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 36.06421933s Aug 18 11:40:09.774: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 38.067444249s Aug 18 11:40:11.777: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 40.071065947s Aug 18 11:40:13.780: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 42.073622364s Aug 18 11:40:15.784: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 44.077941658s Aug 18 11:40:17.787: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 46.081216644s Aug 18 11:40:19.790: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 48.083926374s Aug 18 11:40:21.793: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 50.087208771s Aug 18 11:40:23.796: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 52.089849212s Aug 18 11:40:25.799: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 54.092926519s Aug 18 11:40:27.803: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 56.097073434s Aug 18 11:40:29.806: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 58.099510491s Aug 18 11:40:31.809: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.102833247s Aug 18 11:40:33.813: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.106252406s Aug 18 11:40:35.816: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.109694963s Aug 18 11:40:37.819: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.113013238s Aug 18 11:40:39.822: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.116216039s Aug 18 11:40:41.827: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.12100704s Aug 18 11:40:43.832: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.125586957s Aug 18 11:40:45.836: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.129516213s Aug 18 11:40:47.839: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.132712747s Aug 18 11:40:49.844: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.137377773s Aug 18 11:40:51.846: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.140037705s Aug 18 11:40:53.851: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.145049037s Aug 18 11:40:55.859: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.152588369s Aug 18 11:40:57.862: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.155432778s Aug 18 11:40:59.865: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.158870916s Aug 18 11:41:01.867: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.161203823s Aug 18 11:41:03.871: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.164621141s Aug 18 11:41:05.874: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.167687222s Aug 18 11:41:07.878: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.171736031s Aug 18 11:41:09.883: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.176528998s Aug 18 11:41:11.888: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.181499555s Aug 18 11:41:13.891: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.18508526s Aug 18 11:41:15.895: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.188860882s Aug 18 11:41:17.898: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.192038872s Aug 18 11:41:19.903: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.197137761s Aug 18 11:41:21.907: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.20049208s Aug 18 11:41:23.911: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.204841723s Aug 18 11:41:25.914: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.208112285s Aug 18 11:41:27.918: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.211487903s Aug 18 11:41:29.921: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.214441633s Aug 18 11:41:31.924: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.217496894s Aug 18 11:41:33.927: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.220306841s Aug 18 11:41:35.931: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.224491376s Aug 18 11:41:37.935: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.228585136s Aug 18 11:41:39.940: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.233612836s Aug 18 11:41:41.944: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.238152079s Aug 18 11:41:43.949: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.242801086s Aug 18 11:41:45.953: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.246899465s Aug 18 11:41:47.961: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.254978573s Aug 18 11:41:49.964: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.257935926s Aug 18 11:41:51.967: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.260385035s Aug 18 11:41:53.970: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.26331906s Aug 18 11:41:55.974: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.267233849s Aug 18 11:41:57.977: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.270464977s Aug 18 11:41:59.979: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.273092469s Aug 18 11:42:01.982: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.276154557s Aug 18 11:42:03.985: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.279051842s Aug 18 11:42:05.988: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.281833797s Aug 18 11:42:07.992: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.285472366s Aug 18 11:42:09.996: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.290179548s Aug 18 11:42:12.004: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.297713969s Aug 18 11:42:14.008: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.301455714s Aug 18 11:42:16.011: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.304494285s Aug 18 11:42:18.014: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.307613172s Aug 18 11:42:20.017: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.31086926s Aug 18 11:42:22.020: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.313738915s Aug 18 11:42:24.023: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.316960194s Aug 18 11:42:26.026: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.320176115s Aug 18 11:42:28.031: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.324294509s Aug 18 11:42:30.034: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.32794148s Aug 18 11:42:32.038: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.331665268s Aug 18 11:42:34.040: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.33409701s Aug 18 11:42:36.044: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.337699533s Aug 18 11:42:38.047: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.341193577s Aug 18 11:42:40.051: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.344538316s Aug 18 11:42:42.054: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.347501899s Aug 18 11:42:44.057: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.350527391s Aug 18 11:42:46.060: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.353528262s Aug 18 11:42:48.063: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.356464024s Aug 18 11:42:50.066: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.359940366s Aug 18 11:42:52.069: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.363050652s Aug 18 11:42:54.073: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.366709141s Aug 18 11:42:56.078: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.371944304s Aug 18 11:42:58.081: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.374915922s Aug 18 11:43:00.084: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.377851098s Aug 18 11:43:02.087: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.380639845s Aug 18 11:43:04.090: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.383271406s Aug 18 11:43:06.094: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.387430538s Aug 18 11:43:08.098: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.391718622s Aug 18 11:43:10.102: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.395504825s Aug 18 11:43:12.106: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.400006815s Aug 18 11:43:14.111: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.404376008s Aug 18 11:43:16.114: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.40783546s Aug 18 11:43:18.118: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.411596572s Aug 18 11:43:20.121: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.41429398s Aug 18 11:43:22.124: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.418115152s Aug 18 11:43:24.128: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.421550309s Aug 18 11:43:26.131: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.424569559s Aug 18 11:43:28.135: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.428254617s Aug 18 11:43:30.139: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.432621368s Aug 18 11:43:32.144: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.437533401s Aug 18 11:43:34.147: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.441094153s Aug 18 11:43:36.152: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.446091019s Aug 18 11:43:38.156: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.450010893s Aug 18 11:43:40.159: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.453075661s Aug 18 11:43:42.163: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.456612894s Aug 18 11:43:44.166: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.460132687s Aug 18 11:43:46.171: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.464699556s Aug 18 11:43:48.176: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.469621346s Aug 18 11:43:50.179: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.472844192s Aug 18 11:43:52.182: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.476125066s Aug 18 11:43:54.186: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.480115822s Aug 18 11:43:56.190: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.483234211s Aug 18 11:43:58.193: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.486886763s Aug 18 11:44:00.197: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.490518778s Aug 18 11:44:02.200: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.493835061s Aug 18 11:44:04.203: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.497132702s Aug 18 11:44:06.207: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.500557235s Aug 18 11:44:08.210: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.503474076s Aug 18 11:44:10.213: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.506901516s Aug 18 11:44:12.218: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.511485743s Aug 18 11:44:14.220: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.514159115s Aug 18 11:44:16.224: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.517246646s Aug 18 11:44:18.227: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.520530742s Aug 18 11:44:20.230: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.523891657s Aug 18 11:44:22.234: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.52730356s Aug 18 11:44:24.237: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.530979492s Aug 18 11:44:26.240: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.533934832s Aug 18 11:44:28.244: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.537379324s Aug 18 11:44:30.246: INFO: Pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.540086991s Aug 18 11:44:32.255: INFO: Failed to get logs from node "node2" pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e" container "dapi-container": the server rejected our request for an unknown reason (get pods var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e) STEP: delete the pod Aug 18 11:44:32.261: INFO: Waiting for pod var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e to disappear Aug 18 11:44:32.264: INFO: Pod var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e still exists Aug 18 11:44:34.264: INFO: Waiting for pod var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e to disappear Aug 18 11:44:34.266: INFO: Pod var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e no longer exists Aug 18 11:44:34.267: FAIL: Unexpected error: <*errors.errorString | 0xc0004c7820>: { s: "expected pod \"var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e\" success: Gave up after waiting 5m0s for pod \"var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e\" to be \"Succeeded or Failed\"", } expected pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e" success: Gave up after waiting 5m0s for pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e" to be "Succeeded or Failed" occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).testContainerOutputMatcher(0xc0001b6160, 0x4c79937, 0x20, 0xc001462000, 0x0, 0xc00807d1c8, 0x1, 0x1, 0x4deefa8) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 +0x1ee k8s.io/kubernetes/test/e2e/framework.(*Framework).TestContainerOutput(...) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:525 k8s.io/kubernetes/test/e2e/common.glob..func9.3() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/expansion.go:99 +0x1fb k8s.io/kubernetes/test/e2e.RunE2ETests(0xc00393c780) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc00393c780) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc00393c780, 0x4deb2c0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] Variable Expansion /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "var-expansion-7502". STEP: Found 9 events. Aug 18 11:44:34.271: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e: { } Scheduled: Successfully assigned var-expansion-7502/var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e to node2 Aug 18 11:44:34.271: INFO: At 2021-08-18 11:39:33 +0000 UTC - event for var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e: {multus } AddedInterface: Add eth0 [10.244.3.34/24] Aug 18 11:44:34.271: INFO: At 2021-08-18 11:39:33 +0000 UTC - event for var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e: {kubelet node2} Pulling: Pulling image "docker.io/library/busybox:1.29" Aug 18 11:44:34.271: INFO: At 2021-08-18 11:39:34 +0000 UTC - event for var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e: {kubelet node2} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit Aug 18 11:44:34.271: INFO: At 2021-08-18 11:39:34 +0000 UTC - event for var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e: {kubelet node2} Failed: Error: ErrImagePull Aug 18 11:44:34.271: INFO: At 2021-08-18 11:39:34 +0000 UTC - event for var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e: {kubelet node2} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Aug 18 11:44:34.271: INFO: At 2021-08-18 11:39:36 +0000 UTC - event for var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e: {multus } AddedInterface: Add eth0 [10.244.3.35/24] Aug 18 11:44:34.271: INFO: At 2021-08-18 11:39:36 +0000 UTC - event for var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e: {kubelet node2} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" Aug 18 11:44:34.271: INFO: At 2021-08-18 11:39:36 +0000 UTC - event for var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e: {kubelet node2} Failed: Error: ImagePullBackOff Aug 18 11:44:34.273: INFO: POD NODE PHASE GRACE CONDITIONS Aug 18 11:44:34.273: INFO: Aug 18 11:44:34.277: INFO: Logging node info for node master1 Aug 18 11:44:34.279: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 ebb211fa-503f-4cfe-b1ed-c95d27a70e6e 68568 0 2021-08-18 08:20:52 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"3a:82:be:72:b5:15"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:20:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:20:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:25:59 +0000 UTC,LastTransitionTime:2021-08-18 08:25:59 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:44:26 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:44:26 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:44:26 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:44:26 +0000 UTC,LastTransitionTime:2021-08-18 08:25:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:58c3e57359b641ad92fa1959f2fecf5d,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:012cd796-2076-45d6-8b14-d3e0451b1e64,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[@ :],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:44:34.280: INFO: Logging kubelet events for node master1 Aug 18 11:44:34.282: INFO: Logging pods the kubelet thinks is on node master1 Aug 18 11:44:34.297: INFO: kube-controller-manager-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:34.297: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:44:34.297: INFO: kube-multus-ds-amd64-kbcp6 started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:34.297: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:44:34.297: INFO: docker-registry-docker-registry-56cbc7bc58-49kl2 started at 2021-08-18 08:26:23 +0000 UTC (0+2 container statuses recorded) Aug 18 11:44:34.297: INFO: Container docker-registry ready: true, restart count 0 Aug 18 11:44:34.297: INFO: Container nginx ready: true, restart count 0 Aug 18 11:44:34.297: INFO: node-exporter-5hwz9 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:44:34.297: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:44:34.297: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:44:34.297: INFO: kube-apiserver-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:34.297: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:44:34.297: INFO: kube-proxy-vqk4v started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:34.297: INFO: Container kube-proxy ready: true, restart count 1 Aug 18 11:44:34.297: INFO: kube-flannel-q64cq started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:44:34.297: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:44:34.297: INFO: Container kube-flannel ready: true, restart count 3 Aug 18 11:44:34.297: INFO: coredns-7677f9bb54-kn2qg started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:34.297: INFO: Container coredns ready: true, restart count 2 Aug 18 11:44:34.297: INFO: kube-scheduler-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:34.297: INFO: Container kube-scheduler ready: true, restart count 0 W0818 11:44:34.309865 29 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:44:34.335: INFO: Latency metrics for node master1 Aug 18 11:44:34.335: INFO: Logging node info for node master2 Aug 18 11:44:34.337: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 78946293-3abe-4442-84d4-8ed6b1d15ce0 68560 0 2021-08-18 08:21:31 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"7e:f5:c2:cc:3a:b4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:21:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:21:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-08-18 08:29:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:44:25 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:44:25 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:44:25 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:44:25 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0c44122c7a7248c18d8571e1cc667258,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:0cd329f2-48e0-4c8f-b8b9-fa3ae0ed8406,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:44:34.338: INFO: Logging kubelet events for node master2 Aug 18 11:44:34.340: INFO: Logging pods the kubelet thinks is on node master2 Aug 18 11:44:34.352: INFO: node-exporter-48nfx started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:44:34.352: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:44:34.352: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:44:34.352: INFO: kube-apiserver-master2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:34.352: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:44:34.352: INFO: kube-scheduler-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:34.352: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:44:34.352: INFO: kube-multus-ds-amd64-mld8g started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:34.352: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:44:34.352: INFO: dns-autoscaler-5b7b5c9b6f-hh47r started at 2021-08-18 08:23:57 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:34.352: INFO: Container autoscaler ready: true, restart count 2 Aug 18 11:44:34.352: INFO: node-feature-discovery-controller-5bf5c49849-mq57c started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:34.352: INFO: Container nfd-controller ready: true, restart count 0 Aug 18 11:44:34.352: INFO: kube-controller-manager-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:34.352: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:44:34.352: INFO: kube-proxy-kh2l9 started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:34.352: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:44:34.352: INFO: kube-flannel-pp56h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:44:34.352: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:44:34.352: INFO: Container kube-flannel ready: true, restart count 1 W0818 11:44:34.365802 29 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:44:34.391: INFO: Latency metrics for node master2 Aug 18 11:44:34.391: INFO: Logging node info for node master3 Aug 18 11:44:34.394: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 44feac2b-9447-4be2-9fcd-62f836d67c72 68586 0 2021-08-18 08:21:41 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"86:e4:31:99:58:40"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {kubelet Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:44:30 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:44:30 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:44:30 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:44:30 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1fae19ae59884c44899bcd08aa243244,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:5db926c5-6530-4635-a0d5-806974a3b732,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:44:34.395: INFO: Logging kubelet events for node master3 Aug 18 11:44:34.397: INFO: Logging pods the kubelet thinks is on node master3 Aug 18 11:44:34.410: INFO: kube-scheduler-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:34.410: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:44:34.410: INFO: kube-apiserver-master3 started at 2021-08-18 08:29:12 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:34.410: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:44:34.410: INFO: kube-proxy-sd5lc started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:34.410: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:44:34.410: INFO: kube-flannel-x6tlr started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:44:34.410: INFO: Init container install-cni ready: true, restart count 1 Aug 18 11:44:34.410: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:44:34.410: INFO: kube-multus-ds-amd64-bkw6c started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:34.410: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:44:34.410: INFO: coredns-7677f9bb54-5hxfh started at 2021-08-18 08:23:54 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:34.410: INFO: Container coredns ready: true, restart count 1 Aug 18 11:44:34.410: INFO: node-exporter-vq7d8 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:44:34.410: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:44:34.410: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:44:34.410: INFO: kube-controller-manager-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:34.410: INFO: Container kube-controller-manager ready: true, restart count 2 W0818 11:44:34.424002 29 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:44:34.450: INFO: Latency metrics for node master3 Aug 18 11:44:34.451: INFO: Logging node info for node node1 Aug 18 11:44:34.453: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 84defabd-6ebf-43ec-a629-44c6713da9c9 68580 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"9a:87:55:36:7b:df"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:13 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:35 +0000 UTC,LastTransitionTime:2021-08-18 08:26:35 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:44:28 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:44:28 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:44:28 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:44:28 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:69946ff2b7bc462fa25eb7adb4703c23,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:736dc52f-f5e3-494e-86ca-01eedbea015c,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:a7cea43d9d2f67c38fbf0407786edbe660ee9072945f7bb272b55fd255e8eaca opnfv/barometer-collectd:stable],SizeBytes:1075746799,},ContainerImage{Names:[@ :],SizeBytes:1003788820,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[aquasec/kube-hunter@sha256:2be6820bc1d7e0f57193a9a27d5a3e16b2fd93c53747b03ce8ca48c6fc323781 aquasec/kube-hunter:0.3.1],SizeBytes:347611549,},ContainerImage{Names:[golang@sha256:db2475a1dbb2149508e5db31d7d77a75e6600d54be645f37681f03f2762169ba golang:alpine3.12],SizeBytes:301186719,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:de25c7fc6c4f3a27c7f0c2dff454e4671823a34d88abd533f210848d527e0fbb alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:44:34.454: INFO: Logging kubelet events for node node1 Aug 18 11:44:34.456: INFO: Logging pods the kubelet thinks is on node node1 Aug 18 11:44:34.478: INFO: busybox-scheduling-f75e615f-f2c3-4e61-8ed7-848c386f63d3 started at 2021-08-18 11:40:13 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:34.478: INFO: Container busybox-scheduling-f75e615f-f2c3-4e61-8ed7-848c386f63d3 ready: false, restart count 0 Aug 18 11:44:34.478: INFO: kube-proxy-p6jvp started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:34.478: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:44:34.478: INFO: kubernetes-metrics-scraper-678c97765c-9nsv5 started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:34.478: INFO: Container kubernetes-metrics-scraper ready: true, restart count 2 Aug 18 11:44:34.478: INFO: cmk-init-discover-node1-bxznx started at 2021-08-18 08:32:10 +0000 UTC (0+3 container statuses recorded) Aug 18 11:44:34.478: INFO: Container discover ready: false, restart count 0 Aug 18 11:44:34.478: INFO: Container init ready: false, restart count 0 Aug 18 11:44:34.478: INFO: Container install ready: false, restart count 0 Aug 18 11:44:34.478: INFO: cmk-d8r27 started at 2021-08-18 08:32:52 +0000 UTC (0+2 container statuses recorded) Aug 18 11:44:34.478: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:44:34.478: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:44:34.478: INFO: collectd-xdprr started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:44:34.478: INFO: Container collectd ready: true, restart count 0 Aug 18 11:44:34.478: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:44:34.478: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:44:34.478: INFO: pod-service-account-mountsa started at 2021-08-18 11:43:02 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:34.478: INFO: Container token-test ready: false, restart count 0 Aug 18 11:44:34.478: INFO: nginx-proxy-node1 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:34.478: INFO: Container nginx-proxy ready: true, restart count 2 Aug 18 11:44:34.478: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-vsxvg started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:34.478: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:44:34.478: INFO: fail-once-local-8rxnh started at 2021-08-18 11:34:14 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:34.478: INFO: Container c ready: false, restart count 0 Aug 18 11:44:34.478: INFO: busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665 started at 2021-08-18 11:41:33 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:34.478: INFO: Container busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665 ready: false, restart count 0 Aug 18 11:44:34.478: INFO: test-webserver-6d6ecfd9-c69b-4d5b-867a-e2160ea50524 started at 2021-08-18 11:42:58 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:34.478: INFO: Container test-webserver ready: true, restart count 0 Aug 18 11:44:34.478: INFO: termination-message-container0695240e-6103-4528-845b-e45cb7a8bd7f started at 2021-08-18 11:43:31 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:34.478: INFO: Container termination-message-container ready: false, restart count 0 Aug 18 11:44:34.478: INFO: kube-flannel-q78nd started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:44:34.478: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:44:34.478: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:44:34.478: INFO: prometheus-k8s-0 started at 2021-08-18 08:34:03 +0000 UTC (0+5 container statuses recorded) Aug 18 11:44:34.478: INFO: Container custom-metrics-apiserver ready: true, restart count 0 Aug 18 11:44:34.478: INFO: Container grafana ready: true, restart count 0 Aug 18 11:44:34.478: INFO: Container prometheus ready: true, restart count 1 Aug 18 11:44:34.478: INFO: Container prometheus-config-reloader ready: true, restart count 0 Aug 18 11:44:34.478: INFO: Container rules-configmap-reloader ready: true, restart count 0 Aug 18 11:44:34.478: INFO: kube-multus-ds-amd64-rrvmb started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:34.478: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:44:34.478: INFO: node-feature-discovery-worker-pflgw started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:34.478: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:44:34.478: INFO: node-exporter-kcwvn started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:44:34.478: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:44:34.478: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:44:34.478: INFO: pod-adoption-release started at 2021-08-18 11:41:47 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:34.478: INFO: Container pod-adoption-release ready: false, restart count 0 W0818 11:44:34.489564 29 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:44:34.527: INFO: Latency metrics for node node1 Aug 18 11:44:34.527: INFO: Logging node info for node node2 Aug 18 11:44:34.530: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 1d01177e-3dbb-48a1-a0bc-d18af27ab7f8 68574 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:d1:47:f8:1d:22"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:36 +0000 UTC,LastTransitionTime:2021-08-18 08:26:36 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:44:27 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:44:27 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:44:27 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:44:27 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:dc1f286135c145349b8a016880b65a2f,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:037e7e2d-94e9-42f4-a719-896e5005ac70,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:44:34.531: INFO: Logging kubelet events for node node2 Aug 18 11:44:34.533: INFO: Logging pods the kubelet thinks is on node node2 Aug 18 11:44:34.545: INFO: cmk-webhook-6c9d5f8578-7cxjr started at 2021-08-18 08:32:53 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:34.546: INFO: Container cmk-webhook ready: true, restart count 0 Aug 18 11:44:34.546: INFO: termination-message-containerd34235c0-885f-4596-b8e2-47db8d79aee8 started at 2021-08-18 11:42:58 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:34.546: INFO: Container termination-message-container ready: false, restart count 0 Aug 18 11:44:34.546: INFO: kube-flannel-h7t5h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:44:34.546: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:44:34.546: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:44:34.546: INFO: node-exporter-lrrf2 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:44:34.546: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:44:34.546: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:44:34.546: INFO: pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5 started at 2021-08-18 11:42:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:34.546: INFO: Container env-test ready: false, restart count 0 Aug 18 11:44:34.546: INFO: nginx-proxy-node2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:34.546: INFO: Container nginx-proxy ready: true, restart count 1 Aug 18 11:44:34.546: INFO: cmk-init-discover-node2-6b2kz started at 2021-08-18 08:32:30 +0000 UTC (0+3 container statuses recorded) Aug 18 11:44:34.546: INFO: Container discover ready: false, restart count 0 Aug 18 11:44:34.546: INFO: Container init ready: false, restart count 0 Aug 18 11:44:34.546: INFO: Container install ready: false, restart count 0 Aug 18 11:44:34.546: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-7rn45 started at 2021-08-18 08:36:42 +0000 UTC (0+2 container statuses recorded) Aug 18 11:44:34.546: INFO: Container tas-controller ready: true, restart count 0 Aug 18 11:44:34.546: INFO: Container tas-extender ready: true, restart count 0 Aug 18 11:44:34.546: INFO: downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1 started at 2021-08-18 11:39:54 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:34.546: INFO: Container dapi-container ready: false, restart count 0 Aug 18 11:44:34.546: INFO: fail-once-local-pk5cs started at 2021-08-18 11:34:14 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:34.546: INFO: Container c ready: false, restart count 0 Aug 18 11:44:34.546: INFO: kubernetes-dashboard-86c6f9df5b-qrtdk started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:34.546: INFO: Container kubernetes-dashboard ready: true, restart count 2 Aug 18 11:44:34.546: INFO: cmk-748rz started at 2021-08-18 08:32:53 +0000 UTC (0+2 container statuses recorded) Aug 18 11:44:34.546: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:44:34.546: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:44:34.546: INFO: kube-proxy-qkj9c started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:34.546: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:44:34.546: INFO: node-feature-discovery-worker-hzpf5 started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:34.546: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:44:34.546: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-c82pt started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:34.546: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:44:34.546: INFO: prometheus-operator-5bb8cb9d8f-k97ws started at 2021-08-18 08:33:38 +0000 UTC (0+2 container statuses recorded) Aug 18 11:44:34.546: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:44:34.546: INFO: Container prometheus-operator ready: true, restart count 0 Aug 18 11:44:34.546: INFO: kube-multus-ds-amd64-rvzsg started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:34.546: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:44:34.546: INFO: collectd-67ntq started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:44:34.546: INFO: Container collectd ready: true, restart count 0 Aug 18 11:44:34.546: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:44:34.546: INFO: Container rbac-proxy ready: true, restart count 0 W0818 11:44:34.558574 29 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:44:34.589: INFO: Latency metrics for node node2 Aug 18 11:44:34.589: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "var-expansion-7502" for this suite. • Failure [302.924 seconds] [k8s.io] Variable Expansion /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 should allow substituting values in a container's args [NodeConformance] [Conformance] [It] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:44:34.267: Unexpected error: <*errors.errorString | 0xc0004c7820>: { s: "expected pod \"var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e\" success: Gave up after waiting 5m0s for pod \"var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e\" to be \"Succeeded or Failed\"", } expected pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e" success: Gave up after waiting 5m0s for pod "var-expansion-2cea499e-935b-45e9-b736-9cefe60cd68e" to be "Succeeded or Failed" occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 ------------------------------ {"msg":"FAILED [k8s.io] Variable Expansion should allow substituting values in a container's args [NodeConformance] [Conformance]","total":-1,"completed":22,"skipped":431,"failed":3,"failures":["[k8s.io] InitContainer [NodeConformance] should invoke init containers on a RestartAlways pod [Conformance]","[k8s.io] Pods should allow activeDeadlineSeconds to be updated [NodeConformance] [Conformance]","[k8s.io] Variable Expansion should allow substituting values in a container's args [NodeConformance] [Conformance]"]} SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-api-machinery] Servers with support for Table transformation /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:44:34.699: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename tables STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-api-machinery] Servers with support for Table transformation /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/table_conversion.go:47 [It] should return a 406 for a backend which does not implement metadata [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 [AfterEach] [sig-api-machinery] Servers with support for Table transformation /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:44:34.726: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "tables-700" for this suite. • ------------------------------ {"msg":"PASSED [sig-api-machinery] Servers with support for Table transformation should return a 406 for a backend which does not implement metadata [Conformance]","total":-1,"completed":23,"skipped":474,"failed":3,"failures":["[k8s.io] InitContainer [NodeConformance] should invoke init containers on a RestartAlways pod [Conformance]","[k8s.io] Pods should allow activeDeadlineSeconds to be updated [NodeConformance] [Conformance]","[k8s.io] Variable Expansion should allow substituting values in a container's args [NodeConformance] [Conformance]"]} SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-cli] Kubectl client /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:44:34.884: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename kubectl STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-cli] Kubectl client /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/kubectl.go:247 [It] should support --unix-socket=/path [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Starting the proxy Aug 18 11:44:34.904: INFO: Asynchronously running '/usr/local/bin/kubectl kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-9001 proxy --unix-socket=/tmp/kubectl-proxy-unix188820329/test' STEP: retrieving proxy /api/ output [AfterEach] [sig-cli] Kubectl client /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:44:34.989: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "kubectl-9001" for this suite. • ------------------------------ {"msg":"PASSED [sig-cli] Kubectl client Proxy server should support --unix-socket=/path [Conformance]","total":-1,"completed":24,"skipped":546,"failed":3,"failures":["[k8s.io] InitContainer [NodeConformance] should invoke init containers on a RestartAlways pod [Conformance]","[k8s.io] Pods should allow activeDeadlineSeconds to be updated [NodeConformance] [Conformance]","[k8s.io] Variable Expansion should allow substituting values in a container's args [NodeConformance] [Conformance]"]} S ------------------------------ [BeforeEach] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:44:35.002: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename crd-publish-openapi STEP: Waiting for a default service account to be provisioned in namespace [It] works for CRD with validation schema [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:44:35.022: INFO: >>> kubeConfig: /root/.kube/config STEP: client-side validation (kubectl create and apply) allows request with known and required properties Aug 18 11:44:42.938: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=crd-publish-openapi-6797 --namespace=crd-publish-openapi-6797 create -f -' Aug 18 11:44:43.352: INFO: stderr: "" Aug 18 11:44:43.352: INFO: stdout: "e2e-test-crd-publish-openapi-803-crd.crd-publish-openapi-test-foo.example.com/test-foo created\n" Aug 18 11:44:43.352: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=crd-publish-openapi-6797 --namespace=crd-publish-openapi-6797 delete e2e-test-crd-publish-openapi-803-crds test-foo' Aug 18 11:44:43.508: INFO: stderr: "" Aug 18 11:44:43.508: INFO: stdout: "e2e-test-crd-publish-openapi-803-crd.crd-publish-openapi-test-foo.example.com \"test-foo\" deleted\n" Aug 18 11:44:43.508: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=crd-publish-openapi-6797 --namespace=crd-publish-openapi-6797 apply -f -' Aug 18 11:44:43.786: INFO: stderr: "" Aug 18 11:44:43.786: INFO: stdout: "e2e-test-crd-publish-openapi-803-crd.crd-publish-openapi-test-foo.example.com/test-foo created\n" Aug 18 11:44:43.787: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=crd-publish-openapi-6797 --namespace=crd-publish-openapi-6797 delete e2e-test-crd-publish-openapi-803-crds test-foo' Aug 18 11:44:43.946: INFO: stderr: "" Aug 18 11:44:43.946: INFO: stdout: "e2e-test-crd-publish-openapi-803-crd.crd-publish-openapi-test-foo.example.com \"test-foo\" deleted\n" STEP: client-side validation (kubectl create and apply) rejects request with unknown properties when disallowed by the schema Aug 18 11:44:43.947: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=crd-publish-openapi-6797 --namespace=crd-publish-openapi-6797 create -f -' Aug 18 11:44:44.192: INFO: rc: 1 Aug 18 11:44:44.193: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=crd-publish-openapi-6797 --namespace=crd-publish-openapi-6797 apply -f -' Aug 18 11:44:44.467: INFO: rc: 1 STEP: client-side validation (kubectl create and apply) rejects request without required properties Aug 18 11:44:44.467: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=crd-publish-openapi-6797 --namespace=crd-publish-openapi-6797 create -f -' Aug 18 11:44:44.744: INFO: rc: 1 Aug 18 11:44:44.744: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=crd-publish-openapi-6797 --namespace=crd-publish-openapi-6797 apply -f -' Aug 18 11:44:44.956: INFO: rc: 1 STEP: kubectl explain works to explain CR properties Aug 18 11:44:44.956: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=crd-publish-openapi-6797 explain e2e-test-crd-publish-openapi-803-crds' Aug 18 11:44:45.230: INFO: stderr: "" Aug 18 11:44:45.230: INFO: stdout: "KIND: E2e-test-crd-publish-openapi-803-crd\nVERSION: crd-publish-openapi-test-foo.example.com/v1\n\nDESCRIPTION:\n Foo CRD for Testing\n\nFIELDS:\n apiVersion\t\n APIVersion defines the versioned schema of this representation of an\n object. Servers should convert recognized schemas to the latest internal\n value, and may reject unrecognized values. More info:\n https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#resources\n\n kind\t\n Kind is a string value representing the REST resource this object\n represents. Servers may infer this from the endpoint the client submits\n requests to. Cannot be updated. In CamelCase. More info:\n https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#types-kinds\n\n metadata\t\n Standard object's metadata. More info:\n https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#metadata\n\n spec\t\n Specification of Foo\n\n status\t\n Status of Foo\n\n" STEP: kubectl explain works to explain CR properties recursively Aug 18 11:44:45.231: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=crd-publish-openapi-6797 explain e2e-test-crd-publish-openapi-803-crds.metadata' Aug 18 11:44:45.524: INFO: stderr: "" Aug 18 11:44:45.524: INFO: stdout: "KIND: E2e-test-crd-publish-openapi-803-crd\nVERSION: crd-publish-openapi-test-foo.example.com/v1\n\nRESOURCE: metadata \n\nDESCRIPTION:\n Standard object's metadata. More info:\n https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#metadata\n\n ObjectMeta is metadata that all persisted resources must have, which\n includes all objects users must create.\n\nFIELDS:\n annotations\t\n Annotations is an unstructured key value map stored with a resource that\n may be set by external tools to store and retrieve arbitrary metadata. They\n are not queryable and should be preserved when modifying objects. More\n info: http://kubernetes.io/docs/user-guide/annotations\n\n clusterName\t\n The name of the cluster which the object belongs to. This is used to\n distinguish resources with same name and namespace in different clusters.\n This field is not set anywhere right now and apiserver is going to ignore\n it if set in create or update request.\n\n creationTimestamp\t\n CreationTimestamp is a timestamp representing the server time when this\n object was created. It is not guaranteed to be set in happens-before order\n across separate operations. Clients may not set this value. It is\n represented in RFC3339 form and is in UTC.\n\n Populated by the system. Read-only. Null for lists. More info:\n https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#metadata\n\n deletionGracePeriodSeconds\t\n Number of seconds allowed for this object to gracefully terminate before it\n will be removed from the system. Only set when deletionTimestamp is also\n set. May only be shortened. Read-only.\n\n deletionTimestamp\t\n DeletionTimestamp is RFC 3339 date and time at which this resource will be\n deleted. This field is set by the server when a graceful deletion is\n requested by the user, and is not directly settable by a client. The\n resource is expected to be deleted (no longer visible from resource lists,\n and not reachable by name) after the time in this field, once the\n finalizers list is empty. As long as the finalizers list contains items,\n deletion is blocked. Once the deletionTimestamp is set, this value may not\n be unset or be set further into the future, although it may be shortened or\n the resource may be deleted prior to this time. For example, a user may\n request that a pod is deleted in 30 seconds. The Kubelet will react by\n sending a graceful termination signal to the containers in the pod. After\n that 30 seconds, the Kubelet will send a hard termination signal (SIGKILL)\n to the container and after cleanup, remove the pod from the API. In the\n presence of network partitions, this object may still exist after this\n timestamp, until an administrator or automated process can determine the\n resource is fully terminated. If not set, graceful deletion of the object\n has not been requested.\n\n Populated by the system when a graceful deletion is requested. Read-only.\n More info:\n https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#metadata\n\n finalizers\t<[]string>\n Must be empty before the object is deleted from the registry. Each entry is\n an identifier for the responsible component that will remove the entry from\n the list. If the deletionTimestamp of the object is non-nil, entries in\n this list can only be removed. Finalizers may be processed and removed in\n any order. Order is NOT enforced because it introduces significant risk of\n stuck finalizers. finalizers is a shared field, any actor with permission\n can reorder it. If the finalizer list is processed in order, then this can\n lead to a situation in which the component responsible for the first\n finalizer in the list is waiting for a signal (field value, external\n system, or other) produced by a component responsible for a finalizer later\n in the list, resulting in a deadlock. Without enforced ordering finalizers\n are free to order amongst themselves and are not vulnerable to ordering\n changes in the list.\n\n generateName\t\n GenerateName is an optional prefix, used by the server, to generate a\n unique name ONLY IF the Name field has not been provided. If this field is\n used, the name returned to the client will be different than the name\n passed. This value will also be combined with a unique suffix. The provided\n value has the same validation rules as the Name field, and may be truncated\n by the length of the suffix required to make the value unique on the\n server.\n\n If this field is specified and the generated name exists, the server will\n NOT return a 409 - instead, it will either return 201 Created or 500 with\n Reason ServerTimeout indicating a unique name could not be found in the\n time allotted, and the client should retry (optionally after the time\n indicated in the Retry-After header).\n\n Applied only if Name is not specified. More info:\n https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#idempotency\n\n generation\t\n A sequence number representing a specific generation of the desired state.\n Populated by the system. Read-only.\n\n labels\t\n Map of string keys and values that can be used to organize and categorize\n (scope and select) objects. May match selectors of replication controllers\n and services. More info: http://kubernetes.io/docs/user-guide/labels\n\n managedFields\t<[]Object>\n ManagedFields maps workflow-id and version to the set of fields that are\n managed by that workflow. This is mostly for internal housekeeping, and\n users typically shouldn't need to set or understand this field. A workflow\n can be the user's name, a controller's name, or the name of a specific\n apply path like \"ci-cd\". The set of fields is always in the version that\n the workflow used when modifying the object.\n\n name\t\n Name must be unique within a namespace. Is required when creating\n resources, although some resources may allow a client to request the\n generation of an appropriate name automatically. Name is primarily intended\n for creation idempotence and configuration definition. Cannot be updated.\n More info: http://kubernetes.io/docs/user-guide/identifiers#names\n\n namespace\t\n Namespace defines the space within which each name must be unique. An empty\n namespace is equivalent to the \"default\" namespace, but \"default\" is the\n canonical representation. Not all objects are required to be scoped to a\n namespace - the value of this field for those objects will be empty.\n\n Must be a DNS_LABEL. Cannot be updated. More info:\n http://kubernetes.io/docs/user-guide/namespaces\n\n ownerReferences\t<[]Object>\n List of objects depended by this object. If ALL objects in the list have\n been deleted, this object will be garbage collected. If this object is\n managed by a controller, then an entry in this list will point to this\n controller, with the controller field set to true. There cannot be more\n than one managing controller.\n\n resourceVersion\t\n An opaque value that represents the internal version of this object that\n can be used by clients to determine when objects have changed. May be used\n for optimistic concurrency, change detection, and the watch operation on a\n resource or set of resources. Clients must treat these values as opaque and\n passed unmodified back to the server. They may only be valid for a\n particular resource or set of resources.\n\n Populated by the system. Read-only. Value must be treated as opaque by\n clients and . More info:\n https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#concurrency-control-and-consistency\n\n selfLink\t\n SelfLink is a URL representing this object. Populated by the system.\n Read-only.\n\n DEPRECATED Kubernetes will stop propagating this field in 1.20 release and\n the field is planned to be removed in 1.21 release.\n\n uid\t\n UID is the unique in time and space value for this object. It is typically\n generated by the server on successful creation of a resource and is not\n allowed to change on PUT operations.\n\n Populated by the system. Read-only. More info:\n http://kubernetes.io/docs/user-guide/identifiers#uids\n\n" Aug 18 11:44:45.525: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=crd-publish-openapi-6797 explain e2e-test-crd-publish-openapi-803-crds.spec' Aug 18 11:44:45.840: INFO: stderr: "" Aug 18 11:44:45.840: INFO: stdout: "KIND: E2e-test-crd-publish-openapi-803-crd\nVERSION: crd-publish-openapi-test-foo.example.com/v1\n\nRESOURCE: spec \n\nDESCRIPTION:\n Specification of Foo\n\nFIELDS:\n bars\t<[]Object>\n List of Bars and their specs.\n\n" Aug 18 11:44:45.840: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=crd-publish-openapi-6797 explain e2e-test-crd-publish-openapi-803-crds.spec.bars' Aug 18 11:44:46.100: INFO: stderr: "" Aug 18 11:44:46.100: INFO: stdout: "KIND: E2e-test-crd-publish-openapi-803-crd\nVERSION: crd-publish-openapi-test-foo.example.com/v1\n\nRESOURCE: bars <[]Object>\n\nDESCRIPTION:\n List of Bars and their specs.\n\nFIELDS:\n age\t\n Age of Bar.\n\n bazs\t<[]string>\n List of Bazs.\n\n name\t -required-\n Name of Bar.\n\n" STEP: kubectl explain works to return error when explain is called on property that doesn't exist Aug 18 11:44:46.101: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=crd-publish-openapi-6797 explain e2e-test-crd-publish-openapi-803-crds.spec.bars2' Aug 18 11:44:46.390: INFO: rc: 1 [AfterEach] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:44:49.272: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "crd-publish-openapi-6797" for this suite. • [SLOW TEST:14.278 seconds] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23 works for CRD with validation schema [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] works for CRD with validation schema [Conformance]","total":-1,"completed":25,"skipped":547,"failed":3,"failures":["[k8s.io] InitContainer [NodeConformance] should invoke init containers on a RestartAlways pod [Conformance]","[k8s.io] Pods should allow activeDeadlineSeconds to be updated [NodeConformance] [Conformance]","[k8s.io] Variable Expansion should allow substituting values in a container's args [NodeConformance] [Conformance]"]} SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ {"msg":"PASSED [k8s.io] Probing container with readiness probe that fails should never be ready and never restart [NodeConformance] [Conformance]","total":-1,"completed":15,"skipped":206,"failed":2,"failures":["[sig-apps] Deployment deployment should support rollover [Conformance]","[sig-network] Services should be able to switch session affinity for NodePort service [LinuxOnly] [Conformance]"]} [BeforeEach] [sig-node] Downward API /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:39:54.327: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename downward-api STEP: Waiting for a default service account to be provisioned in namespace [It] should provide container's limits.cpu/memory and requests.cpu/memory as env vars [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating a pod to test downward api env vars Aug 18 11:39:54.362: INFO: Waiting up to 5m0s for pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1" in namespace "downward-api-8566" to be "Succeeded or Failed" Aug 18 11:39:54.364: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 1.919661ms Aug 18 11:39:56.368: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 2.005385751s Aug 18 11:39:58.371: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 4.008831651s Aug 18 11:40:00.374: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 6.012089988s Aug 18 11:40:02.378: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 8.015625972s Aug 18 11:40:04.382: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 10.019770963s Aug 18 11:40:06.388: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 12.025861124s Aug 18 11:40:08.393: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 14.030777243s Aug 18 11:40:10.396: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 16.033963467s Aug 18 11:40:12.400: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 18.038226276s Aug 18 11:40:14.404: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 20.041390708s Aug 18 11:40:16.407: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 22.045260733s Aug 18 11:40:18.411: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 24.049257373s Aug 18 11:40:20.414: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 26.052329048s Aug 18 11:40:22.419: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 28.056643506s Aug 18 11:40:24.421: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 30.059291794s Aug 18 11:40:26.425: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 32.062601361s Aug 18 11:40:28.428: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 34.066294835s Aug 18 11:40:30.432: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 36.069508298s Aug 18 11:40:32.435: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 38.072607407s Aug 18 11:40:34.438: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 40.076207751s Aug 18 11:40:36.441: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 42.079331021s Aug 18 11:40:38.445: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 44.08307925s Aug 18 11:40:40.450: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 46.088113145s Aug 18 11:40:42.454: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 48.091491582s Aug 18 11:40:44.458: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 50.095769433s Aug 18 11:40:46.464: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 52.101493319s Aug 18 11:40:48.469: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 54.106476782s Aug 18 11:40:50.475: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 56.112805316s Aug 18 11:40:52.478: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 58.116336895s Aug 18 11:40:54.482: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.120082275s Aug 18 11:40:56.488: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.12579321s Aug 18 11:40:58.494: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.131699851s Aug 18 11:41:00.499: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.137230113s Aug 18 11:41:02.503: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.14085457s Aug 18 11:41:04.507: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.144462043s Aug 18 11:41:06.511: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.149304403s Aug 18 11:41:08.516: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.15353766s Aug 18 11:41:10.522: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.159502864s Aug 18 11:41:12.525: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.162731982s Aug 18 11:41:14.528: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.166256725s Aug 18 11:41:16.532: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.169531344s Aug 18 11:41:18.538: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.175499263s Aug 18 11:41:20.542: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.17936343s Aug 18 11:41:22.545: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.183201579s Aug 18 11:41:24.548: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.186235179s Aug 18 11:41:26.551: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.189297666s Aug 18 11:41:28.555: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.192661271s Aug 18 11:41:30.558: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.19574043s Aug 18 11:41:32.562: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.199548015s Aug 18 11:41:34.565: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.203270175s Aug 18 11:41:36.569: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.207287702s Aug 18 11:41:38.573: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.211190432s Aug 18 11:41:40.577: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.214564309s Aug 18 11:41:42.580: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.217403902s Aug 18 11:41:44.583: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.221231448s Aug 18 11:41:46.587: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.224750098s Aug 18 11:41:48.590: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.227384581s Aug 18 11:41:50.593: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.231301411s Aug 18 11:41:52.597: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.234520985s Aug 18 11:41:54.600: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.237392193s Aug 18 11:41:56.603: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.240767771s Aug 18 11:41:58.606: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.243484669s Aug 18 11:42:00.609: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.246779471s Aug 18 11:42:02.612: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.249962951s Aug 18 11:42:04.616: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.254174882s Aug 18 11:42:06.620: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.257860744s Aug 18 11:42:08.624: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.261772951s Aug 18 11:42:10.627: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.265010989s Aug 18 11:42:12.630: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.267672725s Aug 18 11:42:14.634: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.27233929s Aug 18 11:42:16.639: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.276973496s Aug 18 11:42:18.642: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.28006705s Aug 18 11:42:20.647: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.285271799s Aug 18 11:42:22.651: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.28845148s Aug 18 11:42:24.655: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.292538586s Aug 18 11:42:26.660: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.297790035s Aug 18 11:42:28.663: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.300602817s Aug 18 11:42:30.666: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.304181178s Aug 18 11:42:32.670: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.307973482s Aug 18 11:42:34.674: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.31173415s Aug 18 11:42:36.677: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.314694844s Aug 18 11:42:38.680: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.317755779s Aug 18 11:42:40.683: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.320541543s Aug 18 11:42:42.686: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.323498594s Aug 18 11:42:44.690: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.327585868s Aug 18 11:42:46.692: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.330227152s Aug 18 11:42:48.696: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.33405072s Aug 18 11:42:50.701: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.338446223s Aug 18 11:42:52.704: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.341994683s Aug 18 11:42:54.707: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.345113907s Aug 18 11:42:56.711: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.348902885s Aug 18 11:42:58.714: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.351456113s Aug 18 11:43:00.717: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.355278025s Aug 18 11:43:02.721: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.358433086s Aug 18 11:43:04.725: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.362454597s Aug 18 11:43:06.728: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.365685901s Aug 18 11:43:08.731: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.368379189s Aug 18 11:43:10.734: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.371701328s Aug 18 11:43:12.738: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.375706912s Aug 18 11:43:14.741: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.379276513s Aug 18 11:43:16.745: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.382635429s Aug 18 11:43:18.748: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.385495823s Aug 18 11:43:20.751: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.389279559s Aug 18 11:43:22.755: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.392376801s Aug 18 11:43:24.758: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.395435841s Aug 18 11:43:26.760: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.398219474s Aug 18 11:43:28.763: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.400670466s Aug 18 11:43:30.766: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.403748392s Aug 18 11:43:32.769: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.406714979s Aug 18 11:43:34.772: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.410268941s Aug 18 11:43:36.775: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.412806246s Aug 18 11:43:38.778: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.41616081s Aug 18 11:43:40.781: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.418834163s Aug 18 11:43:42.784: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.42159569s Aug 18 11:43:44.788: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.425519827s Aug 18 11:43:46.791: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.428469219s Aug 18 11:43:48.794: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.431811518s Aug 18 11:43:50.796: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.434164756s Aug 18 11:43:52.800: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.437650248s Aug 18 11:43:54.803: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.441202305s Aug 18 11:43:56.806: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.44368949s Aug 18 11:43:58.810: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.44746254s Aug 18 11:44:00.813: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.45117337s Aug 18 11:44:02.816: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.453737431s Aug 18 11:44:04.819: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.457190274s Aug 18 11:44:06.822: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.46002203s Aug 18 11:44:08.825: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.462673898s Aug 18 11:44:10.828: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.466282829s Aug 18 11:44:12.832: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.470326128s Aug 18 11:44:14.837: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.474496773s Aug 18 11:44:16.842: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.479762711s Aug 18 11:44:18.846: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.484047912s Aug 18 11:44:20.851: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.489322748s Aug 18 11:44:22.855: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.49278527s Aug 18 11:44:24.860: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.497370026s Aug 18 11:44:26.863: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.500943108s Aug 18 11:44:28.866: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.503685507s Aug 18 11:44:30.869: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.506378209s Aug 18 11:44:32.872: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.509708263s Aug 18 11:44:34.874: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.51229497s Aug 18 11:44:36.878: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.515638507s Aug 18 11:44:38.882: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.520099702s Aug 18 11:44:40.886: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.523518358s Aug 18 11:44:42.889: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.526989611s Aug 18 11:44:44.894: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.531414958s Aug 18 11:44:46.899: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.536540355s Aug 18 11:44:48.903: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.540444228s Aug 18 11:44:50.906: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.544134557s Aug 18 11:44:52.910: INFO: Pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.547624766s Aug 18 11:44:54.920: INFO: Failed to get logs from node "node2" pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1" container "dapi-container": the server rejected our request for an unknown reason (get pods downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1) STEP: delete the pod Aug 18 11:44:54.925: INFO: Waiting for pod downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1 to disappear Aug 18 11:44:54.927: INFO: Pod downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1 still exists Aug 18 11:44:56.929: INFO: Waiting for pod downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1 to disappear Aug 18 11:44:56.931: INFO: Pod downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1 no longer exists Aug 18 11:44:56.932: FAIL: Unexpected error: <*errors.errorString | 0xc00412e3e0>: { s: "expected pod \"downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1\" success: Gave up after waiting 5m0s for pod \"downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1\" to be \"Succeeded or Failed\"", } expected pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1" success: Gave up after waiting 5m0s for pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1" to be "Succeeded or Failed" occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).testContainerOutputMatcher(0xc00042c580, 0x4c3168b, 0x15, 0xc0014c6400, 0x0, 0xc004371198, 0x4, 0x4, 0x4deefb0) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 +0x1ee k8s.io/kubernetes/test/e2e/framework.(*Framework).TestContainerOutputRegexp(...) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:532 k8s.io/kubernetes/test/e2e/common.testDownwardAPIUsingPod(...) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/downward_api.go:425 k8s.io/kubernetes/test/e2e/common.testDownwardAPI(0xc00042c580, 0xc004041100, 0x31, 0xc0024efb80, 0x4, 0x4, 0xc004371198, 0x4, 0x4) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/downward_api.go:391 +0x75c k8s.io/kubernetes/test/e2e/common.glob..func5.4() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/downward_api.go:207 +0x37f k8s.io/kubernetes/test/e2e.RunE2ETests(0xc001880c00) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc001880c00) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc001880c00, 0x4deb2c0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [sig-node] Downward API /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "downward-api-8566". STEP: Found 9 events. Aug 18 11:44:56.936: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1: { } Scheduled: Successfully assigned downward-api-8566/downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1 to node2 Aug 18 11:44:56.936: INFO: At 2021-08-18 11:39:55 +0000 UTC - event for downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1: {multus } AddedInterface: Add eth0 [10.244.3.36/24] Aug 18 11:44:56.936: INFO: At 2021-08-18 11:39:55 +0000 UTC - event for downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1: {kubelet node2} Pulling: Pulling image "docker.io/library/busybox:1.29" Aug 18 11:44:56.936: INFO: At 2021-08-18 11:39:56 +0000 UTC - event for downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1: {kubelet node2} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit Aug 18 11:44:56.936: INFO: At 2021-08-18 11:39:56 +0000 UTC - event for downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1: {kubelet node2} Failed: Error: ErrImagePull Aug 18 11:44:56.936: INFO: At 2021-08-18 11:39:57 +0000 UTC - event for downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1: {kubelet node2} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Aug 18 11:44:56.936: INFO: At 2021-08-18 11:39:59 +0000 UTC - event for downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1: {multus } AddedInterface: Add eth0 [10.244.3.37/24] Aug 18 11:44:56.936: INFO: At 2021-08-18 11:39:59 +0000 UTC - event for downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1: {kubelet node2} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" Aug 18 11:44:56.936: INFO: At 2021-08-18 11:39:59 +0000 UTC - event for downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1: {kubelet node2} Failed: Error: ImagePullBackOff Aug 18 11:44:56.938: INFO: POD NODE PHASE GRACE CONDITIONS Aug 18 11:44:56.938: INFO: Aug 18 11:44:56.944: INFO: Logging node info for node master1 Aug 18 11:44:56.946: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 ebb211fa-503f-4cfe-b1ed-c95d27a70e6e 68784 0 2021-08-18 08:20:52 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"3a:82:be:72:b5:15"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:20:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:20:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:25:59 +0000 UTC,LastTransitionTime:2021-08-18 08:25:59 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:44:56 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:44:56 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:44:56 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:44:56 +0000 UTC,LastTransitionTime:2021-08-18 08:25:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:58c3e57359b641ad92fa1959f2fecf5d,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:012cd796-2076-45d6-8b14-d3e0451b1e64,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[@ :],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:44:56.947: INFO: Logging kubelet events for node master1 Aug 18 11:44:56.950: INFO: Logging pods the kubelet thinks is on node master1 Aug 18 11:44:56.959: INFO: coredns-7677f9bb54-kn2qg started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:56.959: INFO: Container coredns ready: true, restart count 2 Aug 18 11:44:56.959: INFO: kube-scheduler-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:56.959: INFO: Container kube-scheduler ready: true, restart count 0 Aug 18 11:44:56.959: INFO: kube-apiserver-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:56.959: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:44:56.959: INFO: kube-proxy-vqk4v started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:56.959: INFO: Container kube-proxy ready: true, restart count 1 Aug 18 11:44:56.959: INFO: kube-flannel-q64cq started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:44:56.959: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:44:56.959: INFO: Container kube-flannel ready: true, restart count 3 Aug 18 11:44:56.959: INFO: docker-registry-docker-registry-56cbc7bc58-49kl2 started at 2021-08-18 08:26:23 +0000 UTC (0+2 container statuses recorded) Aug 18 11:44:56.959: INFO: Container docker-registry ready: true, restart count 0 Aug 18 11:44:56.959: INFO: Container nginx ready: true, restart count 0 Aug 18 11:44:56.959: INFO: node-exporter-5hwz9 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:44:56.959: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:44:56.959: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:44:56.959: INFO: kube-controller-manager-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:56.959: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:44:56.959: INFO: kube-multus-ds-amd64-kbcp6 started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:56.959: INFO: Container kube-multus ready: true, restart count 1 W0818 11:44:56.973450 26 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:44:56.997: INFO: Latency metrics for node master1 Aug 18 11:44:56.997: INFO: Logging node info for node master2 Aug 18 11:44:56.999: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 78946293-3abe-4442-84d4-8ed6b1d15ce0 68774 0 2021-08-18 08:21:31 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"7e:f5:c2:cc:3a:b4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:21:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:21:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-08-18 08:29:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:44:55 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:44:55 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:44:55 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:44:55 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0c44122c7a7248c18d8571e1cc667258,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:0cd329f2-48e0-4c8f-b8b9-fa3ae0ed8406,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:44:57.000: INFO: Logging kubelet events for node master2 Aug 18 11:44:57.002: INFO: Logging pods the kubelet thinks is on node master2 Aug 18 11:44:57.010: INFO: kube-apiserver-master2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:57.010: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:44:57.010: INFO: kube-scheduler-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:57.010: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:44:57.010: INFO: kube-multus-ds-amd64-mld8g started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:57.010: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:44:57.010: INFO: dns-autoscaler-5b7b5c9b6f-hh47r started at 2021-08-18 08:23:57 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:57.010: INFO: Container autoscaler ready: true, restart count 2 Aug 18 11:44:57.010: INFO: node-feature-discovery-controller-5bf5c49849-mq57c started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:57.010: INFO: Container nfd-controller ready: true, restart count 0 Aug 18 11:44:57.010: INFO: node-exporter-48nfx started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:44:57.010: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:44:57.010: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:44:57.010: INFO: kube-controller-manager-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:57.010: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:44:57.010: INFO: kube-proxy-kh2l9 started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:57.010: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:44:57.010: INFO: kube-flannel-pp56h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:44:57.010: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:44:57.010: INFO: Container kube-flannel ready: true, restart count 1 W0818 11:44:57.024081 26 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:44:57.048: INFO: Latency metrics for node master2 Aug 18 11:44:57.048: INFO: Logging node info for node master3 Aug 18 11:44:57.051: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 44feac2b-9447-4be2-9fcd-62f836d67c72 68739 0 2021-08-18 08:21:41 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"86:e4:31:99:58:40"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {kubelet Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:44:50 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:44:50 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:44:50 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:44:50 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1fae19ae59884c44899bcd08aa243244,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:5db926c5-6530-4635-a0d5-806974a3b732,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:44:57.052: INFO: Logging kubelet events for node master3 Aug 18 11:44:57.054: INFO: Logging pods the kubelet thinks is on node master3 Aug 18 11:44:57.064: INFO: coredns-7677f9bb54-5hxfh started at 2021-08-18 08:23:54 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:57.064: INFO: Container coredns ready: true, restart count 1 Aug 18 11:44:57.064: INFO: node-exporter-vq7d8 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:44:57.064: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:44:57.064: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:44:57.064: INFO: kube-controller-manager-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:57.064: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:44:57.064: INFO: kube-scheduler-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:57.064: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:44:57.064: INFO: kube-apiserver-master3 started at 2021-08-18 08:29:12 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:57.064: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:44:57.064: INFO: kube-proxy-sd5lc started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:57.064: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:44:57.064: INFO: kube-flannel-x6tlr started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:44:57.064: INFO: Init container install-cni ready: true, restart count 1 Aug 18 11:44:57.064: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:44:57.064: INFO: kube-multus-ds-amd64-bkw6c started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:57.064: INFO: Container kube-multus ready: true, restart count 1 W0818 11:44:57.078154 26 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:44:57.101: INFO: Latency metrics for node master3 Aug 18 11:44:57.101: INFO: Logging node info for node node1 Aug 18 11:44:57.105: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 84defabd-6ebf-43ec-a629-44c6713da9c9 68722 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"9a:87:55:36:7b:df"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:13 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:35 +0000 UTC,LastTransitionTime:2021-08-18 08:26:35 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:44:48 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:44:48 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:44:48 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:44:48 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:69946ff2b7bc462fa25eb7adb4703c23,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:736dc52f-f5e3-494e-86ca-01eedbea015c,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:a7cea43d9d2f67c38fbf0407786edbe660ee9072945f7bb272b55fd255e8eaca opnfv/barometer-collectd:stable],SizeBytes:1075746799,},ContainerImage{Names:[@ :],SizeBytes:1003788820,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[aquasec/kube-hunter@sha256:2be6820bc1d7e0f57193a9a27d5a3e16b2fd93c53747b03ce8ca48c6fc323781 aquasec/kube-hunter:0.3.1],SizeBytes:347611549,},ContainerImage{Names:[golang@sha256:db2475a1dbb2149508e5db31d7d77a75e6600d54be645f37681f03f2762169ba golang:alpine3.12],SizeBytes:301186719,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:de25c7fc6c4f3a27c7f0c2dff454e4671823a34d88abd533f210848d527e0fbb alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:44:57.106: INFO: Logging kubelet events for node node1 Aug 18 11:44:57.108: INFO: Logging pods the kubelet thinks is on node node1 Aug 18 11:44:57.123: INFO: termination-message-container0695240e-6103-4528-845b-e45cb7a8bd7f started at 2021-08-18 11:43:31 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:57.123: INFO: Container termination-message-container ready: false, restart count 0 Aug 18 11:44:57.123: INFO: nginx-proxy-node1 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:57.123: INFO: Container nginx-proxy ready: true, restart count 2 Aug 18 11:44:57.123: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-vsxvg started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:57.123: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:44:57.123: INFO: fail-once-local-8rxnh started at 2021-08-18 11:34:14 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:57.123: INFO: Container c ready: false, restart count 0 Aug 18 11:44:57.123: INFO: busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665 started at 2021-08-18 11:41:33 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:57.123: INFO: Container busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665 ready: false, restart count 0 Aug 18 11:44:57.123: INFO: test-webserver-6d6ecfd9-c69b-4d5b-867a-e2160ea50524 started at 2021-08-18 11:42:58 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:57.123: INFO: Container test-webserver ready: true, restart count 0 Aug 18 11:44:57.123: INFO: kube-flannel-q78nd started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:44:57.123: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:44:57.123: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:44:57.123: INFO: prometheus-k8s-0 started at 2021-08-18 08:34:03 +0000 UTC (0+5 container statuses recorded) Aug 18 11:44:57.123: INFO: Container custom-metrics-apiserver ready: true, restart count 0 Aug 18 11:44:57.123: INFO: Container grafana ready: true, restart count 0 Aug 18 11:44:57.123: INFO: Container prometheus ready: true, restart count 1 Aug 18 11:44:57.123: INFO: Container prometheus-config-reloader ready: true, restart count 0 Aug 18 11:44:57.123: INFO: Container rules-configmap-reloader ready: true, restart count 0 Aug 18 11:44:57.123: INFO: pod-with-prestop-exec-hook started at 2021-08-18 11:44:53 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:57.123: INFO: Container pod-with-prestop-exec-hook ready: true, restart count 0 Aug 18 11:44:57.123: INFO: kube-multus-ds-amd64-rrvmb started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:57.123: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:44:57.123: INFO: node-feature-discovery-worker-pflgw started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:57.123: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:44:57.123: INFO: node-exporter-kcwvn started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:44:57.123: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:44:57.123: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:44:57.123: INFO: pod-adoption-release started at 2021-08-18 11:41:47 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:57.123: INFO: Container pod-adoption-release ready: false, restart count 0 Aug 18 11:44:57.123: INFO: busybox-scheduling-f75e615f-f2c3-4e61-8ed7-848c386f63d3 started at 2021-08-18 11:40:13 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:57.123: INFO: Container busybox-scheduling-f75e615f-f2c3-4e61-8ed7-848c386f63d3 ready: false, restart count 0 Aug 18 11:44:57.123: INFO: kube-proxy-p6jvp started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:57.123: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:44:57.123: INFO: kubernetes-metrics-scraper-678c97765c-9nsv5 started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:57.123: INFO: Container kubernetes-metrics-scraper ready: true, restart count 2 Aug 18 11:44:57.123: INFO: cmk-init-discover-node1-bxznx started at 2021-08-18 08:32:10 +0000 UTC (0+3 container statuses recorded) Aug 18 11:44:57.123: INFO: Container discover ready: false, restart count 0 Aug 18 11:44:57.123: INFO: Container init ready: false, restart count 0 Aug 18 11:44:57.123: INFO: Container install ready: false, restart count 0 Aug 18 11:44:57.123: INFO: cmk-d8r27 started at 2021-08-18 08:32:52 +0000 UTC (0+2 container statuses recorded) Aug 18 11:44:57.123: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:44:57.123: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:44:57.123: INFO: collectd-xdprr started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:44:57.123: INFO: Container collectd ready: true, restart count 0 Aug 18 11:44:57.123: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:44:57.123: INFO: Container rbac-proxy ready: true, restart count 0 W0818 11:44:57.136256 26 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:44:57.181: INFO: Latency metrics for node node1 Aug 18 11:44:57.181: INFO: Logging node info for node node2 Aug 18 11:44:57.184: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 1d01177e-3dbb-48a1-a0bc-d18af27ab7f8 68716 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:d1:47:f8:1d:22"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:36 +0000 UTC,LastTransitionTime:2021-08-18 08:26:36 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:44:47 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:44:47 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:44:47 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:44:47 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:dc1f286135c145349b8a016880b65a2f,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:037e7e2d-94e9-42f4-a719-896e5005ac70,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:44:57.185: INFO: Logging kubelet events for node node2 Aug 18 11:44:57.186: INFO: Logging pods the kubelet thinks is on node node2 Aug 18 11:44:57.200: INFO: kube-flannel-h7t5h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:44:57.200: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:44:57.200: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:44:57.200: INFO: node-exporter-lrrf2 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:44:57.200: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:44:57.200: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:44:57.200: INFO: pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5 started at 2021-08-18 11:42:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:57.200: INFO: Container env-test ready: false, restart count 0 Aug 18 11:44:57.200: INFO: nginx-proxy-node2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:57.200: INFO: Container nginx-proxy ready: true, restart count 1 Aug 18 11:44:57.200: INFO: cmk-init-discover-node2-6b2kz started at 2021-08-18 08:32:30 +0000 UTC (0+3 container statuses recorded) Aug 18 11:44:57.200: INFO: Container discover ready: false, restart count 0 Aug 18 11:44:57.200: INFO: Container init ready: false, restart count 0 Aug 18 11:44:57.200: INFO: Container install ready: false, restart count 0 Aug 18 11:44:57.200: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-7rn45 started at 2021-08-18 08:36:42 +0000 UTC (0+2 container statuses recorded) Aug 18 11:44:57.200: INFO: Container tas-controller ready: true, restart count 0 Aug 18 11:44:57.200: INFO: Container tas-extender ready: true, restart count 0 Aug 18 11:44:57.200: INFO: fail-once-local-pk5cs started at 2021-08-18 11:34:14 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:57.200: INFO: Container c ready: false, restart count 0 Aug 18 11:44:57.200: INFO: kubernetes-dashboard-86c6f9df5b-qrtdk started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:57.200: INFO: Container kubernetes-dashboard ready: true, restart count 2 Aug 18 11:44:57.200: INFO: cmk-748rz started at 2021-08-18 08:32:53 +0000 UTC (0+2 container statuses recorded) Aug 18 11:44:57.200: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:44:57.200: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:44:57.200: INFO: kube-proxy-qkj9c started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:57.201: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:44:57.201: INFO: node-feature-discovery-worker-hzpf5 started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:57.201: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:44:57.201: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-c82pt started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:57.201: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:44:57.201: INFO: prometheus-operator-5bb8cb9d8f-k97ws started at 2021-08-18 08:33:38 +0000 UTC (0+2 container statuses recorded) Aug 18 11:44:57.201: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:44:57.201: INFO: Container prometheus-operator ready: true, restart count 0 Aug 18 11:44:57.201: INFO: kube-multus-ds-amd64-rvzsg started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:57.201: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:44:57.201: INFO: collectd-67ntq started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:44:57.201: INFO: Container collectd ready: true, restart count 0 Aug 18 11:44:57.201: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:44:57.201: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:44:57.201: INFO: pod-handle-http-request started at 2021-08-18 11:44:49 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:57.201: INFO: Container pod-handle-http-request ready: true, restart count 0 Aug 18 11:44:57.201: INFO: cmk-webhook-6c9d5f8578-7cxjr started at 2021-08-18 08:32:53 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:57.201: INFO: Container cmk-webhook ready: true, restart count 0 Aug 18 11:44:57.201: INFO: termination-message-containerd34235c0-885f-4596-b8e2-47db8d79aee8 started at 2021-08-18 11:42:58 +0000 UTC (0+1 container statuses recorded) Aug 18 11:44:57.201: INFO: Container termination-message-container ready: false, restart count 0 W0818 11:44:57.212131 26 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:44:57.252: INFO: Latency metrics for node node2 Aug 18 11:44:57.252: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "downward-api-8566" for this suite. • Failure [302.934 seconds] [sig-node] Downward API /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/downward_api.go:34 should provide container's limits.cpu/memory and requests.cpu/memory as env vars [NodeConformance] [Conformance] [It] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:44:56.932: Unexpected error: <*errors.errorString | 0xc00412e3e0>: { s: "expected pod \"downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1\" success: Gave up after waiting 5m0s for pod \"downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1\" to be \"Succeeded or Failed\"", } expected pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1" success: Gave up after waiting 5m0s for pod "downward-api-6d4f8477-bbe4-43ef-b926-feeff60a90d1" to be "Succeeded or Failed" occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 ------------------------------ {"msg":"FAILED [sig-node] Downward API should provide container's limits.cpu/memory and requests.cpu/memory as env vars [NodeConformance] [Conformance]","total":-1,"completed":15,"skipped":206,"failed":3,"failures":["[sig-apps] Deployment deployment should support rollover [Conformance]","[sig-network] Services should be able to switch session affinity for NodePort service [LinuxOnly] [Conformance]","[sig-node] Downward API should provide container's limits.cpu/memory and requests.cpu/memory as env vars [NodeConformance] [Conformance]"]} S ------------------------------ [BeforeEach] [k8s.io] Container Lifecycle Hook /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:44:49.424: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename container-lifecycle-hook STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] when create a pod with lifecycle hook /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/lifecycle_hook.go:64 STEP: create the container to handle the HTTPGet hook request. [It] should execute prestop exec hook properly [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: create the pod with lifecycle hook STEP: delete the pod with lifecycle hook Aug 18 11:44:57.489: INFO: Waiting for pod pod-with-prestop-exec-hook to disappear Aug 18 11:44:57.491: INFO: Pod pod-with-prestop-exec-hook still exists Aug 18 11:44:59.492: INFO: Waiting for pod pod-with-prestop-exec-hook to disappear Aug 18 11:44:59.494: INFO: Pod pod-with-prestop-exec-hook still exists Aug 18 11:45:01.492: INFO: Waiting for pod pod-with-prestop-exec-hook to disappear Aug 18 11:45:01.495: INFO: Pod pod-with-prestop-exec-hook still exists Aug 18 11:45:03.492: INFO: Waiting for pod pod-with-prestop-exec-hook to disappear Aug 18 11:45:03.495: INFO: Pod pod-with-prestop-exec-hook still exists Aug 18 11:45:05.493: INFO: Waiting for pod pod-with-prestop-exec-hook to disappear Aug 18 11:45:05.496: INFO: Pod pod-with-prestop-exec-hook still exists Aug 18 11:45:07.492: INFO: Waiting for pod pod-with-prestop-exec-hook to disappear Aug 18 11:45:07.496: INFO: Pod pod-with-prestop-exec-hook still exists Aug 18 11:45:09.492: INFO: Waiting for pod pod-with-prestop-exec-hook to disappear Aug 18 11:45:09.495: INFO: Pod pod-with-prestop-exec-hook still exists Aug 18 11:45:11.492: INFO: Waiting for pod pod-with-prestop-exec-hook to disappear Aug 18 11:45:11.496: INFO: Pod pod-with-prestop-exec-hook no longer exists STEP: check prestop hook [AfterEach] [k8s.io] Container Lifecycle Hook /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:45:11.502: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "container-lifecycle-hook-692" for this suite. • [SLOW TEST:22.090 seconds] [k8s.io] Container Lifecycle Hook /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 when create a pod with lifecycle hook /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/lifecycle_hook.go:42 should execute prestop exec hook properly [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [k8s.io] Container Lifecycle Hook when create a pod with lifecycle hook should execute prestop exec hook properly [NodeConformance] [Conformance]","total":-1,"completed":26,"skipped":615,"failed":3,"failures":["[k8s.io] InitContainer [NodeConformance] should invoke init containers on a RestartAlways pod [Conformance]","[k8s.io] Pods should allow activeDeadlineSeconds to be updated [NodeConformance] [Conformance]","[k8s.io] Variable Expansion should allow substituting values in a container's args [NodeConformance] [Conformance]"]} SSSSSSSS ------------------------------ [BeforeEach] [k8s.io] Kubelet /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:40:13.737: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename kubelet-test STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [k8s.io] Kubelet /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/kubelet.go:38 [It] should print the output to logs [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:45:13.781: FAIL: Unexpected error: <*errors.errorString | 0xc0002801f0>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*PodClient).CreateSync(0xc0042b6a00, 0xc008d80800, 0x211) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:103 +0xfe k8s.io/kubernetes/test/e2e/common.glob..func12.2.1() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/kubelet.go:50 +0x1af k8s.io/kubernetes/test/e2e.RunE2ETests(0xc003602780) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc003602780) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc003602780, 0x4deb2c0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] Kubelet /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "kubelet-test-1859". STEP: Found 8 events. Aug 18 11:45:13.786: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for busybox-scheduling-f75e615f-f2c3-4e61-8ed7-848c386f63d3: { } Scheduled: Successfully assigned kubelet-test-1859/busybox-scheduling-f75e615f-f2c3-4e61-8ed7-848c386f63d3 to node1 Aug 18 11:45:13.786: INFO: At 2021-08-18 11:40:15 +0000 UTC - event for busybox-scheduling-f75e615f-f2c3-4e61-8ed7-848c386f63d3: {multus } AddedInterface: Add eth0 [10.244.4.45/24] Aug 18 11:45:13.786: INFO: At 2021-08-18 11:40:15 +0000 UTC - event for busybox-scheduling-f75e615f-f2c3-4e61-8ed7-848c386f63d3: {kubelet node1} Pulling: Pulling image "docker.io/library/busybox:1.29" Aug 18 11:45:13.786: INFO: At 2021-08-18 11:40:17 +0000 UTC - event for busybox-scheduling-f75e615f-f2c3-4e61-8ed7-848c386f63d3: {kubelet node1} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit Aug 18 11:45:13.786: INFO: At 2021-08-18 11:40:17 +0000 UTC - event for busybox-scheduling-f75e615f-f2c3-4e61-8ed7-848c386f63d3: {kubelet node1} Failed: Error: ErrImagePull Aug 18 11:45:13.786: INFO: At 2021-08-18 11:40:18 +0000 UTC - event for busybox-scheduling-f75e615f-f2c3-4e61-8ed7-848c386f63d3: {kubelet node1} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" Aug 18 11:45:13.786: INFO: At 2021-08-18 11:40:18 +0000 UTC - event for busybox-scheduling-f75e615f-f2c3-4e61-8ed7-848c386f63d3: {kubelet node1} Failed: Error: ImagePullBackOff Aug 18 11:45:13.786: INFO: At 2021-08-18 11:41:01 +0000 UTC - event for busybox-scheduling-f75e615f-f2c3-4e61-8ed7-848c386f63d3: {kubelet node1} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit Aug 18 11:45:13.789: INFO: POD NODE PHASE GRACE CONDITIONS Aug 18 11:45:13.789: INFO: busybox-scheduling-f75e615f-f2c3-4e61-8ed7-848c386f63d3 node1 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:40:13 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:40:13 +0000 UTC ContainersNotReady containers with unready status: [busybox-scheduling-f75e615f-f2c3-4e61-8ed7-848c386f63d3]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:40:13 +0000 UTC ContainersNotReady containers with unready status: [busybox-scheduling-f75e615f-f2c3-4e61-8ed7-848c386f63d3]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:40:13 +0000 UTC }] Aug 18 11:45:13.789: INFO: Aug 18 11:45:13.794: INFO: Logging node info for node master1 Aug 18 11:45:13.797: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 ebb211fa-503f-4cfe-b1ed-c95d27a70e6e 68879 0 2021-08-18 08:20:52 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"3a:82:be:72:b5:15"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:20:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:20:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:25:59 +0000 UTC,LastTransitionTime:2021-08-18 08:25:59 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:45:06 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:45:06 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:45:06 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:45:06 +0000 UTC,LastTransitionTime:2021-08-18 08:25:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:58c3e57359b641ad92fa1959f2fecf5d,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:012cd796-2076-45d6-8b14-d3e0451b1e64,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[@ :],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:45:13.797: INFO: Logging kubelet events for node master1 Aug 18 11:45:13.800: INFO: Logging pods the kubelet thinks is on node master1 Aug 18 11:45:13.809: INFO: kube-controller-manager-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:45:13.809: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:45:13.809: INFO: kube-multus-ds-amd64-kbcp6 started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:45:13.809: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:45:13.809: INFO: docker-registry-docker-registry-56cbc7bc58-49kl2 started at 2021-08-18 08:26:23 +0000 UTC (0+2 container statuses recorded) Aug 18 11:45:13.809: INFO: Container docker-registry ready: true, restart count 0 Aug 18 11:45:13.809: INFO: Container nginx ready: true, restart count 0 Aug 18 11:45:13.809: INFO: node-exporter-5hwz9 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:45:13.809: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:45:13.809: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:45:13.809: INFO: kube-apiserver-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:45:13.809: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:45:13.809: INFO: kube-proxy-vqk4v started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:45:13.809: INFO: Container kube-proxy ready: true, restart count 1 Aug 18 11:45:13.809: INFO: kube-flannel-q64cq started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:45:13.809: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:45:13.809: INFO: Container kube-flannel ready: true, restart count 3 Aug 18 11:45:13.809: INFO: coredns-7677f9bb54-kn2qg started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:45:13.809: INFO: Container coredns ready: true, restart count 2 Aug 18 11:45:13.809: INFO: kube-scheduler-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:45:13.809: INFO: Container kube-scheduler ready: true, restart count 0 W0818 11:45:13.822766 30 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:45:13.854: INFO: Latency metrics for node master1 Aug 18 11:45:13.854: INFO: Logging node info for node master2 Aug 18 11:45:13.856: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 78946293-3abe-4442-84d4-8ed6b1d15ce0 68868 0 2021-08-18 08:21:31 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"7e:f5:c2:cc:3a:b4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:21:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:21:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-08-18 08:29:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:45:05 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:45:05 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:45:05 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:45:05 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0c44122c7a7248c18d8571e1cc667258,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:0cd329f2-48e0-4c8f-b8b9-fa3ae0ed8406,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:45:13.857: INFO: Logging kubelet events for node master2 Aug 18 11:45:13.859: INFO: Logging pods the kubelet thinks is on node master2 Aug 18 11:45:13.868: INFO: kube-controller-manager-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:45:13.868: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:45:13.868: INFO: kube-proxy-kh2l9 started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:45:13.868: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:45:13.868: INFO: kube-flannel-pp56h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:45:13.868: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:45:13.868: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:45:13.868: INFO: kube-apiserver-master2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:45:13.868: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:45:13.868: INFO: kube-scheduler-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:45:13.868: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:45:13.868: INFO: kube-multus-ds-amd64-mld8g started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:45:13.868: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:45:13.868: INFO: dns-autoscaler-5b7b5c9b6f-hh47r started at 2021-08-18 08:23:57 +0000 UTC (0+1 container statuses recorded) Aug 18 11:45:13.868: INFO: Container autoscaler ready: true, restart count 2 Aug 18 11:45:13.868: INFO: node-feature-discovery-controller-5bf5c49849-mq57c started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:45:13.868: INFO: Container nfd-controller ready: true, restart count 0 Aug 18 11:45:13.868: INFO: node-exporter-48nfx started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:45:13.868: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:45:13.868: INFO: Container node-exporter ready: true, restart count 0 W0818 11:45:13.879477 30 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:45:13.912: INFO: Latency metrics for node master2 Aug 18 11:45:13.912: INFO: Logging node info for node master3 Aug 18 11:45:13.915: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 44feac2b-9447-4be2-9fcd-62f836d67c72 68898 0 2021-08-18 08:21:41 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"86:e4:31:99:58:40"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {kubelet Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:45:10 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:45:10 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:45:10 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:45:10 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1fae19ae59884c44899bcd08aa243244,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:5db926c5-6530-4635-a0d5-806974a3b732,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:45:13.915: INFO: Logging kubelet events for node master3 Aug 18 11:45:13.917: INFO: Logging pods the kubelet thinks is on node master3 Aug 18 11:45:13.926: INFO: kube-multus-ds-amd64-bkw6c started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:45:13.926: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:45:13.926: INFO: coredns-7677f9bb54-5hxfh started at 2021-08-18 08:23:54 +0000 UTC (0+1 container statuses recorded) Aug 18 11:45:13.926: INFO: Container coredns ready: true, restart count 1 Aug 18 11:45:13.926: INFO: node-exporter-vq7d8 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:45:13.926: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:45:13.926: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:45:13.926: INFO: kube-controller-manager-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:45:13.926: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:45:13.926: INFO: kube-scheduler-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:45:13.926: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:45:13.926: INFO: kube-apiserver-master3 started at 2021-08-18 08:29:12 +0000 UTC (0+1 container statuses recorded) Aug 18 11:45:13.926: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:45:13.926: INFO: kube-proxy-sd5lc started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:45:13.926: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:45:13.926: INFO: kube-flannel-x6tlr started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:45:13.926: INFO: Init container install-cni ready: true, restart count 1 Aug 18 11:45:13.926: INFO: Container kube-flannel ready: true, restart count 1 W0818 11:45:13.938938 30 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:45:13.966: INFO: Latency metrics for node master3 Aug 18 11:45:13.966: INFO: Logging node info for node node1 Aug 18 11:45:13.968: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 84defabd-6ebf-43ec-a629-44c6713da9c9 68893 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"9a:87:55:36:7b:df"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:13 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:35 +0000 UTC,LastTransitionTime:2021-08-18 08:26:35 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:45:09 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:45:09 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:45:09 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:45:09 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:69946ff2b7bc462fa25eb7adb4703c23,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:736dc52f-f5e3-494e-86ca-01eedbea015c,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:a7cea43d9d2f67c38fbf0407786edbe660ee9072945f7bb272b55fd255e8eaca opnfv/barometer-collectd:stable],SizeBytes:1075746799,},ContainerImage{Names:[@ :],SizeBytes:1003788820,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[aquasec/kube-hunter@sha256:2be6820bc1d7e0f57193a9a27d5a3e16b2fd93c53747b03ce8ca48c6fc323781 aquasec/kube-hunter:0.3.1],SizeBytes:347611549,},ContainerImage{Names:[golang@sha256:db2475a1dbb2149508e5db31d7d77a75e6600d54be645f37681f03f2762169ba golang:alpine3.12],SizeBytes:301186719,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:de25c7fc6c4f3a27c7f0c2dff454e4671823a34d88abd533f210848d527e0fbb alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:45:13.969: INFO: Logging kubelet events for node node1 Aug 18 11:45:13.971: INFO: Logging pods the kubelet thinks is on node node1 Aug 18 11:45:13.987: INFO: kube-flannel-q78nd started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:45:13.987: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:45:13.987: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:45:13.987: INFO: prometheus-k8s-0 started at 2021-08-18 08:34:03 +0000 UTC (0+5 container statuses recorded) Aug 18 11:45:13.987: INFO: Container custom-metrics-apiserver ready: true, restart count 0 Aug 18 11:45:13.987: INFO: Container grafana ready: true, restart count 0 Aug 18 11:45:13.987: INFO: Container prometheus ready: true, restart count 1 Aug 18 11:45:13.987: INFO: Container prometheus-config-reloader ready: true, restart count 0 Aug 18 11:45:13.987: INFO: Container rules-configmap-reloader ready: true, restart count 0 Aug 18 11:45:13.987: INFO: sample-webhook-deployment-cbccbf6bb-wnkvl started at 2021-08-18 11:45:12 +0000 UTC (0+1 container statuses recorded) Aug 18 11:45:13.987: INFO: Container sample-webhook ready: false, restart count 0 Aug 18 11:45:13.987: INFO: kube-multus-ds-amd64-rrvmb started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:45:13.987: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:45:13.987: INFO: node-feature-discovery-worker-pflgw started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:45:13.987: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:45:13.987: INFO: node-exporter-kcwvn started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:45:13.987: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:45:13.987: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:45:13.987: INFO: pod-adoption-release started at 2021-08-18 11:41:47 +0000 UTC (0+1 container statuses recorded) Aug 18 11:45:13.987: INFO: Container pod-adoption-release ready: false, restart count 0 Aug 18 11:45:13.987: INFO: kube-proxy-p6jvp started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:45:13.987: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:45:13.987: INFO: kubernetes-metrics-scraper-678c97765c-9nsv5 started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:45:13.987: INFO: Container kubernetes-metrics-scraper ready: true, restart count 2 Aug 18 11:45:13.987: INFO: cmk-init-discover-node1-bxznx started at 2021-08-18 08:32:10 +0000 UTC (0+3 container statuses recorded) Aug 18 11:45:13.987: INFO: Container discover ready: false, restart count 0 Aug 18 11:45:13.987: INFO: Container init ready: false, restart count 0 Aug 18 11:45:13.987: INFO: Container install ready: false, restart count 0 Aug 18 11:45:13.987: INFO: cmk-d8r27 started at 2021-08-18 08:32:52 +0000 UTC (0+2 container statuses recorded) Aug 18 11:45:13.987: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:45:13.987: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:45:13.987: INFO: collectd-xdprr started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:45:13.987: INFO: Container collectd ready: true, restart count 0 Aug 18 11:45:13.987: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:45:13.987: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:45:13.987: INFO: busybox-scheduling-f75e615f-f2c3-4e61-8ed7-848c386f63d3 started at 2021-08-18 11:40:13 +0000 UTC (0+1 container statuses recorded) Aug 18 11:45:13.987: INFO: Container busybox-scheduling-f75e615f-f2c3-4e61-8ed7-848c386f63d3 ready: false, restart count 0 Aug 18 11:45:13.987: INFO: nginx-proxy-node1 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:45:13.987: INFO: Container nginx-proxy ready: true, restart count 2 Aug 18 11:45:13.987: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-vsxvg started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:45:13.988: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:45:13.988: INFO: fail-once-local-8rxnh started at 2021-08-18 11:34:14 +0000 UTC (0+1 container statuses recorded) Aug 18 11:45:13.988: INFO: Container c ready: false, restart count 0 Aug 18 11:45:13.988: INFO: busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665 started at 2021-08-18 11:41:33 +0000 UTC (0+1 container statuses recorded) Aug 18 11:45:13.988: INFO: Container busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665 ready: false, restart count 0 Aug 18 11:45:13.988: INFO: test-webserver-6d6ecfd9-c69b-4d5b-867a-e2160ea50524 started at 2021-08-18 11:42:58 +0000 UTC (0+1 container statuses recorded) Aug 18 11:45:13.988: INFO: Container test-webserver ready: true, restart count 0 Aug 18 11:45:13.988: INFO: termination-message-container0695240e-6103-4528-845b-e45cb7a8bd7f started at 2021-08-18 11:43:31 +0000 UTC (0+1 container statuses recorded) Aug 18 11:45:13.988: INFO: Container termination-message-container ready: false, restart count 0 W0818 11:45:13.999320 30 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:45:14.044: INFO: Latency metrics for node node1 Aug 18 11:45:14.044: INFO: Logging node info for node node2 Aug 18 11:45:14.047: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 1d01177e-3dbb-48a1-a0bc-d18af27ab7f8 68884 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:d1:47:f8:1d:22"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:36 +0000 UTC,LastTransitionTime:2021-08-18 08:26:36 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:45:07 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:45:07 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:45:07 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:45:07 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:dc1f286135c145349b8a016880b65a2f,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:037e7e2d-94e9-42f4-a719-896e5005ac70,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:45:14.048: INFO: Logging kubelet events for node node2 Aug 18 11:45:14.050: INFO: Logging pods the kubelet thinks is on node node2 Aug 18 11:45:14.609: INFO: kube-proxy-qkj9c started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:45:14.610: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:45:14.610: INFO: node-feature-discovery-worker-hzpf5 started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:45:14.610: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:45:14.610: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-c82pt started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:45:14.610: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:45:14.610: INFO: prometheus-operator-5bb8cb9d8f-k97ws started at 2021-08-18 08:33:38 +0000 UTC (0+2 container statuses recorded) Aug 18 11:45:14.610: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:45:14.610: INFO: Container prometheus-operator ready: true, restart count 0 Aug 18 11:45:14.610: INFO: kube-multus-ds-amd64-rvzsg started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:45:14.610: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:45:14.610: INFO: collectd-67ntq started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:45:14.610: INFO: Container collectd ready: true, restart count 0 Aug 18 11:45:14.610: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:45:14.610: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:45:14.610: INFO: pod-handle-http-request started at 2021-08-18 11:44:49 +0000 UTC (0+1 container statuses recorded) Aug 18 11:45:14.610: INFO: Container pod-handle-http-request ready: true, restart count 0 Aug 18 11:45:14.610: INFO: server started at 2021-08-18 11:44:57 +0000 UTC (0+1 container statuses recorded) Aug 18 11:45:14.610: INFO: Container agnhost-container ready: true, restart count 0 Aug 18 11:45:14.610: INFO: cmk-webhook-6c9d5f8578-7cxjr started at 2021-08-18 08:32:53 +0000 UTC (0+1 container statuses recorded) Aug 18 11:45:14.610: INFO: Container cmk-webhook ready: true, restart count 0 Aug 18 11:45:14.610: INFO: termination-message-containerd34235c0-885f-4596-b8e2-47db8d79aee8 started at 2021-08-18 11:42:58 +0000 UTC (0+1 container statuses recorded) Aug 18 11:45:14.610: INFO: Container termination-message-container ready: false, restart count 0 Aug 18 11:45:14.610: INFO: tester started at 2021-08-18 11:45:01 +0000 UTC (0+1 container statuses recorded) Aug 18 11:45:14.610: INFO: Container tester ready: false, restart count 0 Aug 18 11:45:14.610: INFO: kube-flannel-h7t5h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:45:14.610: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:45:14.610: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:45:14.610: INFO: node-exporter-lrrf2 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:45:14.610: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:45:14.610: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:45:14.610: INFO: pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5 started at 2021-08-18 11:42:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:45:14.610: INFO: Container env-test ready: false, restart count 0 Aug 18 11:45:14.610: INFO: fail-once-local-pk5cs started at 2021-08-18 11:34:14 +0000 UTC (0+1 container statuses recorded) Aug 18 11:45:14.610: INFO: Container c ready: false, restart count 0 Aug 18 11:45:14.610: INFO: nginx-proxy-node2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:45:14.610: INFO: Container nginx-proxy ready: true, restart count 1 Aug 18 11:45:14.610: INFO: cmk-init-discover-node2-6b2kz started at 2021-08-18 08:32:30 +0000 UTC (0+3 container statuses recorded) Aug 18 11:45:14.610: INFO: Container discover ready: false, restart count 0 Aug 18 11:45:14.610: INFO: Container init ready: false, restart count 0 Aug 18 11:45:14.610: INFO: Container install ready: false, restart count 0 Aug 18 11:45:14.610: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-7rn45 started at 2021-08-18 08:36:42 +0000 UTC (0+2 container statuses recorded) Aug 18 11:45:14.610: INFO: Container tas-controller ready: true, restart count 0 Aug 18 11:45:14.610: INFO: Container tas-extender ready: true, restart count 0 Aug 18 11:45:14.610: INFO: kubernetes-dashboard-86c6f9df5b-qrtdk started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:45:14.610: INFO: Container kubernetes-dashboard ready: true, restart count 2 Aug 18 11:45:14.610: INFO: cmk-748rz started at 2021-08-18 08:32:53 +0000 UTC (0+2 container statuses recorded) Aug 18 11:45:14.610: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:45:14.610: INFO: Container reconcile ready: true, restart count 0 W0818 11:45:14.620579 30 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:45:14.652: INFO: Latency metrics for node node2 Aug 18 11:45:14.652: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "kubelet-test-1859" for this suite. • Failure [300.924 seconds] [k8s.io] Kubelet /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 when scheduling a busybox command in a pod /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/kubelet.go:41 should print the output to logs [NodeConformance] [Conformance] [It] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:45:13.781: Unexpected error: <*errors.errorString | 0xc0002801f0>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:103 ------------------------------ {"msg":"FAILED [k8s.io] Kubelet when scheduling a busybox command in a pod should print the output to logs [NodeConformance] [Conformance]","total":-1,"completed":19,"skipped":317,"failed":3,"failures":["[sig-apps] Deployment RollingUpdateDeployment should delete old pods and create new ones [Conformance]","[sig-storage] ConfigMap binary data should be reflected in volume [NodeConformance] [Conformance]","[k8s.io] Kubelet when scheduling a busybox command in a pod should print the output to logs [NodeConformance] [Conformance]"]} SSSSSSSSSS ------------------------------ [BeforeEach] [sig-storage] Secrets /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:45:14.689: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename secrets STEP: Waiting for a default service account to be provisioned in namespace [It] should be consumable from pods in volume with mappings and Item Mode set [LinuxOnly] [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating secret with name secret-test-map-6382b004-69b0-4931-9a26-25b77467af86 STEP: Creating a pod to test consume secrets Aug 18 11:45:14.725: INFO: Waiting up to 5m0s for pod "pod-secrets-238f5b27-c93e-49cb-b885-eeeee2934451" in namespace "secrets-1229" to be "Succeeded or Failed" Aug 18 11:45:14.727: INFO: Pod "pod-secrets-238f5b27-c93e-49cb-b885-eeeee2934451": Phase="Pending", Reason="", readiness=false. Elapsed: 2.093401ms Aug 18 11:45:16.731: INFO: Pod "pod-secrets-238f5b27-c93e-49cb-b885-eeeee2934451": Phase="Pending", Reason="", readiness=false. Elapsed: 2.005480958s Aug 18 11:45:18.733: INFO: Pod "pod-secrets-238f5b27-c93e-49cb-b885-eeeee2934451": Phase="Pending", Reason="", readiness=false. Elapsed: 4.007793259s Aug 18 11:45:20.736: INFO: Pod "pod-secrets-238f5b27-c93e-49cb-b885-eeeee2934451": Phase="Succeeded", Reason="", readiness=false. Elapsed: 6.0105398s STEP: Saw pod success Aug 18 11:45:20.736: INFO: Pod "pod-secrets-238f5b27-c93e-49cb-b885-eeeee2934451" satisfied condition "Succeeded or Failed" Aug 18 11:45:20.738: INFO: Trying to get logs from node node1 pod pod-secrets-238f5b27-c93e-49cb-b885-eeeee2934451 container secret-volume-test: STEP: delete the pod Aug 18 11:45:20.753: INFO: Waiting for pod pod-secrets-238f5b27-c93e-49cb-b885-eeeee2934451 to disappear Aug 18 11:45:20.755: INFO: Pod pod-secrets-238f5b27-c93e-49cb-b885-eeeee2934451 no longer exists [AfterEach] [sig-storage] Secrets /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:45:20.755: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "secrets-1229" for this suite. • [SLOW TEST:6.073 seconds] [sig-storage] Secrets /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/secrets_volume.go:36 should be consumable from pods in volume with mappings and Item Mode set [LinuxOnly] [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-storage] Secrets should be consumable from pods in volume with mappings and Item Mode set [LinuxOnly] [NodeConformance] [Conformance]","total":-1,"completed":20,"skipped":327,"failed":3,"failures":["[sig-apps] Deployment RollingUpdateDeployment should delete old pods and create new ones [Conformance]","[sig-storage] ConfigMap binary data should be reflected in volume [NodeConformance] [Conformance]","[k8s.io] Kubelet when scheduling a busybox command in a pod should print the output to logs [NodeConformance] [Conformance]"]} SSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-api-machinery] Watchers /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:45:20.825: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename watch STEP: Waiting for a default service account to be provisioned in namespace [It] should be able to restart watching from the last resource version observed by the previous watch [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: creating a watch on configmaps STEP: creating a new configmap STEP: modifying the configmap once STEP: closing the watch once it receives two notifications Aug 18 11:45:20.853: INFO: Got : ADDED &ConfigMap{ObjectMeta:{e2e-watch-test-watch-closed watch-2331 /api/v1/namespaces/watch-2331/configmaps/e2e-watch-test-watch-closed 476eb159-2088-4cba-8399-0a6745ac4973 69034 0 2021-08-18 11:45:20 +0000 UTC map[watch-this-configmap:watch-closed-and-restarted] map[] [] [] [{e2e.test Update v1 2021-08-18 11:45:20 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{".":{},"f:watch-this-configmap":{}}}}}]},Data:map[string]string{},BinaryData:map[string][]byte{},Immutable:nil,} Aug 18 11:45:20.854: INFO: Got : MODIFIED &ConfigMap{ObjectMeta:{e2e-watch-test-watch-closed watch-2331 /api/v1/namespaces/watch-2331/configmaps/e2e-watch-test-watch-closed 476eb159-2088-4cba-8399-0a6745ac4973 69035 0 2021-08-18 11:45:20 +0000 UTC map[watch-this-configmap:watch-closed-and-restarted] map[] [] [] [{e2e.test Update v1 2021-08-18 11:45:20 +0000 UTC FieldsV1 {"f:data":{".":{},"f:mutation":{}},"f:metadata":{"f:labels":{".":{},"f:watch-this-configmap":{}}}}}]},Data:map[string]string{mutation: 1,},BinaryData:map[string][]byte{},Immutable:nil,} STEP: modifying the configmap a second time, while the watch is closed STEP: creating a new watch on configmaps from the last resource version observed by the first watch STEP: deleting the configmap STEP: Expecting to observe notifications for all changes to the configmap since the first watch closed Aug 18 11:45:20.863: INFO: Got : MODIFIED &ConfigMap{ObjectMeta:{e2e-watch-test-watch-closed watch-2331 /api/v1/namespaces/watch-2331/configmaps/e2e-watch-test-watch-closed 476eb159-2088-4cba-8399-0a6745ac4973 69036 0 2021-08-18 11:45:20 +0000 UTC map[watch-this-configmap:watch-closed-and-restarted] map[] [] [] [{e2e.test Update v1 2021-08-18 11:45:20 +0000 UTC FieldsV1 {"f:data":{".":{},"f:mutation":{}},"f:metadata":{"f:labels":{".":{},"f:watch-this-configmap":{}}}}}]},Data:map[string]string{mutation: 2,},BinaryData:map[string][]byte{},Immutable:nil,} Aug 18 11:45:20.864: INFO: Got : DELETED &ConfigMap{ObjectMeta:{e2e-watch-test-watch-closed watch-2331 /api/v1/namespaces/watch-2331/configmaps/e2e-watch-test-watch-closed 476eb159-2088-4cba-8399-0a6745ac4973 69037 0 2021-08-18 11:45:20 +0000 UTC map[watch-this-configmap:watch-closed-and-restarted] map[] [] [] [{e2e.test Update v1 2021-08-18 11:45:20 +0000 UTC FieldsV1 {"f:data":{".":{},"f:mutation":{}},"f:metadata":{"f:labels":{".":{},"f:watch-this-configmap":{}}}}}]},Data:map[string]string{mutation: 2,},BinaryData:map[string][]byte{},Immutable:nil,} [AfterEach] [sig-api-machinery] Watchers /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:45:20.864: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "watch-2331" for this suite. • ------------------------------ {"msg":"PASSED [sig-api-machinery] Watchers should be able to restart watching from the last resource version observed by the previous watch [Conformance]","total":-1,"completed":21,"skipped":355,"failed":3,"failures":["[sig-apps] Deployment RollingUpdateDeployment should delete old pods and create new ones [Conformance]","[sig-storage] ConfigMap binary data should be reflected in volume [NodeConformance] [Conformance]","[k8s.io] Kubelet when scheduling a busybox command in a pod should print the output to logs [NodeConformance] [Conformance]"]} SSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-cli] Kubectl client /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:45:20.905: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename kubectl STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-cli] Kubectl client /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/kubectl.go:247 [It] should check if v1 is in available api versions [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: validating api versions Aug 18 11:45:20.926: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-6424 api-versions' Aug 18 11:45:21.041: INFO: stderr: "" Aug 18 11:45:21.041: INFO: stdout: "admissionregistration.k8s.io/v1\nadmissionregistration.k8s.io/v1beta1\napiextensions.k8s.io/v1\napiextensions.k8s.io/v1beta1\napiregistration.k8s.io/v1\napiregistration.k8s.io/v1beta1\napps/v1\nauthentication.k8s.io/v1\nauthentication.k8s.io/v1beta1\nauthorization.k8s.io/v1\nauthorization.k8s.io/v1beta1\nautoscaling/v1\nautoscaling/v2beta1\nautoscaling/v2beta2\nbatch/v1\nbatch/v1beta1\ncertificates.k8s.io/v1\ncertificates.k8s.io/v1beta1\ncoordination.k8s.io/v1\ncoordination.k8s.io/v1beta1\ncustom.metrics.k8s.io/v1beta1\ndiscovery.k8s.io/v1beta1\nevents.k8s.io/v1\nevents.k8s.io/v1beta1\nextensions/v1beta1\nintel.com/v1\nk8s.cni.cncf.io/v1\nmonitoring.coreos.com/v1\nnetworking.k8s.io/v1\nnetworking.k8s.io/v1beta1\nnode.k8s.io/v1beta1\npolicy/v1beta1\nrbac.authorization.k8s.io/v1\nrbac.authorization.k8s.io/v1beta1\nscheduling.k8s.io/v1\nscheduling.k8s.io/v1beta1\nstorage.k8s.io/v1\nstorage.k8s.io/v1beta1\ntelemetry.intel.com/v1alpha1\nv1\n" [AfterEach] [sig-cli] Kubectl client /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:45:21.041: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "kubectl-6424" for this suite. • ------------------------------ {"msg":"PASSED [sig-cli] Kubectl client Kubectl api-versions should check if v1 is in available api versions [Conformance]","total":-1,"completed":22,"skipped":372,"failed":3,"failures":["[sig-apps] Deployment RollingUpdateDeployment should delete old pods and create new ones [Conformance]","[sig-storage] ConfigMap binary data should be reflected in volume [NodeConformance] [Conformance]","[k8s.io] Kubelet when scheduling a busybox command in a pod should print the output to logs [NodeConformance] [Conformance]"]} SSS ------------------------------ [BeforeEach] [sig-cli] Kubectl client /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:45:21.058: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename kubectl STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-cli] Kubectl client /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/kubectl.go:247 [It] should check is all data is printed [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:45:21.091: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-1304 version' Aug 18 11:45:21.200: INFO: stderr: "" Aug 18 11:45:21.200: INFO: stdout: "Client Version: version.Info{Major:\"1\", Minor:\"19\", GitVersion:\"v1.19.12\", GitCommit:\"2cb4598553d0a2ca5f3eb7980c99cd8236cc5011\", GitTreeState:\"clean\", BuildDate:\"2021-06-16T13:00:29Z\", GoVersion:\"go1.15.13\", Compiler:\"gc\", Platform:\"linux/amd64\"}\nServer Version: version.Info{Major:\"1\", Minor:\"19\", GitVersion:\"v1.19.8\", GitCommit:\"fd5d41537aee486160ad9b5356a9d82363273721\", GitTreeState:\"clean\", BuildDate:\"2021-02-17T12:33:08Z\", GoVersion:\"go1.15.8\", Compiler:\"gc\", Platform:\"linux/amd64\"}\n" [AfterEach] [sig-cli] Kubectl client /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:45:21.201: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "kubectl-1304" for this suite. • ------------------------------ [BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:45:11.536: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename webhook STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:87 STEP: Setting up server cert STEP: Create role binding to let webhook read extension-apiserver-authentication STEP: Deploying the webhook pod STEP: Wait for the deployment to be ready Aug 18 11:45:12.216: INFO: deployment "sample-webhook-deployment" doesn't have the required revision set Aug 18 11:45:14.224: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764883912, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764883912, loc:(*time.Location)(0x77169a0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764883912, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764883912, loc:(*time.Location)(0x77169a0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-cbccbf6bb\" is progressing."}}, CollisionCount:(*int32)(nil)} STEP: Deploying the webhook service STEP: Verifying the service has paired with the endpoint Aug 18 11:45:17.235: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1 [It] should be able to deny pod and configmap creation [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Registering the webhook via the AdmissionRegistration API STEP: create a pod that should be denied by the webhook STEP: create a pod that causes the webhook to hang STEP: create a configmap that should be denied by the webhook STEP: create a configmap that should be admitted by the webhook STEP: update (PUT) the admitted configmap to a non-compliant one should be rejected by the webhook STEP: update (PATCH) the admitted configmap to a non-compliant one should be rejected by the webhook STEP: create a namespace that bypass the webhook STEP: create a configmap that violates the webhook policy but is in a whitelisted namespace [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:45:27.324: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "webhook-3755" for this suite. STEP: Destroying namespace "webhook-3755-markers" for this suite. [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:102 • [SLOW TEST:15.824 seconds] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23 should be able to deny pod and configmap creation [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should be able to deny pod and configmap creation [Conformance]","total":-1,"completed":27,"skipped":623,"failed":3,"failures":["[k8s.io] InitContainer [NodeConformance] should invoke init containers on a RestartAlways pod [Conformance]","[k8s.io] Pods should allow activeDeadlineSeconds to be updated [NodeConformance] [Conformance]","[k8s.io] Variable Expansion should allow substituting values in a container's args [NodeConformance] [Conformance]"]} SSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-api-machinery] Garbage collector /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:45:27.396: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename gc STEP: Waiting for a default service account to be provisioned in namespace [It] should delete RS created by deployment when not orphaning [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: create the deployment STEP: Wait for the Deployment to create new ReplicaSet STEP: delete the deployment STEP: wait for all rs to be garbage collected STEP: expected 0 rs, got 1 rs STEP: expected 0 pods, got 2 pods STEP: Gathering metrics W0818 11:45:28.458536 29 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:46:30.476: INFO: MetricsGrabber failed grab metrics. Skipping metrics gathering. [AfterEach] [sig-api-machinery] Garbage collector /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:46:30.476: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "gc-652" for this suite. • [SLOW TEST:63.090 seconds] [sig-api-machinery] Garbage collector /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23 should delete RS created by deployment when not orphaning [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-api-machinery] Garbage collector should delete RS created by deployment when not orphaning [Conformance]","total":-1,"completed":28,"skipped":638,"failed":3,"failures":["[k8s.io] InitContainer [NodeConformance] should invoke init containers on a RestartAlways pod [Conformance]","[k8s.io] Pods should allow activeDeadlineSeconds to be updated [NodeConformance] [Conformance]","[k8s.io] Variable Expansion should allow substituting values in a container's args [NodeConformance] [Conformance]"]} SSSSSSSSS ------------------------------ [BeforeEach] [sig-storage] Projected configMap /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:46:30.510: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename projected STEP: Waiting for a default service account to be provisioned in namespace [It] should be consumable from pods in volume [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating configMap with name projected-configmap-test-volume-5c31d0ed-4b82-4c77-9e27-7341feb1963d STEP: Creating a pod to test consume configMaps Aug 18 11:46:30.548: INFO: Waiting up to 5m0s for pod "pod-projected-configmaps-76acf77a-d607-4ad8-8a03-984f3cf2eeb3" in namespace "projected-9377" to be "Succeeded or Failed" Aug 18 11:46:30.550: INFO: Pod "pod-projected-configmaps-76acf77a-d607-4ad8-8a03-984f3cf2eeb3": Phase="Pending", Reason="", readiness=false. Elapsed: 1.864527ms Aug 18 11:46:32.553: INFO: Pod "pod-projected-configmaps-76acf77a-d607-4ad8-8a03-984f3cf2eeb3": Phase="Pending", Reason="", readiness=false. Elapsed: 2.004950853s Aug 18 11:46:34.556: INFO: Pod "pod-projected-configmaps-76acf77a-d607-4ad8-8a03-984f3cf2eeb3": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.007941898s STEP: Saw pod success Aug 18 11:46:34.556: INFO: Pod "pod-projected-configmaps-76acf77a-d607-4ad8-8a03-984f3cf2eeb3" satisfied condition "Succeeded or Failed" Aug 18 11:46:34.558: INFO: Trying to get logs from node node1 pod pod-projected-configmaps-76acf77a-d607-4ad8-8a03-984f3cf2eeb3 container projected-configmap-volume-test: STEP: delete the pod Aug 18 11:46:34.572: INFO: Waiting for pod pod-projected-configmaps-76acf77a-d607-4ad8-8a03-984f3cf2eeb3 to disappear Aug 18 11:46:34.573: INFO: Pod pod-projected-configmaps-76acf77a-d607-4ad8-8a03-984f3cf2eeb3 no longer exists [AfterEach] [sig-storage] Projected configMap /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:46:34.574: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "projected-9377" for this suite. • ------------------------------ {"msg":"PASSED [sig-storage] Projected configMap should be consumable from pods in volume [NodeConformance] [Conformance]","total":-1,"completed":29,"skipped":647,"failed":3,"failures":["[k8s.io] InitContainer [NodeConformance] should invoke init containers on a RestartAlways pod [Conformance]","[k8s.io] Pods should allow activeDeadlineSeconds to be updated [NodeConformance] [Conformance]","[k8s.io] Variable Expansion should allow substituting values in a container's args [NodeConformance] [Conformance]"]} SS ------------------------------ [BeforeEach] [k8s.io] Security Context /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:41:33.764: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename security-context-test STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [k8s.io] Security Context /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/security_context.go:41 [It] should run the container as unprivileged when false [LinuxOnly] [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:41:33.798: INFO: Waiting up to 5m0s for pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665" in namespace "security-context-test-4344" to be "Succeeded or Failed" Aug 18 11:41:33.799: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 1.784049ms Aug 18 11:41:35.802: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 2.004594111s Aug 18 11:41:37.805: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 4.007115371s Aug 18 11:41:39.807: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 6.009765689s Aug 18 11:41:41.810: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 8.01278842s Aug 18 11:41:43.813: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 10.015795131s Aug 18 11:41:45.817: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 12.01970402s Aug 18 11:41:47.820: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 14.022855725s Aug 18 11:41:49.823: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 16.02551244s Aug 18 11:41:51.826: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 18.028574759s Aug 18 11:41:53.829: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 20.031567323s Aug 18 11:41:55.832: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 22.034621543s Aug 18 11:41:57.834: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 24.036844102s Aug 18 11:41:59.837: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 26.039458968s Aug 18 11:42:01.841: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 28.042875046s Aug 18 11:42:03.845: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 30.04710685s Aug 18 11:42:05.848: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 32.050657455s Aug 18 11:42:07.851: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 34.053737037s Aug 18 11:42:09.855: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 36.057668461s Aug 18 11:42:11.860: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 38.06277004s Aug 18 11:42:13.864: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 40.066615985s Aug 18 11:42:15.867: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 42.069793676s Aug 18 11:42:17.870: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 44.072701968s Aug 18 11:42:19.874: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 46.076177562s Aug 18 11:42:21.877: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 48.079159849s Aug 18 11:42:23.879: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 50.08174209s Aug 18 11:42:25.885: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 52.087352729s Aug 18 11:42:27.888: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 54.090388149s Aug 18 11:42:29.891: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 56.093394569s Aug 18 11:42:31.896: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 58.09821862s Aug 18 11:42:33.900: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.102632532s Aug 18 11:42:35.905: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.10728656s Aug 18 11:42:37.908: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.110729204s Aug 18 11:42:39.912: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.113882733s Aug 18 11:42:41.915: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.117578278s Aug 18 11:42:43.918: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.120803618s Aug 18 11:42:45.921: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.123498568s Aug 18 11:42:47.924: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.126760214s Aug 18 11:42:49.929: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.130953883s Aug 18 11:42:51.934: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.136752347s Aug 18 11:42:53.937: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.139360483s Aug 18 11:42:55.939: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.14180726s Aug 18 11:42:57.942: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.144869179s Aug 18 11:42:59.947: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.148893792s Aug 18 11:43:01.951: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.152925841s Aug 18 11:43:03.954: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.156647657s Aug 18 11:43:05.958: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.160380092s Aug 18 11:43:07.961: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.163394657s Aug 18 11:43:09.965: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.16721488s Aug 18 11:43:11.968: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.170725747s Aug 18 11:43:13.972: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.17392974s Aug 18 11:43:15.975: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.17735176s Aug 18 11:43:17.978: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.180557712s Aug 18 11:43:19.982: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.184170567s Aug 18 11:43:21.985: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.187550774s Aug 18 11:43:23.988: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.190754928s Aug 18 11:43:25.991: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.193858861s Aug 18 11:43:27.995: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.197320696s Aug 18 11:43:29.999: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.201742615s Aug 18 11:43:32.003: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.205851858s Aug 18 11:43:34.006: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.208664241s Aug 18 11:43:36.009: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.211525042s Aug 18 11:43:38.013: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.215279731s Aug 18 11:43:40.016: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.218760501s Aug 18 11:43:42.020: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.22188135s Aug 18 11:43:44.022: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.224766192s Aug 18 11:43:46.028: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.229998283s Aug 18 11:43:48.033: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.235112373s Aug 18 11:43:50.038: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.240565098s Aug 18 11:43:52.045: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.247515226s Aug 18 11:43:54.048: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.250473906s Aug 18 11:43:56.051: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.253844264s Aug 18 11:43:58.055: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.257209186s Aug 18 11:44:00.058: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.259929662s Aug 18 11:44:02.061: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.263158031s Aug 18 11:44:04.064: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.266209561s Aug 18 11:44:06.067: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.26980713s Aug 18 11:44:08.071: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.273223123s Aug 18 11:44:10.074: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.276752881s Aug 18 11:44:12.079: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.280925656s Aug 18 11:44:14.081: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.283622817s Aug 18 11:44:16.086: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.288048784s Aug 18 11:44:18.089: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.29134932s Aug 18 11:44:20.092: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.294744019s Aug 18 11:44:22.096: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.297986149s Aug 18 11:44:24.098: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.300788568s Aug 18 11:44:26.103: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.305330478s Aug 18 11:44:28.106: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.308788076s Aug 18 11:44:30.110: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.312048154s Aug 18 11:44:32.114: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.316530626s Aug 18 11:44:34.118: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.320010716s Aug 18 11:44:36.120: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.322806876s Aug 18 11:44:38.124: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.326103955s Aug 18 11:44:40.127: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.329781094s Aug 18 11:44:42.130: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.332873814s Aug 18 11:44:44.134: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.336184912s Aug 18 11:44:46.137: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.339870228s Aug 18 11:44:48.141: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.343260863s Aug 18 11:44:50.144: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.346329586s Aug 18 11:44:52.147: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.348910919s Aug 18 11:44:54.150: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.35277945s Aug 18 11:44:56.153: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.355768037s Aug 18 11:44:58.158: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.360783557s Aug 18 11:45:00.161: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.36360673s Aug 18 11:45:02.165: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.367308747s Aug 18 11:45:04.168: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.369879181s Aug 18 11:45:06.170: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.372504191s Aug 18 11:45:08.173: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.375551847s Aug 18 11:45:10.177: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.379659102s Aug 18 11:45:12.181: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.383518136s Aug 18 11:45:14.184: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.386544577s Aug 18 11:45:16.187: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.389836373s Aug 18 11:45:18.190: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.392290352s Aug 18 11:45:20.193: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.395137884s Aug 18 11:45:22.196: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.398008863s Aug 18 11:45:24.199: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.401505291s Aug 18 11:45:26.202: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.404283419s Aug 18 11:45:28.204: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.40682749s Aug 18 11:45:30.207: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.409536673s Aug 18 11:45:32.211: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.413179554s Aug 18 11:45:34.214: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.416239127s Aug 18 11:45:36.220: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.422367161s Aug 18 11:45:38.223: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.425169584s Aug 18 11:45:40.226: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.427994463s Aug 18 11:45:42.229: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.431330315s Aug 18 11:45:44.233: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.43514991s Aug 18 11:45:46.240: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.442085469s Aug 18 11:45:48.243: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.445718339s Aug 18 11:45:50.246: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.448520731s Aug 18 11:45:52.249: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.451535181s Aug 18 11:45:54.252: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.454714054s Aug 18 11:45:56.255: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.457670693s Aug 18 11:45:58.258: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.460793496s Aug 18 11:46:00.262: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.464293274s Aug 18 11:46:02.266: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.468649704s Aug 18 11:46:04.270: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.472091774s Aug 18 11:46:06.274: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.476126651s Aug 18 11:46:08.278: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.479883266s Aug 18 11:46:10.281: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.482907512s Aug 18 11:46:12.284: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.486755128s Aug 18 11:46:14.288: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.490090678s Aug 18 11:46:16.290: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.492784832s Aug 18 11:46:18.294: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.496023756s Aug 18 11:46:20.298: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.500368981s Aug 18 11:46:22.303: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.505685239s Aug 18 11:46:24.306: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.508272869s Aug 18 11:46:26.309: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.51165799s Aug 18 11:46:28.313: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.515687665s Aug 18 11:46:30.317: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.519697946s Aug 18 11:46:32.321: INFO: Pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.523315246s Aug 18 11:46:34.322: FAIL: wait for pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665" to succeed Expected success, but got an error: <*errors.errorString | 0xc003b78150>: { s: "Gave up after waiting 5m0s for pod \"busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665\" to be \"Succeeded or Failed\"", } Gave up after waiting 5m0s for pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665" to be "Succeeded or Failed" Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*PodClient).WaitForSuccess(0xc0011da6a0, 0xc0049efe00, 0x3d, 0x45d964b800) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:212 +0x2bb k8s.io/kubernetes/test/e2e/common.glob..func29.5.2(0x0, 0x0, 0xc0011da6a0) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/security_context.go:255 +0x1ec k8s.io/kubernetes/test/e2e/common.glob..func29.5.3() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/security_context.go:265 +0x48 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc001a9de00) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc001a9de00) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc001a9de00, 0x4deb2c0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] Security Context /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "security-context-test-4344". STEP: Found 9 events. Aug 18 11:46:34.327: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665: { } Scheduled: Successfully assigned security-context-test-4344/busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665 to node1 Aug 18 11:46:34.327: INFO: At 2021-08-18 11:41:35 +0000 UTC - event for busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665: {multus } AddedInterface: Add eth0 [10.244.4.52/24] Aug 18 11:46:34.327: INFO: At 2021-08-18 11:41:35 +0000 UTC - event for busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665: {kubelet node1} Pulling: Pulling image "docker.io/library/busybox:1.29" Aug 18 11:46:34.327: INFO: At 2021-08-18 11:41:36 +0000 UTC - event for busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665: {kubelet node1} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit Aug 18 11:46:34.327: INFO: At 2021-08-18 11:41:36 +0000 UTC - event for busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665: {kubelet node1} Failed: Error: ErrImagePull Aug 18 11:46:34.327: INFO: At 2021-08-18 11:41:36 +0000 UTC - event for busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665: {kubelet node1} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Aug 18 11:46:34.327: INFO: At 2021-08-18 11:41:38 +0000 UTC - event for busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665: {multus } AddedInterface: Add eth0 [10.244.4.53/24] Aug 18 11:46:34.327: INFO: At 2021-08-18 11:41:38 +0000 UTC - event for busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665: {kubelet node1} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" Aug 18 11:46:34.327: INFO: At 2021-08-18 11:41:38 +0000 UTC - event for busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665: {kubelet node1} Failed: Error: ImagePullBackOff Aug 18 11:46:34.329: INFO: POD NODE PHASE GRACE CONDITIONS Aug 18 11:46:34.329: INFO: busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665 node1 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:41:33 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:41:33 +0000 UTC ContainersNotReady containers with unready status: [busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:41:33 +0000 UTC ContainersNotReady containers with unready status: [busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:41:33 +0000 UTC }] Aug 18 11:46:34.329: INFO: Aug 18 11:46:34.333: INFO: Logging node info for node master1 Aug 18 11:46:34.336: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 ebb211fa-503f-4cfe-b1ed-c95d27a70e6e 69446 0 2021-08-18 08:20:52 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"3a:82:be:72:b5:15"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:20:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:20:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:25:59 +0000 UTC,LastTransitionTime:2021-08-18 08:25:59 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:46:26 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:46:26 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:46:26 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:46:26 +0000 UTC,LastTransitionTime:2021-08-18 08:25:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:58c3e57359b641ad92fa1959f2fecf5d,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:012cd796-2076-45d6-8b14-d3e0451b1e64,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[@ :],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:46:34.337: INFO: Logging kubelet events for node master1 Aug 18 11:46:34.339: INFO: Logging pods the kubelet thinks is on node master1 Aug 18 11:46:34.350: INFO: kube-controller-manager-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:34.350: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:46:34.350: INFO: kube-multus-ds-amd64-kbcp6 started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:34.350: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:46:34.350: INFO: docker-registry-docker-registry-56cbc7bc58-49kl2 started at 2021-08-18 08:26:23 +0000 UTC (0+2 container statuses recorded) Aug 18 11:46:34.350: INFO: Container docker-registry ready: true, restart count 0 Aug 18 11:46:34.350: INFO: Container nginx ready: true, restart count 0 Aug 18 11:46:34.350: INFO: node-exporter-5hwz9 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:46:34.350: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:46:34.350: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:46:34.350: INFO: kube-apiserver-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:34.350: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:46:34.350: INFO: kube-proxy-vqk4v started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:34.350: INFO: Container kube-proxy ready: true, restart count 1 Aug 18 11:46:34.350: INFO: kube-flannel-q64cq started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:46:34.350: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:46:34.350: INFO: Container kube-flannel ready: true, restart count 3 Aug 18 11:46:34.350: INFO: coredns-7677f9bb54-kn2qg started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:34.350: INFO: Container coredns ready: true, restart count 2 Aug 18 11:46:34.350: INFO: kube-scheduler-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:34.350: INFO: Container kube-scheduler ready: true, restart count 0 W0818 11:46:34.361896 34 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:46:34.387: INFO: Latency metrics for node master1 Aug 18 11:46:34.387: INFO: Logging node info for node master2 Aug 18 11:46:34.390: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 78946293-3abe-4442-84d4-8ed6b1d15ce0 69439 0 2021-08-18 08:21:31 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"7e:f5:c2:cc:3a:b4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:21:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:21:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-08-18 08:29:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:46:25 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:46:25 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:46:25 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:46:25 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0c44122c7a7248c18d8571e1cc667258,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:0cd329f2-48e0-4c8f-b8b9-fa3ae0ed8406,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:46:34.390: INFO: Logging kubelet events for node master2 Aug 18 11:46:34.393: INFO: Logging pods the kubelet thinks is on node master2 Aug 18 11:46:34.404: INFO: kube-controller-manager-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:34.404: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:46:34.404: INFO: kube-proxy-kh2l9 started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:34.404: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:46:34.404: INFO: kube-flannel-pp56h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:46:34.404: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:46:34.404: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:46:34.404: INFO: node-feature-discovery-controller-5bf5c49849-mq57c started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:34.404: INFO: Container nfd-controller ready: true, restart count 0 Aug 18 11:46:34.404: INFO: node-exporter-48nfx started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:46:34.404: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:46:34.404: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:46:34.404: INFO: kube-apiserver-master2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:34.404: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:46:34.404: INFO: kube-scheduler-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:34.404: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:46:34.404: INFO: kube-multus-ds-amd64-mld8g started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:34.404: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:46:34.404: INFO: dns-autoscaler-5b7b5c9b6f-hh47r started at 2021-08-18 08:23:57 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:34.404: INFO: Container autoscaler ready: true, restart count 2 W0818 11:46:34.417251 34 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:46:34.443: INFO: Latency metrics for node master2 Aug 18 11:46:34.443: INFO: Logging node info for node master3 Aug 18 11:46:34.446: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 44feac2b-9447-4be2-9fcd-62f836d67c72 69472 0 2021-08-18 08:21:41 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"86:e4:31:99:58:40"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {kubelet Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:46:30 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:46:30 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:46:30 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:46:30 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1fae19ae59884c44899bcd08aa243244,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:5db926c5-6530-4635-a0d5-806974a3b732,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:46:34.446: INFO: Logging kubelet events for node master3 Aug 18 11:46:34.449: INFO: Logging pods the kubelet thinks is on node master3 Aug 18 11:46:34.460: INFO: kube-multus-ds-amd64-bkw6c started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:34.460: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:46:34.460: INFO: coredns-7677f9bb54-5hxfh started at 2021-08-18 08:23:54 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:34.460: INFO: Container coredns ready: true, restart count 1 Aug 18 11:46:34.460: INFO: node-exporter-vq7d8 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:46:34.460: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:46:34.460: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:46:34.460: INFO: kube-controller-manager-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:34.460: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:46:34.460: INFO: kube-scheduler-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:34.460: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:46:34.460: INFO: kube-apiserver-master3 started at 2021-08-18 08:29:12 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:34.460: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:46:34.460: INFO: kube-proxy-sd5lc started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:34.460: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:46:34.460: INFO: kube-flannel-x6tlr started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:46:34.460: INFO: Init container install-cni ready: true, restart count 1 Aug 18 11:46:34.460: INFO: Container kube-flannel ready: true, restart count 1 W0818 11:46:34.474258 34 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:46:34.502: INFO: Latency metrics for node master3 Aug 18 11:46:34.502: INFO: Logging node info for node node1 Aug 18 11:46:34.504: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 84defabd-6ebf-43ec-a629-44c6713da9c9 69458 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"9a:87:55:36:7b:df"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:13 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:35 +0000 UTC,LastTransitionTime:2021-08-18 08:26:35 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:46:30 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:46:30 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:46:30 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:46:30 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:69946ff2b7bc462fa25eb7adb4703c23,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:736dc52f-f5e3-494e-86ca-01eedbea015c,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:a7cea43d9d2f67c38fbf0407786edbe660ee9072945f7bb272b55fd255e8eaca opnfv/barometer-collectd:stable],SizeBytes:1075746799,},ContainerImage{Names:[@ :],SizeBytes:1003788820,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[aquasec/kube-hunter@sha256:2be6820bc1d7e0f57193a9a27d5a3e16b2fd93c53747b03ce8ca48c6fc323781 aquasec/kube-hunter:0.3.1],SizeBytes:347611549,},ContainerImage{Names:[golang@sha256:db2475a1dbb2149508e5db31d7d77a75e6600d54be645f37681f03f2762169ba golang:alpine3.12],SizeBytes:301186719,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:de25c7fc6c4f3a27c7f0c2dff454e4671823a34d88abd533f210848d527e0fbb alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:46:34.505: INFO: Logging kubelet events for node node1 Aug 18 11:46:34.507: INFO: Logging pods the kubelet thinks is on node node1 Aug 18 11:46:34.526: INFO: kube-proxy-p6jvp started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:34.526: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:46:34.526: INFO: kubernetes-metrics-scraper-678c97765c-9nsv5 started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:34.526: INFO: Container kubernetes-metrics-scraper ready: true, restart count 2 Aug 18 11:46:34.526: INFO: cmk-init-discover-node1-bxznx started at 2021-08-18 08:32:10 +0000 UTC (0+3 container statuses recorded) Aug 18 11:46:34.526: INFO: Container discover ready: false, restart count 0 Aug 18 11:46:34.526: INFO: Container init ready: false, restart count 0 Aug 18 11:46:34.526: INFO: Container install ready: false, restart count 0 Aug 18 11:46:34.526: INFO: cmk-d8r27 started at 2021-08-18 08:32:52 +0000 UTC (0+2 container statuses recorded) Aug 18 11:46:34.526: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:46:34.526: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:46:34.526: INFO: collectd-xdprr started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:46:34.526: INFO: Container collectd ready: true, restart count 0 Aug 18 11:46:34.526: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:46:34.526: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:46:34.526: INFO: nginx-proxy-node1 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:34.526: INFO: Container nginx-proxy ready: true, restart count 2 Aug 18 11:46:34.526: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-vsxvg started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:34.526: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:46:34.526: INFO: fail-once-local-8rxnh started at 2021-08-18 11:34:14 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:34.526: INFO: Container c ready: false, restart count 0 Aug 18 11:46:34.526: INFO: busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665 started at 2021-08-18 11:41:33 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:34.526: INFO: Container busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665 ready: false, restart count 0 Aug 18 11:46:34.526: INFO: test-webserver-6d6ecfd9-c69b-4d5b-867a-e2160ea50524 started at 2021-08-18 11:42:58 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:34.526: INFO: Container test-webserver ready: true, restart count 0 Aug 18 11:46:34.526: INFO: termination-message-container0695240e-6103-4528-845b-e45cb7a8bd7f started at 2021-08-18 11:43:31 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:34.526: INFO: Container termination-message-container ready: false, restart count 0 Aug 18 11:46:34.526: INFO: pod-projected-configmaps-76acf77a-d607-4ad8-8a03-984f3cf2eeb3 started at 2021-08-18 11:46:30 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:34.526: INFO: Container projected-configmap-volume-test ready: false, restart count 0 Aug 18 11:46:34.526: INFO: kube-flannel-q78nd started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:46:34.526: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:46:34.526: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:46:34.526: INFO: prometheus-k8s-0 started at 2021-08-18 08:34:03 +0000 UTC (0+5 container statuses recorded) Aug 18 11:46:34.526: INFO: Container custom-metrics-apiserver ready: true, restart count 0 Aug 18 11:46:34.526: INFO: Container grafana ready: true, restart count 0 Aug 18 11:46:34.526: INFO: Container prometheus ready: true, restart count 1 Aug 18 11:46:34.526: INFO: Container prometheus-config-reloader ready: true, restart count 0 Aug 18 11:46:34.526: INFO: Container rules-configmap-reloader ready: true, restart count 0 Aug 18 11:46:34.526: INFO: kube-multus-ds-amd64-rrvmb started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:34.526: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:46:34.526: INFO: node-feature-discovery-worker-pflgw started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:34.526: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:46:34.526: INFO: node-exporter-kcwvn started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:46:34.526: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:46:34.526: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:46:34.526: INFO: pod-exec-websocket-bcecdfc1-0c3c-45a9-8652-d4ffebd4fba3 started at 2021-08-18 11:45:21 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:34.526: INFO: Container main ready: false, restart count 0 Aug 18 11:46:34.526: INFO: pod-adoption-release started at 2021-08-18 11:41:47 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:34.526: INFO: Container pod-adoption-release ready: false, restart count 0 W0818 11:46:34.539119 34 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:46:34.579: INFO: Latency metrics for node node1 Aug 18 11:46:34.579: INFO: Logging node info for node node2 Aug 18 11:46:34.582: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 1d01177e-3dbb-48a1-a0bc-d18af27ab7f8 69450 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:d1:47:f8:1d:22"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:36 +0000 UTC,LastTransitionTime:2021-08-18 08:26:36 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:46:27 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:46:27 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:46:27 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:46:27 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:dc1f286135c145349b8a016880b65a2f,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:037e7e2d-94e9-42f4-a719-896e5005ac70,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:46:34.583: INFO: Logging kubelet events for node node2 Aug 18 11:46:34.584: INFO: Logging pods the kubelet thinks is on node node2 Aug 18 11:46:34.595: INFO: kube-multus-ds-amd64-rvzsg started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:34.595: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:46:34.595: INFO: collectd-67ntq started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:46:34.595: INFO: Container collectd ready: true, restart count 0 Aug 18 11:46:34.595: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:46:34.595: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:46:34.595: INFO: server started at 2021-08-18 11:44:57 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:34.595: INFO: Container agnhost-container ready: true, restart count 0 Aug 18 11:46:34.595: INFO: cmk-webhook-6c9d5f8578-7cxjr started at 2021-08-18 08:32:53 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:34.595: INFO: Container cmk-webhook ready: true, restart count 0 Aug 18 11:46:34.595: INFO: termination-message-containerd34235c0-885f-4596-b8e2-47db8d79aee8 started at 2021-08-18 11:42:58 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:34.595: INFO: Container termination-message-container ready: false, restart count 0 Aug 18 11:46:34.595: INFO: tester started at 2021-08-18 11:45:01 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:34.595: INFO: Container tester ready: false, restart count 0 Aug 18 11:46:34.595: INFO: kube-flannel-h7t5h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:46:34.595: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:46:34.595: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:46:34.595: INFO: node-exporter-lrrf2 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:46:34.595: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:46:34.595: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:46:34.595: INFO: pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5 started at 2021-08-18 11:42:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:34.595: INFO: Container env-test ready: false, restart count 0 Aug 18 11:46:34.595: INFO: nginx-proxy-node2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:34.595: INFO: Container nginx-proxy ready: true, restart count 1 Aug 18 11:46:34.595: INFO: cmk-init-discover-node2-6b2kz started at 2021-08-18 08:32:30 +0000 UTC (0+3 container statuses recorded) Aug 18 11:46:34.595: INFO: Container discover ready: false, restart count 0 Aug 18 11:46:34.595: INFO: Container init ready: false, restart count 0 Aug 18 11:46:34.595: INFO: Container install ready: false, restart count 0 Aug 18 11:46:34.595: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-7rn45 started at 2021-08-18 08:36:42 +0000 UTC (0+2 container statuses recorded) Aug 18 11:46:34.595: INFO: Container tas-controller ready: true, restart count 0 Aug 18 11:46:34.595: INFO: Container tas-extender ready: true, restart count 0 Aug 18 11:46:34.595: INFO: fail-once-local-pk5cs started at 2021-08-18 11:34:14 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:34.595: INFO: Container c ready: false, restart count 0 Aug 18 11:46:34.595: INFO: kubernetes-dashboard-86c6f9df5b-qrtdk started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:34.595: INFO: Container kubernetes-dashboard ready: true, restart count 2 Aug 18 11:46:34.595: INFO: cmk-748rz started at 2021-08-18 08:32:53 +0000 UTC (0+2 container statuses recorded) Aug 18 11:46:34.595: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:46:34.595: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:46:34.595: INFO: kube-proxy-qkj9c started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:34.595: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:46:34.595: INFO: node-feature-discovery-worker-hzpf5 started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:34.595: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:46:34.595: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-c82pt started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:34.595: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:46:34.595: INFO: prometheus-operator-5bb8cb9d8f-k97ws started at 2021-08-18 08:33:38 +0000 UTC (0+2 container statuses recorded) Aug 18 11:46:34.595: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:46:34.595: INFO: Container prometheus-operator ready: true, restart count 0 W0818 11:46:34.606932 34 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:46:34.639: INFO: Latency metrics for node node2 Aug 18 11:46:34.639: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "security-context-test-4344" for this suite. • Failure [300.888 seconds] [k8s.io] Security Context /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 When creating a pod with privileged /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/security_context.go:227 should run the container as unprivileged when false [LinuxOnly] [NodeConformance] [Conformance] [It] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:46:34.322: wait for pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665" to succeed Expected success, but got an error: <*errors.errorString | 0xc003b78150>: { s: "Gave up after waiting 5m0s for pod \"busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665\" to be \"Succeeded or Failed\"", } Gave up after waiting 5m0s for pod "busybox-privileged-false-62ecd422-6423-4fce-9af7-2e63cb584665" to be "Succeeded or Failed" /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:212 ------------------------------ {"msg":"FAILED [k8s.io] Security Context When creating a pod with privileged should run the container as unprivileged when false [LinuxOnly] [NodeConformance] [Conformance]","total":-1,"completed":12,"skipped":133,"failed":4,"failures":["[k8s.io] Variable Expansion should verify that a failing subpath expansion can be modified during the lifecycle of a container [sig-storage][Slow] [Conformance]","[sig-apps] Deployment deployment should delete old replica sets [Conformance]","[k8s.io] Variable Expansion should succeed in writing subpaths in container [sig-storage][Slow] [Conformance]","[k8s.io] Security Context When creating a pod with privileged should run the container as unprivileged when false [LinuxOnly] [NodeConformance] [Conformance]"]} SSSS ------------------------------ [BeforeEach] [sig-apps] ReplicaSet /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:41:47.897: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename replicaset STEP: Waiting for a default service account to be provisioned in namespace [It] should adopt matching pods on creation and release no longer matching pods [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Given a Pod with a 'name' label pod-adoption-release is created Aug 18 11:46:47.938: FAIL: Unexpected error: <*errors.errorString | 0xc0002c2200>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*PodClient).CreateSync(0xc0040c9560, 0xc003101c00, 0x4bef98b) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:103 +0xfe k8s.io/kubernetes/test/e2e/apps.testRSAdoptMatchingAndReleaseNotMatching(0xc0005d7080) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/replica_set.go:264 +0x233 k8s.io/kubernetes/test/e2e/apps.glob..func9.4() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/replica_set.go:115 +0x2a k8s.io/kubernetes/test/e2e.RunE2ETests(0xc00359cc00) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc00359cc00) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc00359cc00, 0x4deb2c0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [sig-apps] ReplicaSet /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "replicaset-6654". STEP: Found 7 events. Aug 18 11:46:47.942: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for pod-adoption-release: { } Scheduled: Successfully assigned replicaset-6654/pod-adoption-release to node1 Aug 18 11:46:47.942: INFO: At 2021-08-18 11:41:50 +0000 UTC - event for pod-adoption-release: {multus } AddedInterface: Add eth0 [10.244.4.54/24] Aug 18 11:46:47.942: INFO: At 2021-08-18 11:41:50 +0000 UTC - event for pod-adoption-release: {kubelet node1} Pulling: Pulling image "docker.io/library/httpd:2.4.38-alpine" Aug 18 11:46:47.942: INFO: At 2021-08-18 11:41:51 +0000 UTC - event for pod-adoption-release: {kubelet node1} Failed: Failed to pull image "docker.io/library/httpd:2.4.38-alpine": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit Aug 18 11:46:47.942: INFO: At 2021-08-18 11:41:51 +0000 UTC - event for pod-adoption-release: {kubelet node1} Failed: Error: ErrImagePull Aug 18 11:46:47.942: INFO: At 2021-08-18 11:41:53 +0000 UTC - event for pod-adoption-release: {kubelet node1} BackOff: Back-off pulling image "docker.io/library/httpd:2.4.38-alpine" Aug 18 11:46:47.942: INFO: At 2021-08-18 11:41:53 +0000 UTC - event for pod-adoption-release: {kubelet node1} Failed: Error: ImagePullBackOff Aug 18 11:46:47.945: INFO: POD NODE PHASE GRACE CONDITIONS Aug 18 11:46:47.945: INFO: pod-adoption-release node1 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:41:47 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:41:47 +0000 UTC ContainersNotReady containers with unready status: [pod-adoption-release]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:41:47 +0000 UTC ContainersNotReady containers with unready status: [pod-adoption-release]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:41:47 +0000 UTC }] Aug 18 11:46:47.945: INFO: Aug 18 11:46:47.949: INFO: Logging node info for node master1 Aug 18 11:46:47.951: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 ebb211fa-503f-4cfe-b1ed-c95d27a70e6e 69635 0 2021-08-18 08:20:52 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"3a:82:be:72:b5:15"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:20:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:20:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:25:59 +0000 UTC,LastTransitionTime:2021-08-18 08:25:59 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:46:46 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:46:46 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:46:46 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:46:46 +0000 UTC,LastTransitionTime:2021-08-18 08:25:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:58c3e57359b641ad92fa1959f2fecf5d,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:012cd796-2076-45d6-8b14-d3e0451b1e64,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[@ :],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:46:47.951: INFO: Logging kubelet events for node master1 Aug 18 11:46:47.954: INFO: Logging pods the kubelet thinks is on node master1 Aug 18 11:46:47.964: INFO: kube-flannel-q64cq started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:46:47.964: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:46:47.964: INFO: Container kube-flannel ready: true, restart count 3 Aug 18 11:46:47.964: INFO: coredns-7677f9bb54-kn2qg started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:47.964: INFO: Container coredns ready: true, restart count 2 Aug 18 11:46:47.964: INFO: kube-scheduler-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:47.964: INFO: Container kube-scheduler ready: true, restart count 0 Aug 18 11:46:47.964: INFO: kube-apiserver-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:47.964: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:46:47.964: INFO: kube-proxy-vqk4v started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:47.964: INFO: Container kube-proxy ready: true, restart count 1 Aug 18 11:46:47.964: INFO: kube-multus-ds-amd64-kbcp6 started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:47.964: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:46:47.964: INFO: docker-registry-docker-registry-56cbc7bc58-49kl2 started at 2021-08-18 08:26:23 +0000 UTC (0+2 container statuses recorded) Aug 18 11:46:47.964: INFO: Container docker-registry ready: true, restart count 0 Aug 18 11:46:47.964: INFO: Container nginx ready: true, restart count 0 Aug 18 11:46:47.964: INFO: node-exporter-5hwz9 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:46:47.964: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:46:47.964: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:46:47.964: INFO: kube-controller-manager-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:47.964: INFO: Container kube-controller-manager ready: true, restart count 2 W0818 11:46:47.977355 23 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:46:48.002: INFO: Latency metrics for node master1 Aug 18 11:46:48.002: INFO: Logging node info for node master2 Aug 18 11:46:48.005: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 78946293-3abe-4442-84d4-8ed6b1d15ce0 69626 0 2021-08-18 08:21:31 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"7e:f5:c2:cc:3a:b4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:21:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:21:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-08-18 08:29:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:46:45 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:46:45 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:46:45 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:46:45 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0c44122c7a7248c18d8571e1cc667258,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:0cd329f2-48e0-4c8f-b8b9-fa3ae0ed8406,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:46:48.005: INFO: Logging kubelet events for node master2 Aug 18 11:46:48.007: INFO: Logging pods the kubelet thinks is on node master2 Aug 18 11:46:48.015: INFO: node-feature-discovery-controller-5bf5c49849-mq57c started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:48.015: INFO: Container nfd-controller ready: true, restart count 0 Aug 18 11:46:48.015: INFO: node-exporter-48nfx started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:46:48.015: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:46:48.015: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:46:48.015: INFO: kube-apiserver-master2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:48.015: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:46:48.015: INFO: kube-scheduler-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:48.015: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:46:48.015: INFO: kube-multus-ds-amd64-mld8g started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:48.015: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:46:48.015: INFO: dns-autoscaler-5b7b5c9b6f-hh47r started at 2021-08-18 08:23:57 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:48.015: INFO: Container autoscaler ready: true, restart count 2 Aug 18 11:46:48.015: INFO: kube-controller-manager-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:48.015: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:46:48.015: INFO: kube-proxy-kh2l9 started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:48.015: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:46:48.015: INFO: kube-flannel-pp56h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:46:48.015: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:46:48.015: INFO: Container kube-flannel ready: true, restart count 1 W0818 11:46:48.027903 23 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:46:48.052: INFO: Latency metrics for node master2 Aug 18 11:46:48.052: INFO: Logging node info for node master3 Aug 18 11:46:48.056: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 44feac2b-9447-4be2-9fcd-62f836d67c72 69609 0 2021-08-18 08:21:41 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"86:e4:31:99:58:40"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {kubelet Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:46:40 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:46:40 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:46:40 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:46:40 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1fae19ae59884c44899bcd08aa243244,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:5db926c5-6530-4635-a0d5-806974a3b732,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:46:48.056: INFO: Logging kubelet events for node master3 Aug 18 11:46:48.058: INFO: Logging pods the kubelet thinks is on node master3 Aug 18 11:46:48.065: INFO: coredns-7677f9bb54-5hxfh started at 2021-08-18 08:23:54 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:48.065: INFO: Container coredns ready: true, restart count 1 Aug 18 11:46:48.065: INFO: node-exporter-vq7d8 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:46:48.065: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:46:48.065: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:46:48.065: INFO: kube-controller-manager-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:48.066: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:46:48.066: INFO: kube-scheduler-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:48.066: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:46:48.066: INFO: kube-apiserver-master3 started at 2021-08-18 08:29:12 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:48.066: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:46:48.066: INFO: kube-proxy-sd5lc started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:48.066: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:46:48.066: INFO: kube-flannel-x6tlr started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:46:48.066: INFO: Init container install-cni ready: true, restart count 1 Aug 18 11:46:48.066: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:46:48.066: INFO: kube-multus-ds-amd64-bkw6c started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:48.066: INFO: Container kube-multus ready: true, restart count 1 W0818 11:46:48.077477 23 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:46:48.100: INFO: Latency metrics for node master3 Aug 18 11:46:48.100: INFO: Logging node info for node node1 Aug 18 11:46:48.103: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 84defabd-6ebf-43ec-a629-44c6713da9c9 69604 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"9a:87:55:36:7b:df"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:13 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:35 +0000 UTC,LastTransitionTime:2021-08-18 08:26:35 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:46:40 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:46:40 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:46:40 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:46:40 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:69946ff2b7bc462fa25eb7adb4703c23,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:736dc52f-f5e3-494e-86ca-01eedbea015c,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:a7cea43d9d2f67c38fbf0407786edbe660ee9072945f7bb272b55fd255e8eaca opnfv/barometer-collectd:stable],SizeBytes:1075746799,},ContainerImage{Names:[@ :],SizeBytes:1003788820,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[aquasec/kube-hunter@sha256:2be6820bc1d7e0f57193a9a27d5a3e16b2fd93c53747b03ce8ca48c6fc323781 aquasec/kube-hunter:0.3.1],SizeBytes:347611549,},ContainerImage{Names:[golang@sha256:db2475a1dbb2149508e5db31d7d77a75e6600d54be645f37681f03f2762169ba golang:alpine3.12],SizeBytes:301186719,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:de25c7fc6c4f3a27c7f0c2dff454e4671823a34d88abd533f210848d527e0fbb alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:46:48.103: INFO: Logging kubelet events for node node1 Aug 18 11:46:48.106: INFO: Logging pods the kubelet thinks is on node node1 Aug 18 11:46:48.121: INFO: nginx-proxy-node1 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:48.121: INFO: Container nginx-proxy ready: true, restart count 2 Aug 18 11:46:48.121: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-vsxvg started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:48.121: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:46:48.121: INFO: fail-once-local-8rxnh started at 2021-08-18 11:34:14 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:48.121: INFO: Container c ready: false, restart count 0 Aug 18 11:46:48.121: INFO: test-webserver-6d6ecfd9-c69b-4d5b-867a-e2160ea50524 started at 2021-08-18 11:42:58 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:48.121: INFO: Container test-webserver ready: true, restart count 0 Aug 18 11:46:48.121: INFO: termination-message-container0695240e-6103-4528-845b-e45cb7a8bd7f started at 2021-08-18 11:43:31 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:48.121: INFO: Container termination-message-container ready: false, restart count 0 Aug 18 11:46:48.121: INFO: kube-flannel-q78nd started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:46:48.121: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:46:48.121: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:46:48.121: INFO: prometheus-k8s-0 started at 2021-08-18 08:34:03 +0000 UTC (0+5 container statuses recorded) Aug 18 11:46:48.121: INFO: Container custom-metrics-apiserver ready: true, restart count 0 Aug 18 11:46:48.121: INFO: Container grafana ready: true, restart count 0 Aug 18 11:46:48.121: INFO: Container prometheus ready: true, restart count 1 Aug 18 11:46:48.121: INFO: Container prometheus-config-reloader ready: true, restart count 0 Aug 18 11:46:48.121: INFO: Container rules-configmap-reloader ready: true, restart count 0 Aug 18 11:46:48.121: INFO: kube-multus-ds-amd64-rrvmb started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:48.121: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:46:48.121: INFO: node-feature-discovery-worker-pflgw started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:48.121: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:46:48.121: INFO: node-exporter-kcwvn started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:46:48.121: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:46:48.121: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:46:48.121: INFO: pod-exec-websocket-bcecdfc1-0c3c-45a9-8652-d4ffebd4fba3 started at 2021-08-18 11:45:21 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:48.121: INFO: Container main ready: false, restart count 0 Aug 18 11:46:48.121: INFO: pod-adoption-release started at 2021-08-18 11:41:47 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:48.121: INFO: Container pod-adoption-release ready: false, restart count 0 Aug 18 11:46:48.121: INFO: kube-proxy-p6jvp started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:48.121: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:46:48.121: INFO: kubernetes-metrics-scraper-678c97765c-9nsv5 started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:48.121: INFO: Container kubernetes-metrics-scraper ready: true, restart count 2 Aug 18 11:46:48.121: INFO: cmk-init-discover-node1-bxznx started at 2021-08-18 08:32:10 +0000 UTC (0+3 container statuses recorded) Aug 18 11:46:48.121: INFO: Container discover ready: false, restart count 0 Aug 18 11:46:48.121: INFO: Container init ready: false, restart count 0 Aug 18 11:46:48.121: INFO: Container install ready: false, restart count 0 Aug 18 11:46:48.121: INFO: cmk-d8r27 started at 2021-08-18 08:32:52 +0000 UTC (0+2 container statuses recorded) Aug 18 11:46:48.121: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:46:48.121: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:46:48.121: INFO: collectd-xdprr started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:46:48.121: INFO: Container collectd ready: true, restart count 0 Aug 18 11:46:48.121: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:46:48.121: INFO: Container rbac-proxy ready: true, restart count 0 W0818 11:46:48.134684 23 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:46:48.177: INFO: Latency metrics for node node1 Aug 18 11:46:48.177: INFO: Logging node info for node node2 Aug 18 11:46:48.180: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 1d01177e-3dbb-48a1-a0bc-d18af27ab7f8 69637 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:d1:47:f8:1d:22"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:36 +0000 UTC,LastTransitionTime:2021-08-18 08:26:36 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:46:48 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:46:48 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:46:48 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:46:48 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:dc1f286135c145349b8a016880b65a2f,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:037e7e2d-94e9-42f4-a719-896e5005ac70,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:46:48.180: INFO: Logging kubelet events for node node2 Aug 18 11:46:48.183: INFO: Logging pods the kubelet thinks is on node node2 Aug 18 11:46:48.195: INFO: cmk-webhook-6c9d5f8578-7cxjr started at 2021-08-18 08:32:53 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:48.195: INFO: Container cmk-webhook ready: true, restart count 0 Aug 18 11:46:48.195: INFO: termination-message-containerd34235c0-885f-4596-b8e2-47db8d79aee8 started at 2021-08-18 11:42:58 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:48.195: INFO: Container termination-message-container ready: false, restart count 0 Aug 18 11:46:48.195: INFO: tester started at 2021-08-18 11:45:01 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:48.195: INFO: Container tester ready: false, restart count 0 Aug 18 11:46:48.195: INFO: kube-flannel-h7t5h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:46:48.196: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:46:48.196: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:46:48.196: INFO: node-exporter-lrrf2 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:46:48.196: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:46:48.196: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:46:48.196: INFO: pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70 started at 2021-08-18 11:46:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:48.196: INFO: Container env-test ready: false, restart count 0 Aug 18 11:46:48.196: INFO: pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5 started at 2021-08-18 11:42:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:48.196: INFO: Container env-test ready: false, restart count 0 Aug 18 11:46:48.196: INFO: nginx-proxy-node2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:48.196: INFO: Container nginx-proxy ready: true, restart count 1 Aug 18 11:46:48.196: INFO: cmk-init-discover-node2-6b2kz started at 2021-08-18 08:32:30 +0000 UTC (0+3 container statuses recorded) Aug 18 11:46:48.196: INFO: Container discover ready: false, restart count 0 Aug 18 11:46:48.196: INFO: Container init ready: false, restart count 0 Aug 18 11:46:48.196: INFO: Container install ready: false, restart count 0 Aug 18 11:46:48.196: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-7rn45 started at 2021-08-18 08:36:42 +0000 UTC (0+2 container statuses recorded) Aug 18 11:46:48.196: INFO: Container tas-controller ready: true, restart count 0 Aug 18 11:46:48.196: INFO: Container tas-extender ready: true, restart count 0 Aug 18 11:46:48.196: INFO: fail-once-local-pk5cs started at 2021-08-18 11:34:14 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:48.196: INFO: Container c ready: false, restart count 0 Aug 18 11:46:48.196: INFO: kubernetes-dashboard-86c6f9df5b-qrtdk started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:48.196: INFO: Container kubernetes-dashboard ready: true, restart count 2 Aug 18 11:46:48.196: INFO: cmk-748rz started at 2021-08-18 08:32:53 +0000 UTC (0+2 container statuses recorded) Aug 18 11:46:48.196: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:46:48.196: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:46:48.196: INFO: kube-proxy-qkj9c started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:48.196: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:46:48.196: INFO: node-feature-discovery-worker-hzpf5 started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:48.196: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:46:48.196: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-c82pt started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:48.196: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:46:48.196: INFO: prometheus-operator-5bb8cb9d8f-k97ws started at 2021-08-18 08:33:38 +0000 UTC (0+2 container statuses recorded) Aug 18 11:46:48.196: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:46:48.196: INFO: Container prometheus-operator ready: true, restart count 0 Aug 18 11:46:48.196: INFO: kube-multus-ds-amd64-rvzsg started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:48.196: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:46:48.196: INFO: collectd-67ntq started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:46:48.196: INFO: Container collectd ready: true, restart count 0 Aug 18 11:46:48.196: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:46:48.196: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:46:48.196: INFO: ss-0 started at 2021-08-18 11:46:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:48.196: INFO: Container webserver ready: false, restart count 0 Aug 18 11:46:48.196: INFO: server started at 2021-08-18 11:44:57 +0000 UTC (0+1 container statuses recorded) Aug 18 11:46:48.196: INFO: Container agnhost-container ready: true, restart count 0 W0818 11:46:48.209296 23 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:46:48.285: INFO: Latency metrics for node node2 Aug 18 11:46:48.285: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "replicaset-6654" for this suite. • Failure [300.397 seconds] [sig-apps] ReplicaSet /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/framework.go:23 should adopt matching pods on creation and release no longer matching pods [Conformance] [It] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:46:47.938: Unexpected error: <*errors.errorString | 0xc0002c2200>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:103 ------------------------------ {"msg":"FAILED [sig-apps] ReplicaSet should adopt matching pods on creation and release no longer matching pods [Conformance]","total":-1,"completed":6,"skipped":193,"failed":4,"failures":["[sig-apps] StatefulSet [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] Should recreate evicted statefulset [Conformance]","[sig-node] Downward API should provide pod UID as env vars [NodeConformance] [Conformance]","[sig-apps] ReplicationController should adopt matching pods on creation [Conformance]","[sig-apps] ReplicaSet should adopt matching pods on creation and release no longer matching pods [Conformance]"]} SSSSSSSSS ------------------------------ [BeforeEach] [sig-node] PodTemplates /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:46:48.318: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename podtemplate STEP: Waiting for a default service account to be provisioned in namespace [It] should run the lifecycle of PodTemplates [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 [AfterEach] [sig-node] PodTemplates /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:46:48.367: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "podtemplate-5244" for this suite. • ------------------------------ {"msg":"PASSED [sig-node] PodTemplates should run the lifecycle of PodTemplates [Conformance]","total":-1,"completed":7,"skipped":202,"failed":4,"failures":["[sig-apps] StatefulSet [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] Should recreate evicted statefulset [Conformance]","[sig-node] Downward API should provide pod UID as env vars [NodeConformance] [Conformance]","[sig-apps] ReplicationController should adopt matching pods on creation [Conformance]","[sig-apps] ReplicaSet should adopt matching pods on creation and release no longer matching pods [Conformance]"]} SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-storage] EmptyDir volumes /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:46:48.450: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename emptydir STEP: Waiting for a default service account to be provisioned in namespace [It] should support (non-root,0777,tmpfs) [LinuxOnly] [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating a pod to test emptydir 0777 on tmpfs Aug 18 11:46:48.484: INFO: Waiting up to 5m0s for pod "pod-d0b39bf2-192e-480c-930c-60eeaafa6177" in namespace "emptydir-6110" to be "Succeeded or Failed" Aug 18 11:46:48.486: INFO: Pod "pod-d0b39bf2-192e-480c-930c-60eeaafa6177": Phase="Pending", Reason="", readiness=false. Elapsed: 1.892242ms Aug 18 11:46:50.490: INFO: Pod "pod-d0b39bf2-192e-480c-930c-60eeaafa6177": Phase="Pending", Reason="", readiness=false. Elapsed: 2.006312696s Aug 18 11:46:52.493: INFO: Pod "pod-d0b39bf2-192e-480c-930c-60eeaafa6177": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.009040635s STEP: Saw pod success Aug 18 11:46:52.493: INFO: Pod "pod-d0b39bf2-192e-480c-930c-60eeaafa6177" satisfied condition "Succeeded or Failed" Aug 18 11:46:52.496: INFO: Trying to get logs from node node1 pod pod-d0b39bf2-192e-480c-930c-60eeaafa6177 container test-container: STEP: delete the pod Aug 18 11:46:52.511: INFO: Waiting for pod pod-d0b39bf2-192e-480c-930c-60eeaafa6177 to disappear Aug 18 11:46:52.514: INFO: Pod pod-d0b39bf2-192e-480c-930c-60eeaafa6177 no longer exists [AfterEach] [sig-storage] EmptyDir volumes /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:46:52.514: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "emptydir-6110" for this suite. • ------------------------------ {"msg":"PASSED [sig-storage] EmptyDir volumes should support (non-root,0777,tmpfs) [LinuxOnly] [NodeConformance] [Conformance]","total":-1,"completed":8,"skipped":235,"failed":4,"failures":["[sig-apps] StatefulSet [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] Should recreate evicted statefulset [Conformance]","[sig-node] Downward API should provide pod UID as env vars [NodeConformance] [Conformance]","[sig-apps] ReplicationController should adopt matching pods on creation [Conformance]","[sig-apps] ReplicaSet should adopt matching pods on creation and release no longer matching pods [Conformance]"]} S ------------------------------ [BeforeEach] [sig-cli] Kubectl client /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:46:52.526: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename kubectl STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-cli] Kubectl client /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/kubectl.go:247 [It] should add annotations for pods in rc [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: creating Agnhost RC Aug 18 11:46:52.547: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-5739 create -f -' Aug 18 11:46:52.868: INFO: stderr: "" Aug 18 11:46:52.868: INFO: stdout: "replicationcontroller/agnhost-primary created\n" STEP: Waiting for Agnhost primary to start. Aug 18 11:46:53.873: INFO: Selector matched 1 pods for map[app:agnhost] Aug 18 11:46:53.873: INFO: Found 0 / 1 Aug 18 11:46:54.871: INFO: Selector matched 1 pods for map[app:agnhost] Aug 18 11:46:54.871: INFO: Found 0 / 1 Aug 18 11:46:55.872: INFO: Selector matched 1 pods for map[app:agnhost] Aug 18 11:46:55.872: INFO: Found 1 / 1 Aug 18 11:46:55.872: INFO: WaitFor completed with timeout 5m0s. Pods found = 1 out of 1 STEP: patching all pods Aug 18 11:46:55.875: INFO: Selector matched 1 pods for map[app:agnhost] Aug 18 11:46:55.875: INFO: ForEach: Found 1 pods from the filter. Now looping through them. Aug 18 11:46:55.876: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-5739 patch pod agnhost-primary-cplhw -p {"metadata":{"annotations":{"x":"y"}}}' Aug 18 11:46:56.047: INFO: stderr: "" Aug 18 11:46:56.047: INFO: stdout: "pod/agnhost-primary-cplhw patched\n" STEP: checking annotations Aug 18 11:46:56.050: INFO: Selector matched 1 pods for map[app:agnhost] Aug 18 11:46:56.050: INFO: ForEach: Found 1 pods from the filter. Now looping through them. [AfterEach] [sig-cli] Kubectl client /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:46:56.050: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "kubectl-5739" for this suite. • ------------------------------ {"msg":"PASSED [sig-cli] Kubectl client Kubectl patch should add annotations for pods in rc [Conformance]","total":-1,"completed":9,"skipped":236,"failed":4,"failures":["[sig-apps] StatefulSet [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] Should recreate evicted statefulset [Conformance]","[sig-node] Downward API should provide pod UID as env vars [NodeConformance] [Conformance]","[sig-apps] ReplicationController should adopt matching pods on creation [Conformance]","[sig-apps] ReplicaSet should adopt matching pods on creation and release no longer matching pods [Conformance]"]} SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-storage] EmptyDir volumes /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:46:56.128: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename emptydir STEP: Waiting for a default service account to be provisioned in namespace [It] should support (root,0777,default) [LinuxOnly] [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating a pod to test emptydir 0777 on node default medium Aug 18 11:46:56.159: INFO: Waiting up to 5m0s for pod "pod-4372b2ad-57a7-422e-a090-70229940911b" in namespace "emptydir-5365" to be "Succeeded or Failed" Aug 18 11:46:56.162: INFO: Pod "pod-4372b2ad-57a7-422e-a090-70229940911b": Phase="Pending", Reason="", readiness=false. Elapsed: 2.812005ms Aug 18 11:46:58.164: INFO: Pod "pod-4372b2ad-57a7-422e-a090-70229940911b": Phase="Pending", Reason="", readiness=false. Elapsed: 2.005606062s Aug 18 11:47:00.167: INFO: Pod "pod-4372b2ad-57a7-422e-a090-70229940911b": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.008017607s STEP: Saw pod success Aug 18 11:47:00.167: INFO: Pod "pod-4372b2ad-57a7-422e-a090-70229940911b" satisfied condition "Succeeded or Failed" Aug 18 11:47:00.169: INFO: Trying to get logs from node node1 pod pod-4372b2ad-57a7-422e-a090-70229940911b container test-container: STEP: delete the pod Aug 18 11:47:00.183: INFO: Waiting for pod pod-4372b2ad-57a7-422e-a090-70229940911b to disappear Aug 18 11:47:00.184: INFO: Pod pod-4372b2ad-57a7-422e-a090-70229940911b no longer exists [AfterEach] [sig-storage] EmptyDir volumes /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:47:00.185: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "emptydir-5365" for this suite. • ------------------------------ {"msg":"PASSED [sig-storage] EmptyDir volumes should support (root,0777,default) [LinuxOnly] [NodeConformance] [Conformance]","total":-1,"completed":10,"skipped":268,"failed":4,"failures":["[sig-apps] StatefulSet [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] Should recreate evicted statefulset [Conformance]","[sig-node] Downward API should provide pod UID as env vars [NodeConformance] [Conformance]","[sig-apps] ReplicationController should adopt matching pods on creation [Conformance]","[sig-apps] ReplicaSet should adopt matching pods on creation and release no longer matching pods [Conformance]"]} SSSSSSSSS ------------------------------ [BeforeEach] [k8s.io] Probing container /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:42:58.455: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename container-probe STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [k8s.io] Probing container /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:54 [It] should *not* be restarted with a /healthz http liveness probe [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating pod test-webserver-6d6ecfd9-c69b-4d5b-867a-e2160ea50524 in namespace container-probe-3081 Aug 18 11:43:02.492: INFO: Started pod test-webserver-6d6ecfd9-c69b-4d5b-867a-e2160ea50524 in namespace container-probe-3081 STEP: checking the pod's current state and verifying that restartCount is present Aug 18 11:43:02.494: INFO: Initial restart count of pod test-webserver-6d6ecfd9-c69b-4d5b-867a-e2160ea50524 is 0 STEP: deleting the pod [AfterEach] [k8s.io] Probing container /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:47:02.950: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "container-probe-3081" for this suite. • [SLOW TEST:244.503 seconds] [k8s.io] Probing container /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 should *not* be restarted with a /healthz http liveness probe [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [k8s.io] Probing container should *not* be restarted with a /healthz http liveness probe [NodeConformance] [Conformance]","total":-1,"completed":6,"skipped":151,"failed":2,"failures":["[k8s.io] Variable Expansion should allow substituting values in a volume subpath [sig-storage] [Conformance]","[sig-apps] StatefulSet [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] should perform canary updates and phased rolling updates of template modifications [Conformance]"]} SSSSSSSSSS ------------------------------ [BeforeEach] [k8s.io] InitContainer [NodeConformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:47:00.218: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename init-container STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [k8s.io] InitContainer [NodeConformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/init_container.go:162 [It] should not start app containers and fail the pod if init containers fail on a RestartNever pod [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: creating the pod Aug 18 11:47:00.240: INFO: PodSpec: initContainers in spec.initContainers Aug 18 11:47:05.725: FAIL: Expected <*errors.errorString | 0xc0021cd630>: { s: "second init container should have reason PodInitializing: v1.ContainerStatus{Name:\"init1\", State:v1.ContainerState{Waiting:(*v1.ContainerStateWaiting)(0xc004df1640), Running:(*v1.ContainerStateRunning)(nil), Terminated:(*v1.ContainerStateTerminated)(nil)}, LastTerminationState:v1.ContainerState{Waiting:(*v1.ContainerStateWaiting)(nil), Running:(*v1.ContainerStateRunning)(nil), Terminated:(*v1.ContainerStateTerminated)(nil)}, Ready:false, RestartCount:0, Image:\"docker.io/library/busybox:1.29\", ImageID:\"\", ContainerID:\"\", Started:(*bool)(nil)}", } to be nil Full Stack Trace k8s.io/kubernetes/test/e2e/common.glob..func11.5() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/init_container.go:547 +0xdad k8s.io/kubernetes/test/e2e.RunE2ETests(0xc00359cc00) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc00359cc00) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc00359cc00, 0x4deb2c0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] InitContainer [NodeConformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "init-container-4314". STEP: Found 7 events. Aug 18 11:47:05.729: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for pod-init-0e12df14-5438-414c-9e57-016966ff75cd: { } Scheduled: Successfully assigned init-container-4314/pod-init-0e12df14-5438-414c-9e57-016966ff75cd to node1 Aug 18 11:47:05.729: INFO: At 2021-08-18 11:47:04 +0000 UTC - event for pod-init-0e12df14-5438-414c-9e57-016966ff75cd: {multus } AddedInterface: Add eth0 [10.244.4.73/24] Aug 18 11:47:05.729: INFO: At 2021-08-18 11:47:04 +0000 UTC - event for pod-init-0e12df14-5438-414c-9e57-016966ff75cd: {kubelet node1} Pulling: Pulling image "docker.io/library/busybox:1.29" Aug 18 11:47:05.729: INFO: At 2021-08-18 11:47:05 +0000 UTC - event for pod-init-0e12df14-5438-414c-9e57-016966ff75cd: {kubelet node1} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit Aug 18 11:47:05.729: INFO: At 2021-08-18 11:47:05 +0000 UTC - event for pod-init-0e12df14-5438-414c-9e57-016966ff75cd: {kubelet node1} Failed: Error: ErrImagePull Aug 18 11:47:05.729: INFO: At 2021-08-18 11:47:05 +0000 UTC - event for pod-init-0e12df14-5438-414c-9e57-016966ff75cd: {kubelet node1} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" Aug 18 11:47:05.729: INFO: At 2021-08-18 11:47:05 +0000 UTC - event for pod-init-0e12df14-5438-414c-9e57-016966ff75cd: {kubelet node1} Failed: Error: ImagePullBackOff Aug 18 11:47:05.732: INFO: POD NODE PHASE GRACE CONDITIONS Aug 18 11:47:05.732: INFO: pod-init-0e12df14-5438-414c-9e57-016966ff75cd node1 Pending [{Initialized False 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:47:00 +0000 UTC ContainersNotInitialized containers with incomplete status: [init1 init2]} {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:47:00 +0000 UTC ContainersNotReady containers with unready status: [run1]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:47:00 +0000 UTC ContainersNotReady containers with unready status: [run1]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:47:00 +0000 UTC }] Aug 18 11:47:05.732: INFO: Aug 18 11:47:05.736: INFO: Logging node info for node master1 Aug 18 11:47:05.738: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 ebb211fa-503f-4cfe-b1ed-c95d27a70e6e 69753 0 2021-08-18 08:20:52 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"3a:82:be:72:b5:15"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:20:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:20:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:25:59 +0000 UTC,LastTransitionTime:2021-08-18 08:25:59 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:46:56 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:46:56 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:46:56 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:46:56 +0000 UTC,LastTransitionTime:2021-08-18 08:25:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:58c3e57359b641ad92fa1959f2fecf5d,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:012cd796-2076-45d6-8b14-d3e0451b1e64,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[@ :],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:47:05.739: INFO: Logging kubelet events for node master1 Aug 18 11:47:05.741: INFO: Logging pods the kubelet thinks is on node master1 Aug 18 11:47:05.749: INFO: kube-controller-manager-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:05.749: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:47:05.749: INFO: kube-multus-ds-amd64-kbcp6 started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:05.749: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:47:05.749: INFO: docker-registry-docker-registry-56cbc7bc58-49kl2 started at 2021-08-18 08:26:23 +0000 UTC (0+2 container statuses recorded) Aug 18 11:47:05.749: INFO: Container docker-registry ready: true, restart count 0 Aug 18 11:47:05.749: INFO: Container nginx ready: true, restart count 0 Aug 18 11:47:05.749: INFO: node-exporter-5hwz9 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:47:05.749: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:47:05.749: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:47:05.749: INFO: kube-apiserver-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:05.749: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:47:05.749: INFO: kube-proxy-vqk4v started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:05.749: INFO: Container kube-proxy ready: true, restart count 1 Aug 18 11:47:05.749: INFO: kube-flannel-q64cq started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:47:05.749: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:47:05.749: INFO: Container kube-flannel ready: true, restart count 3 Aug 18 11:47:05.749: INFO: coredns-7677f9bb54-kn2qg started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:05.749: INFO: Container coredns ready: true, restart count 2 Aug 18 11:47:05.749: INFO: kube-scheduler-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:05.749: INFO: Container kube-scheduler ready: true, restart count 0 W0818 11:47:05.762343 23 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:47:05.786: INFO: Latency metrics for node master1 Aug 18 11:47:05.786: INFO: Logging node info for node master2 Aug 18 11:47:05.788: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 78946293-3abe-4442-84d4-8ed6b1d15ce0 69873 0 2021-08-18 08:21:31 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"7e:f5:c2:cc:3a:b4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:21:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:21:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-08-18 08:29:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:47:05 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:47:05 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:47:05 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:47:05 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0c44122c7a7248c18d8571e1cc667258,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:0cd329f2-48e0-4c8f-b8b9-fa3ae0ed8406,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:47:05.788: INFO: Logging kubelet events for node master2 Aug 18 11:47:05.790: INFO: Logging pods the kubelet thinks is on node master2 Aug 18 11:47:05.798: INFO: kube-controller-manager-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:05.798: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:47:05.798: INFO: kube-proxy-kh2l9 started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:05.798: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:47:05.798: INFO: kube-flannel-pp56h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:47:05.798: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:47:05.798: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:47:05.798: INFO: node-feature-discovery-controller-5bf5c49849-mq57c started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:05.798: INFO: Container nfd-controller ready: true, restart count 0 Aug 18 11:47:05.798: INFO: node-exporter-48nfx started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:47:05.798: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:47:05.798: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:47:05.798: INFO: kube-apiserver-master2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:05.798: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:47:05.798: INFO: kube-scheduler-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:05.798: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:47:05.798: INFO: kube-multus-ds-amd64-mld8g started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:05.798: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:47:05.798: INFO: dns-autoscaler-5b7b5c9b6f-hh47r started at 2021-08-18 08:23:57 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:05.798: INFO: Container autoscaler ready: true, restart count 2 W0818 11:47:05.811575 23 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:47:05.840: INFO: Latency metrics for node master2 Aug 18 11:47:05.840: INFO: Logging node info for node master3 Aug 18 11:47:05.842: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 44feac2b-9447-4be2-9fcd-62f836d67c72 69810 0 2021-08-18 08:21:41 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"86:e4:31:99:58:40"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {kubelet Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:47:00 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:47:00 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:47:00 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:47:00 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1fae19ae59884c44899bcd08aa243244,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:5db926c5-6530-4635-a0d5-806974a3b732,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:47:05.843: INFO: Logging kubelet events for node master3 Aug 18 11:47:05.845: INFO: Logging pods the kubelet thinks is on node master3 Aug 18 11:47:05.852: INFO: kube-controller-manager-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:05.852: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:47:05.852: INFO: kube-scheduler-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:05.852: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:47:05.852: INFO: kube-apiserver-master3 started at 2021-08-18 08:29:12 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:05.852: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:47:05.852: INFO: kube-proxy-sd5lc started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:05.852: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:47:05.852: INFO: kube-flannel-x6tlr started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:47:05.852: INFO: Init container install-cni ready: true, restart count 1 Aug 18 11:47:05.852: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:47:05.852: INFO: kube-multus-ds-amd64-bkw6c started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:05.852: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:47:05.852: INFO: coredns-7677f9bb54-5hxfh started at 2021-08-18 08:23:54 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:05.852: INFO: Container coredns ready: true, restart count 1 Aug 18 11:47:05.852: INFO: node-exporter-vq7d8 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:47:05.852: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:47:05.852: INFO: Container node-exporter ready: true, restart count 0 W0818 11:47:05.863404 23 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:47:05.889: INFO: Latency metrics for node master3 Aug 18 11:47:05.889: INFO: Logging node info for node node1 Aug 18 11:47:05.892: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 84defabd-6ebf-43ec-a629-44c6713da9c9 69805 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"9a:87:55:36:7b:df"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:13 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:35 +0000 UTC,LastTransitionTime:2021-08-18 08:26:35 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:47:00 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:47:00 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:47:00 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:47:00 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:69946ff2b7bc462fa25eb7adb4703c23,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:736dc52f-f5e3-494e-86ca-01eedbea015c,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:a7cea43d9d2f67c38fbf0407786edbe660ee9072945f7bb272b55fd255e8eaca opnfv/barometer-collectd:stable],SizeBytes:1075746799,},ContainerImage{Names:[@ :],SizeBytes:1003788820,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[aquasec/kube-hunter@sha256:2be6820bc1d7e0f57193a9a27d5a3e16b2fd93c53747b03ce8ca48c6fc323781 aquasec/kube-hunter:0.3.1],SizeBytes:347611549,},ContainerImage{Names:[golang@sha256:db2475a1dbb2149508e5db31d7d77a75e6600d54be645f37681f03f2762169ba golang:alpine3.12],SizeBytes:301186719,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:de25c7fc6c4f3a27c7f0c2dff454e4671823a34d88abd533f210848d527e0fbb alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:47:05.893: INFO: Logging kubelet events for node node1 Aug 18 11:47:05.895: INFO: Logging pods the kubelet thinks is on node node1 Aug 18 11:47:05.909: INFO: kube-flannel-q78nd started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:47:05.909: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:47:05.909: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:47:05.909: INFO: prometheus-k8s-0 started at 2021-08-18 08:34:03 +0000 UTC (0+5 container statuses recorded) Aug 18 11:47:05.909: INFO: Container custom-metrics-apiserver ready: true, restart count 0 Aug 18 11:47:05.909: INFO: Container grafana ready: true, restart count 0 Aug 18 11:47:05.909: INFO: Container prometheus ready: true, restart count 1 Aug 18 11:47:05.909: INFO: Container prometheus-config-reloader ready: true, restart count 0 Aug 18 11:47:05.909: INFO: Container rules-configmap-reloader ready: true, restart count 0 Aug 18 11:47:05.909: INFO: kube-multus-ds-amd64-rrvmb started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:05.909: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:47:05.909: INFO: node-feature-discovery-worker-pflgw started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:05.909: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:47:05.909: INFO: node-exporter-kcwvn started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:47:05.909: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:47:05.909: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:47:05.909: INFO: pod-exec-websocket-bcecdfc1-0c3c-45a9-8652-d4ffebd4fba3 started at 2021-08-18 11:45:21 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:05.909: INFO: Container main ready: false, restart count 0 Aug 18 11:47:05.909: INFO: pod-init-0e12df14-5438-414c-9e57-016966ff75cd started at 2021-08-18 11:47:00 +0000 UTC (2+1 container statuses recorded) Aug 18 11:47:05.909: INFO: Init container init1 ready: false, restart count 0 Aug 18 11:47:05.909: INFO: Init container init2 ready: false, restart count 0 Aug 18 11:47:05.909: INFO: Container run1 ready: false, restart count 0 Aug 18 11:47:05.909: INFO: kube-proxy-p6jvp started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:05.909: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:47:05.909: INFO: kubernetes-metrics-scraper-678c97765c-9nsv5 started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:05.909: INFO: Container kubernetes-metrics-scraper ready: true, restart count 2 Aug 18 11:47:05.909: INFO: cmk-init-discover-node1-bxznx started at 2021-08-18 08:32:10 +0000 UTC (0+3 container statuses recorded) Aug 18 11:47:05.909: INFO: Container discover ready: false, restart count 0 Aug 18 11:47:05.909: INFO: Container init ready: false, restart count 0 Aug 18 11:47:05.909: INFO: Container install ready: false, restart count 0 Aug 18 11:47:05.909: INFO: cmk-d8r27 started at 2021-08-18 08:32:52 +0000 UTC (0+2 container statuses recorded) Aug 18 11:47:05.909: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:47:05.909: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:47:05.909: INFO: collectd-xdprr started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:47:05.909: INFO: Container collectd ready: true, restart count 0 Aug 18 11:47:05.909: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:47:05.909: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:47:05.909: INFO: nginx-proxy-node1 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:05.909: INFO: Container nginx-proxy ready: true, restart count 2 Aug 18 11:47:05.909: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-vsxvg started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:05.909: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:47:05.909: INFO: fail-once-local-8rxnh started at 2021-08-18 11:34:14 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:05.909: INFO: Container c ready: false, restart count 0 Aug 18 11:47:05.909: INFO: termination-message-container0695240e-6103-4528-845b-e45cb7a8bd7f started at 2021-08-18 11:43:31 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:05.909: INFO: Container termination-message-container ready: false, restart count 0 W0818 11:47:05.921661 23 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:47:06.089: INFO: Latency metrics for node node1 Aug 18 11:47:06.089: INFO: Logging node info for node node2 Aug 18 11:47:06.092: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 1d01177e-3dbb-48a1-a0bc-d18af27ab7f8 69770 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:d1:47:f8:1d:22"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:36 +0000 UTC,LastTransitionTime:2021-08-18 08:26:36 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:46:58 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:46:58 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:46:58 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:46:58 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:dc1f286135c145349b8a016880b65a2f,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:037e7e2d-94e9-42f4-a719-896e5005ac70,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:47:06.092: INFO: Logging kubelet events for node node2 Aug 18 11:47:06.094: INFO: Logging pods the kubelet thinks is on node node2 Aug 18 11:47:06.109: INFO: kubernetes-dashboard-86c6f9df5b-qrtdk started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:06.109: INFO: Container kubernetes-dashboard ready: true, restart count 2 Aug 18 11:47:06.109: INFO: cmk-748rz started at 2021-08-18 08:32:53 +0000 UTC (0+2 container statuses recorded) Aug 18 11:47:06.109: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:47:06.109: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:47:06.109: INFO: kube-proxy-qkj9c started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:06.109: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:47:06.109: INFO: node-feature-discovery-worker-hzpf5 started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:06.109: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:47:06.109: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-c82pt started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:06.109: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:47:06.109: INFO: prometheus-operator-5bb8cb9d8f-k97ws started at 2021-08-18 08:33:38 +0000 UTC (0+2 container statuses recorded) Aug 18 11:47:06.109: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:47:06.109: INFO: Container prometheus-operator ready: true, restart count 0 Aug 18 11:47:06.109: INFO: kube-multus-ds-amd64-rvzsg started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:06.109: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:47:06.109: INFO: collectd-67ntq started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:47:06.109: INFO: Container collectd ready: true, restart count 0 Aug 18 11:47:06.109: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:47:06.109: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:47:06.109: INFO: ss-0 started at 2021-08-18 11:46:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:06.109: INFO: Container webserver ready: false, restart count 0 Aug 18 11:47:06.109: INFO: server started at 2021-08-18 11:44:57 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:06.109: INFO: Container agnhost-container ready: true, restart count 0 Aug 18 11:47:06.109: INFO: cmk-webhook-6c9d5f8578-7cxjr started at 2021-08-18 08:32:53 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:06.109: INFO: Container cmk-webhook ready: true, restart count 0 Aug 18 11:47:06.109: INFO: termination-message-containerd34235c0-885f-4596-b8e2-47db8d79aee8 started at 2021-08-18 11:42:58 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:06.109: INFO: Container termination-message-container ready: false, restart count 0 Aug 18 11:47:06.109: INFO: tester started at 2021-08-18 11:45:01 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:06.109: INFO: Container tester ready: false, restart count 0 Aug 18 11:47:06.109: INFO: downwardapi-volume-ba4d3623-1253-4fe0-be87-9a63c98b90e8 started at 2021-08-18 11:47:03 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:06.109: INFO: Container client-container ready: false, restart count 0 Aug 18 11:47:06.109: INFO: kube-flannel-h7t5h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:47:06.109: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:47:06.109: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:47:06.109: INFO: node-exporter-lrrf2 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:47:06.109: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:47:06.109: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:47:06.109: INFO: pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70 started at 2021-08-18 11:46:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:06.109: INFO: Container env-test ready: false, restart count 0 Aug 18 11:47:06.109: INFO: pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5 started at 2021-08-18 11:42:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:06.109: INFO: Container env-test ready: false, restart count 0 Aug 18 11:47:06.109: INFO: fail-once-local-pk5cs started at 2021-08-18 11:34:14 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:06.109: INFO: Container c ready: false, restart count 0 Aug 18 11:47:06.109: INFO: nginx-proxy-node2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:06.109: INFO: Container nginx-proxy ready: true, restart count 1 Aug 18 11:47:06.109: INFO: cmk-init-discover-node2-6b2kz started at 2021-08-18 08:32:30 +0000 UTC (0+3 container statuses recorded) Aug 18 11:47:06.109: INFO: Container discover ready: false, restart count 0 Aug 18 11:47:06.109: INFO: Container init ready: false, restart count 0 Aug 18 11:47:06.109: INFO: Container install ready: false, restart count 0 Aug 18 11:47:06.109: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-7rn45 started at 2021-08-18 08:36:42 +0000 UTC (0+2 container statuses recorded) Aug 18 11:47:06.109: INFO: Container tas-controller ready: true, restart count 0 Aug 18 11:47:06.109: INFO: Container tas-extender ready: true, restart count 0 W0818 11:47:06.130890 23 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:47:06.173: INFO: Latency metrics for node node2 Aug 18 11:47:06.173: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "init-container-4314" for this suite. • Failure [5.966 seconds] [k8s.io] InitContainer [NodeConformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 should not start app containers and fail the pod if init containers fail on a RestartNever pod [Conformance] [It] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:47:05.725: Expected <*errors.errorString | 0xc0021cd630>: { s: "second init container should have reason PodInitializing: v1.ContainerStatus{Name:\"init1\", State:v1.ContainerState{Waiting:(*v1.ContainerStateWaiting)(0xc004df1640), Running:(*v1.ContainerStateRunning)(nil), Terminated:(*v1.ContainerStateTerminated)(nil)}, LastTerminationState:v1.ContainerState{Waiting:(*v1.ContainerStateWaiting)(nil), Running:(*v1.ContainerStateRunning)(nil), Terminated:(*v1.ContainerStateTerminated)(nil)}, Ready:false, RestartCount:0, Image:\"docker.io/library/busybox:1.29\", ImageID:\"\", ContainerID:\"\", Started:(*bool)(nil)}", } to be nil /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/init_container.go:547 ------------------------------ {"msg":"FAILED [k8s.io] InitContainer [NodeConformance] should not start app containers and fail the pod if init containers fail on a RestartNever pod [Conformance]","total":-1,"completed":10,"skipped":277,"failed":5,"failures":["[sig-apps] StatefulSet [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] Should recreate evicted statefulset [Conformance]","[sig-node] Downward API should provide pod UID as env vars [NodeConformance] [Conformance]","[sig-apps] ReplicationController should adopt matching pods on creation [Conformance]","[sig-apps] ReplicaSet should adopt matching pods on creation and release no longer matching pods [Conformance]","[k8s.io] InitContainer [NodeConformance] should not start app containers and fail the pod if init containers fail on a RestartNever pod [Conformance]"]} SSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-storage] Projected downwardAPI /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:47:02.981: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename projected STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-storage] Projected downwardAPI /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/projected_downwardapi.go:42 [It] should provide podname only [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating a pod to test downward API volume plugin Aug 18 11:47:03.013: INFO: Waiting up to 5m0s for pod "downwardapi-volume-ba4d3623-1253-4fe0-be87-9a63c98b90e8" in namespace "projected-1360" to be "Succeeded or Failed" Aug 18 11:47:03.015: INFO: Pod "downwardapi-volume-ba4d3623-1253-4fe0-be87-9a63c98b90e8": Phase="Pending", Reason="", readiness=false. Elapsed: 1.969422ms Aug 18 11:47:05.020: INFO: Pod "downwardapi-volume-ba4d3623-1253-4fe0-be87-9a63c98b90e8": Phase="Pending", Reason="", readiness=false. Elapsed: 2.006612479s Aug 18 11:47:07.023: INFO: Pod "downwardapi-volume-ba4d3623-1253-4fe0-be87-9a63c98b90e8": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.009571751s STEP: Saw pod success Aug 18 11:47:07.023: INFO: Pod "downwardapi-volume-ba4d3623-1253-4fe0-be87-9a63c98b90e8" satisfied condition "Succeeded or Failed" Aug 18 11:47:07.025: INFO: Trying to get logs from node node2 pod downwardapi-volume-ba4d3623-1253-4fe0-be87-9a63c98b90e8 container client-container: STEP: delete the pod Aug 18 11:47:07.037: INFO: Waiting for pod downwardapi-volume-ba4d3623-1253-4fe0-be87-9a63c98b90e8 to disappear Aug 18 11:47:07.039: INFO: Pod downwardapi-volume-ba4d3623-1253-4fe0-be87-9a63c98b90e8 no longer exists [AfterEach] [sig-storage] Projected downwardAPI /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:47:07.039: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "projected-1360" for this suite. • ------------------------------ {"msg":"PASSED [sig-storage] Projected downwardAPI should provide podname only [NodeConformance] [Conformance]","total":-1,"completed":7,"skipped":161,"failed":2,"failures":["[k8s.io] Variable Expansion should allow substituting values in a volume subpath [sig-storage] [Conformance]","[sig-apps] StatefulSet [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] should perform canary updates and phased rolling updates of template modifications [Conformance]"]} SSSSSSSS ------------------------------ [BeforeEach] [sig-storage] ConfigMap /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:47:06.238: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename configmap STEP: Waiting for a default service account to be provisioned in namespace [It] should be consumable from pods in volume with mappings as non-root [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating configMap with name configmap-test-volume-map-6f900e80-41c5-404b-9e48-0b4c50e98db5 STEP: Creating a pod to test consume configMaps Aug 18 11:47:06.276: INFO: Waiting up to 5m0s for pod "pod-configmaps-6af0ea4e-81eb-4e1f-b860-232821c8d29d" in namespace "configmap-9970" to be "Succeeded or Failed" Aug 18 11:47:06.278: INFO: Pod "pod-configmaps-6af0ea4e-81eb-4e1f-b860-232821c8d29d": Phase="Pending", Reason="", readiness=false. Elapsed: 2.617102ms Aug 18 11:47:08.284: INFO: Pod "pod-configmaps-6af0ea4e-81eb-4e1f-b860-232821c8d29d": Phase="Pending", Reason="", readiness=false. Elapsed: 2.008095251s Aug 18 11:47:10.290: INFO: Pod "pod-configmaps-6af0ea4e-81eb-4e1f-b860-232821c8d29d": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.014237541s STEP: Saw pod success Aug 18 11:47:10.290: INFO: Pod "pod-configmaps-6af0ea4e-81eb-4e1f-b860-232821c8d29d" satisfied condition "Succeeded or Failed" Aug 18 11:47:10.292: INFO: Trying to get logs from node node1 pod pod-configmaps-6af0ea4e-81eb-4e1f-b860-232821c8d29d container configmap-volume-test: STEP: delete the pod Aug 18 11:47:10.307: INFO: Waiting for pod pod-configmaps-6af0ea4e-81eb-4e1f-b860-232821c8d29d to disappear Aug 18 11:47:10.309: INFO: Pod pod-configmaps-6af0ea4e-81eb-4e1f-b860-232821c8d29d no longer exists [AfterEach] [sig-storage] ConfigMap /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:47:10.309: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "configmap-9970" for this suite. • ------------------------------ {"msg":"PASSED [sig-storage] ConfigMap should be consumable from pods in volume with mappings as non-root [NodeConformance] [Conformance]","total":-1,"completed":11,"skipped":300,"failed":5,"failures":["[sig-apps] StatefulSet [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] Should recreate evicted statefulset [Conformance]","[sig-node] Downward API should provide pod UID as env vars [NodeConformance] [Conformance]","[sig-apps] ReplicationController should adopt matching pods on creation [Conformance]","[sig-apps] ReplicaSet should adopt matching pods on creation and release no longer matching pods [Conformance]","[k8s.io] InitContainer [NodeConformance] should not start app containers and fail the pod if init containers fail on a RestartNever pod [Conformance]"]} SSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-storage] Secrets /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:47:07.067: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename secrets STEP: Waiting for a default service account to be provisioned in namespace [It] should be consumable from pods in volume with mappings [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating secret with name secret-test-map-c0c976de-c40f-4344-9dd5-06c2021b50f3 STEP: Creating a pod to test consume secrets Aug 18 11:47:07.105: INFO: Waiting up to 5m0s for pod "pod-secrets-110d41ee-ebf0-42f4-ada4-95beb1139513" in namespace "secrets-5655" to be "Succeeded or Failed" Aug 18 11:47:07.109: INFO: Pod "pod-secrets-110d41ee-ebf0-42f4-ada4-95beb1139513": Phase="Pending", Reason="", readiness=false. Elapsed: 4.318142ms Aug 18 11:47:09.112: INFO: Pod "pod-secrets-110d41ee-ebf0-42f4-ada4-95beb1139513": Phase="Pending", Reason="", readiness=false. Elapsed: 2.007137552s Aug 18 11:47:11.115: INFO: Pod "pod-secrets-110d41ee-ebf0-42f4-ada4-95beb1139513": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.010204651s STEP: Saw pod success Aug 18 11:47:11.115: INFO: Pod "pod-secrets-110d41ee-ebf0-42f4-ada4-95beb1139513" satisfied condition "Succeeded or Failed" Aug 18 11:47:11.118: INFO: Trying to get logs from node node1 pod pod-secrets-110d41ee-ebf0-42f4-ada4-95beb1139513 container secret-volume-test: STEP: delete the pod Aug 18 11:47:11.144: INFO: Waiting for pod pod-secrets-110d41ee-ebf0-42f4-ada4-95beb1139513 to disappear Aug 18 11:47:11.146: INFO: Pod pod-secrets-110d41ee-ebf0-42f4-ada4-95beb1139513 no longer exists [AfterEach] [sig-storage] Secrets /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:47:11.146: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "secrets-5655" for this suite. • ------------------------------ {"msg":"PASSED [sig-storage] Secrets should be consumable from pods in volume with mappings [NodeConformance] [Conformance]","total":-1,"completed":8,"skipped":169,"failed":2,"failures":["[k8s.io] Variable Expansion should allow substituting values in a volume subpath [sig-storage] [Conformance]","[sig-apps] StatefulSet [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] should perform canary updates and phased rolling updates of template modifications [Conformance]"]} SSSSS ------------------------------ [BeforeEach] [sig-storage] EmptyDir volumes /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:47:11.165: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename emptydir STEP: Waiting for a default service account to be provisioned in namespace [It] should support (root,0666,tmpfs) [LinuxOnly] [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating a pod to test emptydir 0666 on tmpfs Aug 18 11:47:11.199: INFO: Waiting up to 5m0s for pod "pod-5049711c-0558-4435-a570-0214e2726621" in namespace "emptydir-4323" to be "Succeeded or Failed" Aug 18 11:47:11.203: INFO: Pod "pod-5049711c-0558-4435-a570-0214e2726621": Phase="Pending", Reason="", readiness=false. Elapsed: 4.404377ms Aug 18 11:47:13.207: INFO: Pod "pod-5049711c-0558-4435-a570-0214e2726621": Phase="Pending", Reason="", readiness=false. Elapsed: 2.008099836s Aug 18 11:47:15.211: INFO: Pod "pod-5049711c-0558-4435-a570-0214e2726621": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.012564328s STEP: Saw pod success Aug 18 11:47:15.211: INFO: Pod "pod-5049711c-0558-4435-a570-0214e2726621" satisfied condition "Succeeded or Failed" Aug 18 11:47:15.214: INFO: Trying to get logs from node node2 pod pod-5049711c-0558-4435-a570-0214e2726621 container test-container: STEP: delete the pod Aug 18 11:47:15.229: INFO: Waiting for pod pod-5049711c-0558-4435-a570-0214e2726621 to disappear Aug 18 11:47:15.231: INFO: Pod pod-5049711c-0558-4435-a570-0214e2726621 no longer exists [AfterEach] [sig-storage] EmptyDir volumes /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:47:15.231: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "emptydir-4323" for this suite. • ------------------------------ [BeforeEach] [sig-storage] Subpath /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:47:10.363: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename subpath STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] Atomic writer volumes /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/subpath.go:38 STEP: Setting up data [It] should support subpaths with configmap pod [LinuxOnly] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating pod pod-subpath-test-configmap-7m49 STEP: Creating a pod to test atomic-volume-subpath Aug 18 11:47:10.406: INFO: Waiting up to 5m0s for pod "pod-subpath-test-configmap-7m49" in namespace "subpath-3039" to be "Succeeded or Failed" Aug 18 11:47:10.410: INFO: Pod "pod-subpath-test-configmap-7m49": Phase="Pending", Reason="", readiness=false. Elapsed: 4.116043ms Aug 18 11:47:12.414: INFO: Pod "pod-subpath-test-configmap-7m49": Phase="Pending", Reason="", readiness=false. Elapsed: 2.008609948s Aug 18 11:47:14.419: INFO: Pod "pod-subpath-test-configmap-7m49": Phase="Running", Reason="", readiness=true. Elapsed: 4.012771513s Aug 18 11:47:16.423: INFO: Pod "pod-subpath-test-configmap-7m49": Phase="Running", Reason="", readiness=true. Elapsed: 6.016839338s Aug 18 11:47:18.428: INFO: Pod "pod-subpath-test-configmap-7m49": Phase="Running", Reason="", readiness=true. Elapsed: 8.021756752s Aug 18 11:47:20.431: INFO: Pod "pod-subpath-test-configmap-7m49": Phase="Running", Reason="", readiness=true. Elapsed: 10.025616986s Aug 18 11:47:22.435: INFO: Pod "pod-subpath-test-configmap-7m49": Phase="Running", Reason="", readiness=true. Elapsed: 12.028832856s Aug 18 11:47:24.438: INFO: Pod "pod-subpath-test-configmap-7m49": Phase="Running", Reason="", readiness=true. Elapsed: 14.032360305s Aug 18 11:47:26.442: INFO: Pod "pod-subpath-test-configmap-7m49": Phase="Running", Reason="", readiness=true. Elapsed: 16.036114513s Aug 18 11:47:28.446: INFO: Pod "pod-subpath-test-configmap-7m49": Phase="Running", Reason="", readiness=true. Elapsed: 18.040455812s Aug 18 11:47:30.450: INFO: Pod "pod-subpath-test-configmap-7m49": Phase="Running", Reason="", readiness=true. Elapsed: 20.043985066s Aug 18 11:47:32.453: INFO: Pod "pod-subpath-test-configmap-7m49": Phase="Running", Reason="", readiness=true. Elapsed: 22.047002394s Aug 18 11:47:34.456: INFO: Pod "pod-subpath-test-configmap-7m49": Phase="Succeeded", Reason="", readiness=false. Elapsed: 24.050466869s STEP: Saw pod success Aug 18 11:47:34.456: INFO: Pod "pod-subpath-test-configmap-7m49" satisfied condition "Succeeded or Failed" Aug 18 11:47:34.458: INFO: Trying to get logs from node node1 pod pod-subpath-test-configmap-7m49 container test-container-subpath-configmap-7m49: STEP: delete the pod Aug 18 11:47:34.472: INFO: Waiting for pod pod-subpath-test-configmap-7m49 to disappear Aug 18 11:47:34.474: INFO: Pod pod-subpath-test-configmap-7m49 no longer exists STEP: Deleting pod pod-subpath-test-configmap-7m49 Aug 18 11:47:34.474: INFO: Deleting pod "pod-subpath-test-configmap-7m49" in namespace "subpath-3039" [AfterEach] [sig-storage] Subpath /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:47:34.476: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "subpath-3039" for this suite. • [SLOW TEST:24.120 seconds] [sig-storage] Subpath /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/framework.go:23 Atomic writer volumes /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/subpath.go:34 should support subpaths with configmap pod [LinuxOnly] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-storage] Subpath Atomic writer volumes should support subpaths with configmap pod [LinuxOnly] [Conformance]","total":-1,"completed":12,"skipped":323,"failed":5,"failures":["[sig-apps] StatefulSet [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] Should recreate evicted statefulset [Conformance]","[sig-node] Downward API should provide pod UID as env vars [NodeConformance] [Conformance]","[sig-apps] ReplicationController should adopt matching pods on creation [Conformance]","[sig-apps] ReplicaSet should adopt matching pods on creation and release no longer matching pods [Conformance]","[k8s.io] InitContainer [NodeConformance] should not start app containers and fail the pod if init containers fail on a RestartNever pod [Conformance]"]} SSSSSS ------------------------------ [BeforeEach] [sig-api-machinery] Secrets /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:42:51.521: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename secrets STEP: Waiting for a default service account to be provisioned in namespace [It] should be consumable via the environment [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: creating secret secrets-5315/secret-test-7bdf107b-70fe-4858-878f-f0ce1855ef06 STEP: Creating a pod to test consume secrets Aug 18 11:42:51.556: INFO: Waiting up to 5m0s for pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5" in namespace "secrets-5315" to be "Succeeded or Failed" Aug 18 11:42:51.559: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 2.432995ms Aug 18 11:42:53.562: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 2.005883967s Aug 18 11:42:55.566: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 4.009123896s Aug 18 11:42:57.569: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 6.012030686s Aug 18 11:42:59.573: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 8.016020311s Aug 18 11:43:01.575: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 10.018475924s Aug 18 11:43:03.580: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 12.023192076s Aug 18 11:43:05.584: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 14.027289731s Aug 18 11:43:07.587: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 16.030385462s Aug 18 11:43:09.592: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 18.035161685s Aug 18 11:43:11.595: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 20.038230152s Aug 18 11:43:13.598: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 22.041980051s Aug 18 11:43:15.602: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 24.045419277s Aug 18 11:43:17.605: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 26.048025852s Aug 18 11:43:19.608: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 28.051594276s Aug 18 11:43:21.612: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 30.055149653s Aug 18 11:43:23.616: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 32.059339708s Aug 18 11:43:25.620: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 34.063444979s Aug 18 11:43:27.623: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 36.066901017s Aug 18 11:43:29.630: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 38.073961045s Aug 18 11:43:31.634: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 40.077692821s Aug 18 11:43:33.638: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 42.081864393s Aug 18 11:43:35.643: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 44.086533007s Aug 18 11:43:37.648: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 46.091332044s Aug 18 11:43:39.652: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 48.095900583s Aug 18 11:43:41.657: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 50.100133938s Aug 18 11:43:43.660: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 52.10400472s Aug 18 11:43:45.666: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 54.109216928s Aug 18 11:43:47.669: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 56.112682213s Aug 18 11:43:49.674: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 58.117110613s Aug 18 11:43:51.677: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.120490666s Aug 18 11:43:53.681: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.124206447s Aug 18 11:43:55.685: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.128335268s Aug 18 11:43:57.687: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.130984082s Aug 18 11:43:59.691: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.134885822s Aug 18 11:44:01.696: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.139171309s Aug 18 11:44:03.698: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.141922071s Aug 18 11:44:05.701: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.144479241s Aug 18 11:44:07.706: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.149148522s Aug 18 11:44:09.709: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.152880782s Aug 18 11:44:11.715: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.158257692s Aug 18 11:44:13.719: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.162171363s Aug 18 11:44:15.722: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.165588558s Aug 18 11:44:17.725: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.168347151s Aug 18 11:44:19.729: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.172892373s Aug 18 11:44:21.733: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.176234901s Aug 18 11:44:23.736: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.179617028s Aug 18 11:44:25.739: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.182392686s Aug 18 11:44:27.742: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.185494399s Aug 18 11:44:29.745: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.18895933s Aug 18 11:44:31.750: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.193162813s Aug 18 11:44:33.753: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.196663892s Aug 18 11:44:35.757: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.200101908s Aug 18 11:44:37.760: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.203303787s Aug 18 11:44:39.763: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.206355944s Aug 18 11:44:41.766: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.209321028s Aug 18 11:44:43.769: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.212802016s Aug 18 11:44:45.773: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.216481775s Aug 18 11:44:47.778: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.221474767s Aug 18 11:44:49.781: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.22433352s Aug 18 11:44:51.783: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.226843902s Aug 18 11:44:53.786: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.229685648s Aug 18 11:44:55.790: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.233728683s Aug 18 11:44:57.794: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.237576545s Aug 18 11:44:59.798: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.241012801s Aug 18 11:45:01.801: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.244813888s Aug 18 11:45:03.804: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.24768776s Aug 18 11:45:05.807: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.250520757s Aug 18 11:45:07.811: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.254947741s Aug 18 11:45:09.815: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.258107826s Aug 18 11:45:11.818: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.26139596s Aug 18 11:45:13.820: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.263933951s Aug 18 11:45:15.823: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.266894048s Aug 18 11:45:17.827: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.270275782s Aug 18 11:45:19.830: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.273308702s Aug 18 11:45:21.833: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.27685917s Aug 18 11:45:23.839: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.2828765s Aug 18 11:45:25.843: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.286366164s Aug 18 11:45:27.846: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.289882349s Aug 18 11:45:29.850: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.293071176s Aug 18 11:45:31.853: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.296272819s Aug 18 11:45:33.856: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.299698513s Aug 18 11:45:35.859: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.302916586s Aug 18 11:45:37.863: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.306099664s Aug 18 11:45:39.866: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.309298724s Aug 18 11:45:41.869: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.312843685s Aug 18 11:45:43.872: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.315795801s Aug 18 11:45:45.876: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.319282033s Aug 18 11:45:47.879: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.322246184s Aug 18 11:45:49.882: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.325077039s Aug 18 11:45:51.885: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.328166871s Aug 18 11:45:53.889: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.332828291s Aug 18 11:45:55.893: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.336391614s Aug 18 11:45:57.896: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.339377219s Aug 18 11:45:59.899: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.342091977s Aug 18 11:46:01.902: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.345043009s Aug 18 11:46:03.905: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.348819182s Aug 18 11:46:05.909: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.352126214s Aug 18 11:46:07.911: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.354852239s Aug 18 11:46:09.915: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.358693827s Aug 18 11:46:11.919: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.362030551s Aug 18 11:46:13.924: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.367175546s Aug 18 11:46:15.927: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.370674207s Aug 18 11:46:17.930: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.373453756s Aug 18 11:46:19.934: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.377527919s Aug 18 11:46:21.936: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.379991297s Aug 18 11:46:23.939: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.382252031s Aug 18 11:46:25.941: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.384701669s Aug 18 11:46:27.944: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.38789241s Aug 18 11:46:29.947: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.390209024s Aug 18 11:46:31.951: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.394024186s Aug 18 11:46:33.955: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.398084019s Aug 18 11:46:35.958: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.401149858s Aug 18 11:46:37.960: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.403700309s Aug 18 11:46:39.965: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.408824409s Aug 18 11:46:41.969: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.412132936s Aug 18 11:46:43.972: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.415283559s Aug 18 11:46:45.976: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.419630482s Aug 18 11:46:47.979: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.422717032s Aug 18 11:46:49.983: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.426171179s Aug 18 11:46:51.985: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.428937723s Aug 18 11:46:53.989: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.432122861s Aug 18 11:46:55.992: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.435384882s Aug 18 11:46:57.995: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.438696878s Aug 18 11:47:00.000: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.443101409s Aug 18 11:47:02.003: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.44656956s Aug 18 11:47:04.006: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.449247416s Aug 18 11:47:06.009: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.453010004s Aug 18 11:47:08.012: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.455655011s Aug 18 11:47:10.015: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.458239806s Aug 18 11:47:12.017: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.460860537s Aug 18 11:47:14.021: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.464675192s Aug 18 11:47:16.026: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.469202996s Aug 18 11:47:18.029: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.472656768s Aug 18 11:47:20.032: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.475924134s Aug 18 11:47:22.035: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.478874903s Aug 18 11:47:24.038: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.481912693s Aug 18 11:47:26.044: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.487390363s Aug 18 11:47:28.048: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.491346969s Aug 18 11:47:30.053: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.496031317s Aug 18 11:47:32.057: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.500107205s Aug 18 11:47:34.060: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.50309245s Aug 18 11:47:36.065: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.508295578s Aug 18 11:47:38.069: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.512935881s Aug 18 11:47:40.072: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.515705352s Aug 18 11:47:42.076: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.519667572s Aug 18 11:47:44.080: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.52322159s Aug 18 11:47:46.083: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.526791452s Aug 18 11:47:48.087: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.530945206s Aug 18 11:47:50.092: INFO: Pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.535934817s Aug 18 11:47:52.104: INFO: Failed to get logs from node "node2" pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5" container "env-test": the server rejected our request for an unknown reason (get pods pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5) STEP: delete the pod Aug 18 11:47:52.108: INFO: Waiting for pod pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5 to disappear Aug 18 11:47:52.111: INFO: Pod pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5 still exists Aug 18 11:47:54.112: INFO: Waiting for pod pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5 to disappear Aug 18 11:47:54.114: INFO: Pod pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5 no longer exists Aug 18 11:47:54.115: FAIL: Unexpected error: <*errors.errorString | 0xc004edf280>: { s: "expected pod \"pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5\" success: Gave up after waiting 5m0s for pod \"pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5\" to be \"Succeeded or Failed\"", } expected pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5" success: Gave up after waiting 5m0s for pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5" to be "Succeeded or Failed" occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).testContainerOutputMatcher(0xc0003762c0, 0x4c10f08, 0xf, 0xc0021bfc00, 0x0, 0xc0029bf178, 0x6, 0x6, 0x4deefa8) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 +0x1ee k8s.io/kubernetes/test/e2e/framework.(*Framework).TestContainerOutput(...) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:525 k8s.io/kubernetes/test/e2e/common.glob..func27.2() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/secrets.go:127 +0xa14 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc001283680) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc001283680) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc001283680, 0x4deb2c0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [sig-api-machinery] Secrets /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "secrets-5315". STEP: Found 7 events. Aug 18 11:47:54.119: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5: { } Scheduled: Successfully assigned secrets-5315/pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5 to node2 Aug 18 11:47:54.119: INFO: At 2021-08-18 11:42:52 +0000 UTC - event for pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5: {multus } AddedInterface: Add eth0 [10.244.3.50/24] Aug 18 11:47:54.119: INFO: At 2021-08-18 11:42:52 +0000 UTC - event for pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5: {kubelet node2} Pulling: Pulling image "docker.io/library/busybox:1.29" Aug 18 11:47:54.119: INFO: At 2021-08-18 11:42:53 +0000 UTC - event for pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5: {kubelet node2} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit Aug 18 11:47:54.119: INFO: At 2021-08-18 11:42:53 +0000 UTC - event for pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5: {kubelet node2} Failed: Error: ErrImagePull Aug 18 11:47:54.119: INFO: At 2021-08-18 11:42:54 +0000 UTC - event for pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5: {kubelet node2} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" Aug 18 11:47:54.119: INFO: At 2021-08-18 11:42:54 +0000 UTC - event for pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5: {kubelet node2} Failed: Error: ImagePullBackOff Aug 18 11:47:54.122: INFO: POD NODE PHASE GRACE CONDITIONS Aug 18 11:47:54.122: INFO: Aug 18 11:47:54.126: INFO: Logging node info for node master1 Aug 18 11:47:54.128: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 ebb211fa-503f-4cfe-b1ed-c95d27a70e6e 70270 0 2021-08-18 08:20:52 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"3a:82:be:72:b5:15"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:20:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:20:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:25:59 +0000 UTC,LastTransitionTime:2021-08-18 08:25:59 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:47:47 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:47:47 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:47:47 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:47:47 +0000 UTC,LastTransitionTime:2021-08-18 08:25:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:58c3e57359b641ad92fa1959f2fecf5d,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:012cd796-2076-45d6-8b14-d3e0451b1e64,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[@ :],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:47:54.129: INFO: Logging kubelet events for node master1 Aug 18 11:47:54.131: INFO: Logging pods the kubelet thinks is on node master1 Aug 18 11:47:54.139: INFO: kube-apiserver-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:54.139: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:47:54.139: INFO: kube-proxy-vqk4v started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:54.139: INFO: Container kube-proxy ready: true, restart count 1 Aug 18 11:47:54.139: INFO: kube-flannel-q64cq started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:47:54.139: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:47:54.139: INFO: Container kube-flannel ready: true, restart count 3 Aug 18 11:47:54.139: INFO: coredns-7677f9bb54-kn2qg started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:54.139: INFO: Container coredns ready: true, restart count 2 Aug 18 11:47:54.139: INFO: kube-scheduler-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:54.139: INFO: Container kube-scheduler ready: true, restart count 0 Aug 18 11:47:54.139: INFO: kube-controller-manager-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:54.139: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:47:54.139: INFO: kube-multus-ds-amd64-kbcp6 started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:54.139: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:47:54.139: INFO: docker-registry-docker-registry-56cbc7bc58-49kl2 started at 2021-08-18 08:26:23 +0000 UTC (0+2 container statuses recorded) Aug 18 11:47:54.139: INFO: Container docker-registry ready: true, restart count 0 Aug 18 11:47:54.139: INFO: Container nginx ready: true, restart count 0 Aug 18 11:47:54.139: INFO: node-exporter-5hwz9 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:47:54.139: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:47:54.139: INFO: Container node-exporter ready: true, restart count 0 W0818 11:47:54.152133 27 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:47:54.186: INFO: Latency metrics for node master1 Aug 18 11:47:54.186: INFO: Logging node info for node master2 Aug 18 11:47:54.188: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 78946293-3abe-4442-84d4-8ed6b1d15ce0 70267 0 2021-08-18 08:21:31 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"7e:f5:c2:cc:3a:b4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:21:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:21:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-08-18 08:29:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:47:45 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:47:45 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:47:45 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:47:45 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0c44122c7a7248c18d8571e1cc667258,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:0cd329f2-48e0-4c8f-b8b9-fa3ae0ed8406,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:47:54.189: INFO: Logging kubelet events for node master2 Aug 18 11:47:54.191: INFO: Logging pods the kubelet thinks is on node master2 Aug 18 11:47:54.200: INFO: kube-apiserver-master2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:54.200: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:47:54.200: INFO: kube-scheduler-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:54.200: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:47:54.200: INFO: kube-multus-ds-amd64-mld8g started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:54.200: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:47:54.200: INFO: dns-autoscaler-5b7b5c9b6f-hh47r started at 2021-08-18 08:23:57 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:54.200: INFO: Container autoscaler ready: true, restart count 2 Aug 18 11:47:54.200: INFO: node-feature-discovery-controller-5bf5c49849-mq57c started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:54.200: INFO: Container nfd-controller ready: true, restart count 0 Aug 18 11:47:54.200: INFO: node-exporter-48nfx started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:47:54.200: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:47:54.200: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:47:54.200: INFO: kube-controller-manager-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:54.200: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:47:54.200: INFO: kube-proxy-kh2l9 started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:54.200: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:47:54.200: INFO: kube-flannel-pp56h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:47:54.200: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:47:54.200: INFO: Container kube-flannel ready: true, restart count 1 W0818 11:47:54.211819 27 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:47:54.244: INFO: Latency metrics for node master2 Aug 18 11:47:54.244: INFO: Logging node info for node master3 Aug 18 11:47:54.246: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 44feac2b-9447-4be2-9fcd-62f836d67c72 70290 0 2021-08-18 08:21:41 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"86:e4:31:99:58:40"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {kubelet Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:47:51 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:47:51 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:47:51 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:47:51 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1fae19ae59884c44899bcd08aa243244,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:5db926c5-6530-4635-a0d5-806974a3b732,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:47:54.247: INFO: Logging kubelet events for node master3 Aug 18 11:47:54.248: INFO: Logging pods the kubelet thinks is on node master3 Aug 18 11:47:54.256: INFO: kube-apiserver-master3 started at 2021-08-18 08:29:12 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:54.256: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:47:54.256: INFO: kube-proxy-sd5lc started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:54.256: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:47:54.256: INFO: kube-flannel-x6tlr started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:47:54.256: INFO: Init container install-cni ready: true, restart count 1 Aug 18 11:47:54.256: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:47:54.256: INFO: kube-multus-ds-amd64-bkw6c started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:54.256: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:47:54.256: INFO: coredns-7677f9bb54-5hxfh started at 2021-08-18 08:23:54 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:54.256: INFO: Container coredns ready: true, restart count 1 Aug 18 11:47:54.256: INFO: node-exporter-vq7d8 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:47:54.256: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:47:54.256: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:47:54.256: INFO: kube-controller-manager-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:54.256: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:47:54.256: INFO: kube-scheduler-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:54.256: INFO: Container kube-scheduler ready: true, restart count 2 W0818 11:47:54.268879 27 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:47:54.297: INFO: Latency metrics for node master3 Aug 18 11:47:54.297: INFO: Logging node info for node node1 Aug 18 11:47:54.300: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 84defabd-6ebf-43ec-a629-44c6713da9c9 70291 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"9a:87:55:36:7b:df"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:13 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:35 +0000 UTC,LastTransitionTime:2021-08-18 08:26:35 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:47:51 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:47:51 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:47:51 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:47:51 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:69946ff2b7bc462fa25eb7adb4703c23,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:736dc52f-f5e3-494e-86ca-01eedbea015c,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:a7cea43d9d2f67c38fbf0407786edbe660ee9072945f7bb272b55fd255e8eaca opnfv/barometer-collectd:stable],SizeBytes:1075746799,},ContainerImage{Names:[@ :],SizeBytes:1003788820,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[aquasec/kube-hunter@sha256:2be6820bc1d7e0f57193a9a27d5a3e16b2fd93c53747b03ce8ca48c6fc323781 aquasec/kube-hunter:0.3.1],SizeBytes:347611549,},ContainerImage{Names:[golang@sha256:db2475a1dbb2149508e5db31d7d77a75e6600d54be645f37681f03f2762169ba golang:alpine3.12],SizeBytes:301186719,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:de25c7fc6c4f3a27c7f0c2dff454e4671823a34d88abd533f210848d527e0fbb alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:47:54.300: INFO: Logging kubelet events for node node1 Aug 18 11:47:54.302: INFO: Logging pods the kubelet thinks is on node node1 Aug 18 11:47:54.317: INFO: nginx-proxy-node1 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:54.317: INFO: Container nginx-proxy ready: true, restart count 2 Aug 18 11:47:54.317: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-vsxvg started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:54.317: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:47:54.317: INFO: fail-once-local-8rxnh started at 2021-08-18 11:34:14 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:54.317: INFO: Container c ready: false, restart count 0 Aug 18 11:47:54.317: INFO: pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975 started at 2021-08-18 11:47:15 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:54.317: INFO: Container secret-env-test ready: false, restart count 0 Aug 18 11:47:54.317: INFO: termination-message-container0695240e-6103-4528-845b-e45cb7a8bd7f started at 2021-08-18 11:43:31 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:54.317: INFO: Container termination-message-container ready: false, restart count 0 Aug 18 11:47:54.317: INFO: kube-flannel-q78nd started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:47:54.317: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:47:54.317: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:47:54.317: INFO: prometheus-k8s-0 started at 2021-08-18 08:34:03 +0000 UTC (0+5 container statuses recorded) Aug 18 11:47:54.317: INFO: Container custom-metrics-apiserver ready: true, restart count 0 Aug 18 11:47:54.317: INFO: Container grafana ready: true, restart count 0 Aug 18 11:47:54.317: INFO: Container prometheus ready: true, restart count 1 Aug 18 11:47:54.317: INFO: Container prometheus-config-reloader ready: true, restart count 0 Aug 18 11:47:54.317: INFO: Container rules-configmap-reloader ready: true, restart count 0 Aug 18 11:47:54.317: INFO: kube-multus-ds-amd64-rrvmb started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:54.317: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:47:54.317: INFO: node-feature-discovery-worker-pflgw started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:54.317: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:47:54.317: INFO: node-exporter-kcwvn started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:47:54.317: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:47:54.317: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:47:54.317: INFO: pod-exec-websocket-bcecdfc1-0c3c-45a9-8652-d4ffebd4fba3 started at 2021-08-18 11:45:21 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:54.317: INFO: Container main ready: false, restart count 0 Aug 18 11:47:54.317: INFO: ss-0 started at 2021-08-18 11:47:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:54.317: INFO: Container webserver ready: false, restart count 0 Aug 18 11:47:54.317: INFO: kube-proxy-p6jvp started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:54.317: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:47:54.317: INFO: kubernetes-metrics-scraper-678c97765c-9nsv5 started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:54.317: INFO: Container kubernetes-metrics-scraper ready: true, restart count 2 Aug 18 11:47:54.317: INFO: cmk-init-discover-node1-bxznx started at 2021-08-18 08:32:10 +0000 UTC (0+3 container statuses recorded) Aug 18 11:47:54.317: INFO: Container discover ready: false, restart count 0 Aug 18 11:47:54.317: INFO: Container init ready: false, restart count 0 Aug 18 11:47:54.317: INFO: Container install ready: false, restart count 0 Aug 18 11:47:54.317: INFO: cmk-d8r27 started at 2021-08-18 08:32:52 +0000 UTC (0+2 container statuses recorded) Aug 18 11:47:54.317: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:47:54.317: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:47:54.317: INFO: collectd-xdprr started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:47:54.317: INFO: Container collectd ready: true, restart count 0 Aug 18 11:47:54.317: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:47:54.317: INFO: Container rbac-proxy ready: true, restart count 0 W0818 11:47:54.328875 27 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:47:54.360: INFO: Latency metrics for node node1 Aug 18 11:47:54.360: INFO: Logging node info for node node2 Aug 18 11:47:54.363: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 1d01177e-3dbb-48a1-a0bc-d18af27ab7f8 70277 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:d1:47:f8:1d:22"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:36 +0000 UTC,LastTransitionTime:2021-08-18 08:26:36 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:47:48 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:47:48 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:47:48 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:47:48 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:dc1f286135c145349b8a016880b65a2f,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:037e7e2d-94e9-42f4-a719-896e5005ac70,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:47:54.364: INFO: Logging kubelet events for node node2 Aug 18 11:47:54.366: INFO: Logging pods the kubelet thinks is on node node2 Aug 18 11:47:54.379: INFO: collectd-67ntq started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:47:54.379: INFO: Container collectd ready: true, restart count 0 Aug 18 11:47:54.379: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:47:54.379: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:47:54.379: INFO: ss-0 started at 2021-08-18 11:46:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:54.379: INFO: Container webserver ready: false, restart count 0 Aug 18 11:47:54.379: INFO: server started at 2021-08-18 11:44:57 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:54.379: INFO: Container agnhost-container ready: true, restart count 0 Aug 18 11:47:54.379: INFO: kube-multus-ds-amd64-rvzsg started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:54.379: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:47:54.379: INFO: termination-message-containerd34235c0-885f-4596-b8e2-47db8d79aee8 started at 2021-08-18 11:42:58 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:54.379: INFO: Container termination-message-container ready: false, restart count 0 Aug 18 11:47:54.379: INFO: tester started at 2021-08-18 11:45:01 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:54.379: INFO: Container tester ready: false, restart count 0 Aug 18 11:47:54.379: INFO: cmk-webhook-6c9d5f8578-7cxjr started at 2021-08-18 08:32:53 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:54.379: INFO: Container cmk-webhook ready: true, restart count 0 Aug 18 11:47:54.379: INFO: node-exporter-lrrf2 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:47:54.379: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:47:54.379: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:47:54.379: INFO: kube-flannel-h7t5h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:47:54.379: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:47:54.379: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:47:54.379: INFO: pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70 started at 2021-08-18 11:46:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:54.379: INFO: Container env-test ready: false, restart count 0 Aug 18 11:47:54.379: INFO: cmk-init-discover-node2-6b2kz started at 2021-08-18 08:32:30 +0000 UTC (0+3 container statuses recorded) Aug 18 11:47:54.379: INFO: Container discover ready: false, restart count 0 Aug 18 11:47:54.379: INFO: Container init ready: false, restart count 0 Aug 18 11:47:54.379: INFO: Container install ready: false, restart count 0 Aug 18 11:47:54.379: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-7rn45 started at 2021-08-18 08:36:42 +0000 UTC (0+2 container statuses recorded) Aug 18 11:47:54.379: INFO: Container tas-controller ready: true, restart count 0 Aug 18 11:47:54.379: INFO: Container tas-extender ready: true, restart count 0 Aug 18 11:47:54.379: INFO: fail-once-local-pk5cs started at 2021-08-18 11:34:14 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:54.379: INFO: Container c ready: false, restart count 0 Aug 18 11:47:54.379: INFO: nginx-proxy-node2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:54.379: INFO: Container nginx-proxy ready: true, restart count 1 Aug 18 11:47:54.379: INFO: kubernetes-dashboard-86c6f9df5b-qrtdk started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:54.379: INFO: Container kubernetes-dashboard ready: true, restart count 2 Aug 18 11:47:54.379: INFO: cmk-748rz started at 2021-08-18 08:32:53 +0000 UTC (0+2 container statuses recorded) Aug 18 11:47:54.379: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:47:54.379: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:47:54.379: INFO: node-feature-discovery-worker-hzpf5 started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:54.379: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:47:54.379: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-c82pt started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:54.379: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:47:54.379: INFO: prometheus-operator-5bb8cb9d8f-k97ws started at 2021-08-18 08:33:38 +0000 UTC (0+2 container statuses recorded) Aug 18 11:47:54.379: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:47:54.379: INFO: Container prometheus-operator ready: true, restart count 0 Aug 18 11:47:54.379: INFO: kube-proxy-qkj9c started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:54.379: INFO: Container kube-proxy ready: true, restart count 2 W0818 11:47:54.392439 27 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:47:54.421: INFO: Latency metrics for node node2 Aug 18 11:47:54.421: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "secrets-5315" for this suite. • Failure [302.910 seconds] [sig-api-machinery] Secrets /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/secrets.go:36 should be consumable via the environment [NodeConformance] [Conformance] [It] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:47:54.115: Unexpected error: <*errors.errorString | 0xc004edf280>: { s: "expected pod \"pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5\" success: Gave up after waiting 5m0s for pod \"pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5\" to be \"Succeeded or Failed\"", } expected pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5" success: Gave up after waiting 5m0s for pod "pod-configmaps-29d7735d-b2a3-4f31-a0a0-d8b658e924c5" to be "Succeeded or Failed" occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 ------------------------------ {"msg":"FAILED [sig-api-machinery] Secrets should be consumable via the environment [NodeConformance] [Conformance]","total":-1,"completed":21,"skipped":362,"failed":3,"failures":["[sig-node] Downward API should provide host IP as an env var [NodeConformance] [Conformance]","[k8s.io] Kubelet when scheduling a busybox Pod with hostAliases should write entries to /etc/hosts [LinuxOnly] [NodeConformance] [Conformance]","[sig-api-machinery] Secrets should be consumable via the environment [NodeConformance] [Conformance]"]} SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-apps] ReplicationController /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:47:54.491: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename replication-controller STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-apps] ReplicationController /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/rc.go:54 [It] should surface a failure condition on a common issue like exceeded quota [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:47:54.510: INFO: Creating quota "condition-test" that allows only two pods to run in the current namespace STEP: Creating rc "condition-test" that asks for more than the allowed pod quota STEP: Checking rc "condition-test" has the desired failure condition set STEP: Scaling down rc "condition-test" to satisfy pod quota Aug 18 11:47:56.538: INFO: Updating replication controller "condition-test" STEP: Checking rc "condition-test" has no failure condition set [AfterEach] [sig-apps] ReplicationController /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:47:57.544: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "replication-controller-8987" for this suite. • ------------------------------ {"msg":"PASSED [sig-apps] ReplicationController should surface a failure condition on a common issue like exceeded quota [Conformance]","total":-1,"completed":22,"skipped":393,"failed":3,"failures":["[sig-node] Downward API should provide host IP as an env var [NodeConformance] [Conformance]","[k8s.io] Kubelet when scheduling a busybox Pod with hostAliases should write entries to /etc/hosts [LinuxOnly] [NodeConformance] [Conformance]","[sig-api-machinery] Secrets should be consumable via the environment [NodeConformance] [Conformance]"]} SSSSSSS ------------------------------ [BeforeEach] [k8s.io] Container Runtime /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:42:58.597: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename container-runtime STEP: Waiting for a default service account to be provisioned in namespace [It] should report termination message [LinuxOnly] from log output if TerminationMessagePolicy FallbackToLogsOnError is set [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: create the container STEP: wait for the container to reach Failed Aug 18 11:47:58.629: FAIL: Timed out after 300.000s. Expected : Pending to equal : Failed Full Stack Trace k8s.io/kubernetes/test/e2e/common.glob..func25.1.2.1(0x4c650ad, 0x1d, 0xc000550060, 0x1e, 0xc004c8a600, 0x2, 0x2, 0xc004bddd50, 0x1, 0x1, ...) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/runtime.go:154 +0x3f1 k8s.io/kubernetes/test/e2e/common.glob..func25.1.2.4() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/runtime.go:228 +0x1d2 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc001b28d80) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc001b28d80) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc001b28d80, 0x4deb2c0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] Container Runtime /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "container-runtime-4667". STEP: Found 10 events. Aug 18 11:47:58.640: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for termination-message-containerd34235c0-885f-4596-b8e2-47db8d79aee8: { } Scheduled: Successfully assigned container-runtime-4667/termination-message-containerd34235c0-885f-4596-b8e2-47db8d79aee8 to node2 Aug 18 11:47:58.640: INFO: At 2021-08-18 11:43:00 +0000 UTC - event for termination-message-containerd34235c0-885f-4596-b8e2-47db8d79aee8: {multus } AddedInterface: Add eth0 [10.244.3.51/24] Aug 18 11:47:58.640: INFO: At 2021-08-18 11:43:00 +0000 UTC - event for termination-message-containerd34235c0-885f-4596-b8e2-47db8d79aee8: {kubelet node2} Pulling: Pulling image "docker.io/library/busybox:1.29" Aug 18 11:47:58.640: INFO: At 2021-08-18 11:43:00 +0000 UTC - event for termination-message-containerd34235c0-885f-4596-b8e2-47db8d79aee8: {kubelet node2} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit Aug 18 11:47:58.640: INFO: At 2021-08-18 11:43:00 +0000 UTC - event for termination-message-containerd34235c0-885f-4596-b8e2-47db8d79aee8: {kubelet node2} Failed: Error: ErrImagePull Aug 18 11:47:58.640: INFO: At 2021-08-18 11:43:01 +0000 UTC - event for termination-message-containerd34235c0-885f-4596-b8e2-47db8d79aee8: {kubelet node2} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Aug 18 11:47:58.640: INFO: At 2021-08-18 11:43:06 +0000 UTC - event for termination-message-containerd34235c0-885f-4596-b8e2-47db8d79aee8: {multus } AddedInterface: Add eth0 [10.244.3.54/24] Aug 18 11:47:58.640: INFO: At 2021-08-18 11:43:07 +0000 UTC - event for termination-message-containerd34235c0-885f-4596-b8e2-47db8d79aee8: {kubelet node2} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" Aug 18 11:47:58.640: INFO: At 2021-08-18 11:43:07 +0000 UTC - event for termination-message-containerd34235c0-885f-4596-b8e2-47db8d79aee8: {kubelet node2} Failed: Error: ImagePullBackOff Aug 18 11:47:58.640: INFO: At 2021-08-18 11:43:12 +0000 UTC - event for termination-message-containerd34235c0-885f-4596-b8e2-47db8d79aee8: {multus } AddedInterface: Add eth0 [10.244.3.59/24] Aug 18 11:47:58.642: INFO: POD NODE PHASE GRACE CONDITIONS Aug 18 11:47:58.642: INFO: Aug 18 11:47:58.648: INFO: Logging node info for node master1 Aug 18 11:47:58.650: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 ebb211fa-503f-4cfe-b1ed-c95d27a70e6e 70349 0 2021-08-18 08:20:52 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"3a:82:be:72:b5:15"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:20:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:20:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:25:59 +0000 UTC,LastTransitionTime:2021-08-18 08:25:59 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:47:57 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:47:57 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:47:57 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:47:57 +0000 UTC,LastTransitionTime:2021-08-18 08:25:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:58c3e57359b641ad92fa1959f2fecf5d,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:012cd796-2076-45d6-8b14-d3e0451b1e64,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[@ :],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:47:58.651: INFO: Logging kubelet events for node master1 Aug 18 11:47:58.653: INFO: Logging pods the kubelet thinks is on node master1 Aug 18 11:47:58.661: INFO: kube-controller-manager-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:58.661: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:47:58.661: INFO: kube-multus-ds-amd64-kbcp6 started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:58.661: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:47:58.661: INFO: docker-registry-docker-registry-56cbc7bc58-49kl2 started at 2021-08-18 08:26:23 +0000 UTC (0+2 container statuses recorded) Aug 18 11:47:58.661: INFO: Container docker-registry ready: true, restart count 0 Aug 18 11:47:58.661: INFO: Container nginx ready: true, restart count 0 Aug 18 11:47:58.661: INFO: node-exporter-5hwz9 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:47:58.661: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:47:58.661: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:47:58.661: INFO: kube-apiserver-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:58.661: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:47:58.661: INFO: kube-proxy-vqk4v started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:58.661: INFO: Container kube-proxy ready: true, restart count 1 Aug 18 11:47:58.661: INFO: kube-flannel-q64cq started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:47:58.661: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:47:58.661: INFO: Container kube-flannel ready: true, restart count 3 Aug 18 11:47:58.661: INFO: coredns-7677f9bb54-kn2qg started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:58.661: INFO: Container coredns ready: true, restart count 2 Aug 18 11:47:58.661: INFO: kube-scheduler-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:58.661: INFO: Container kube-scheduler ready: true, restart count 0 W0818 11:47:58.675642 31 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:47:58.700: INFO: Latency metrics for node master1 Aug 18 11:47:58.700: INFO: Logging node info for node master2 Aug 18 11:47:58.702: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 78946293-3abe-4442-84d4-8ed6b1d15ce0 70337 0 2021-08-18 08:21:31 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"7e:f5:c2:cc:3a:b4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:21:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:21:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-08-18 08:29:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:47:55 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:47:55 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:47:55 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:47:55 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0c44122c7a7248c18d8571e1cc667258,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:0cd329f2-48e0-4c8f-b8b9-fa3ae0ed8406,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:47:58.703: INFO: Logging kubelet events for node master2 Aug 18 11:47:58.706: INFO: Logging pods the kubelet thinks is on node master2 Aug 18 11:47:58.713: INFO: kube-controller-manager-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:58.713: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:47:58.713: INFO: kube-proxy-kh2l9 started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:58.713: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:47:58.713: INFO: kube-flannel-pp56h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:47:58.713: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:47:58.713: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:47:58.713: INFO: kube-apiserver-master2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:58.713: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:47:58.713: INFO: kube-scheduler-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:58.713: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:47:58.713: INFO: kube-multus-ds-amd64-mld8g started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:58.713: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:47:58.713: INFO: dns-autoscaler-5b7b5c9b6f-hh47r started at 2021-08-18 08:23:57 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:58.713: INFO: Container autoscaler ready: true, restart count 2 Aug 18 11:47:58.713: INFO: node-feature-discovery-controller-5bf5c49849-mq57c started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:58.713: INFO: Container nfd-controller ready: true, restart count 0 Aug 18 11:47:58.713: INFO: node-exporter-48nfx started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:47:58.713: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:47:58.713: INFO: Container node-exporter ready: true, restart count 0 W0818 11:47:58.724631 31 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:47:58.749: INFO: Latency metrics for node master2 Aug 18 11:47:58.749: INFO: Logging node info for node master3 Aug 18 11:47:58.752: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 44feac2b-9447-4be2-9fcd-62f836d67c72 70290 0 2021-08-18 08:21:41 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"86:e4:31:99:58:40"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {kubelet Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:47:51 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:47:51 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:47:51 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:47:51 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1fae19ae59884c44899bcd08aa243244,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:5db926c5-6530-4635-a0d5-806974a3b732,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:47:58.752: INFO: Logging kubelet events for node master3 Aug 18 11:47:58.754: INFO: Logging pods the kubelet thinks is on node master3 Aug 18 11:47:58.761: INFO: kube-apiserver-master3 started at 2021-08-18 08:29:12 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:58.761: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:47:58.762: INFO: kube-proxy-sd5lc started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:58.762: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:47:58.762: INFO: kube-flannel-x6tlr started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:47:58.762: INFO: Init container install-cni ready: true, restart count 1 Aug 18 11:47:58.762: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:47:58.762: INFO: kube-multus-ds-amd64-bkw6c started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:58.762: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:47:58.762: INFO: coredns-7677f9bb54-5hxfh started at 2021-08-18 08:23:54 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:58.762: INFO: Container coredns ready: true, restart count 1 Aug 18 11:47:58.762: INFO: node-exporter-vq7d8 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:47:58.762: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:47:58.762: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:47:58.762: INFO: kube-controller-manager-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:58.762: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:47:58.762: INFO: kube-scheduler-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:58.762: INFO: Container kube-scheduler ready: true, restart count 2 W0818 11:47:58.774416 31 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:47:58.799: INFO: Latency metrics for node master3 Aug 18 11:47:58.799: INFO: Logging node info for node node1 Aug 18 11:47:58.802: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 84defabd-6ebf-43ec-a629-44c6713da9c9 70291 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"9a:87:55:36:7b:df"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:13 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:35 +0000 UTC,LastTransitionTime:2021-08-18 08:26:35 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:47:51 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:47:51 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:47:51 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:47:51 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:69946ff2b7bc462fa25eb7adb4703c23,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:736dc52f-f5e3-494e-86ca-01eedbea015c,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:a7cea43d9d2f67c38fbf0407786edbe660ee9072945f7bb272b55fd255e8eaca opnfv/barometer-collectd:stable],SizeBytes:1075746799,},ContainerImage{Names:[@ :],SizeBytes:1003788820,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[aquasec/kube-hunter@sha256:2be6820bc1d7e0f57193a9a27d5a3e16b2fd93c53747b03ce8ca48c6fc323781 aquasec/kube-hunter:0.3.1],SizeBytes:347611549,},ContainerImage{Names:[golang@sha256:db2475a1dbb2149508e5db31d7d77a75e6600d54be645f37681f03f2762169ba golang:alpine3.12],SizeBytes:301186719,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:de25c7fc6c4f3a27c7f0c2dff454e4671823a34d88abd533f210848d527e0fbb alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:47:58.803: INFO: Logging kubelet events for node node1 Aug 18 11:47:58.805: INFO: Logging pods the kubelet thinks is on node node1 Aug 18 11:47:58.819: INFO: kube-proxy-p6jvp started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:58.819: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:47:58.819: INFO: kubernetes-metrics-scraper-678c97765c-9nsv5 started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:58.819: INFO: Container kubernetes-metrics-scraper ready: true, restart count 2 Aug 18 11:47:58.819: INFO: cmk-init-discover-node1-bxznx started at 2021-08-18 08:32:10 +0000 UTC (0+3 container statuses recorded) Aug 18 11:47:58.819: INFO: Container discover ready: false, restart count 0 Aug 18 11:47:58.819: INFO: Container init ready: false, restart count 0 Aug 18 11:47:58.819: INFO: Container install ready: false, restart count 0 Aug 18 11:47:58.819: INFO: cmk-d8r27 started at 2021-08-18 08:32:52 +0000 UTC (0+2 container statuses recorded) Aug 18 11:47:58.819: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:47:58.819: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:47:58.819: INFO: collectd-xdprr started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:47:58.819: INFO: Container collectd ready: true, restart count 0 Aug 18 11:47:58.819: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:47:58.819: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:47:58.819: INFO: condition-test-nj8nm started at 2021-08-18 11:47:55 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:58.819: INFO: Container httpd ready: false, restart count 0 Aug 18 11:47:58.819: INFO: nginx-proxy-node1 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:58.819: INFO: Container nginx-proxy ready: true, restart count 2 Aug 18 11:47:58.819: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-vsxvg started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:58.819: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:47:58.819: INFO: fail-once-local-8rxnh started at 2021-08-18 11:34:14 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:58.819: INFO: Container c ready: false, restart count 0 Aug 18 11:47:58.819: INFO: pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975 started at 2021-08-18 11:47:15 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:58.819: INFO: Container secret-env-test ready: false, restart count 0 Aug 18 11:47:58.819: INFO: var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209 started at 2021-08-18 11:47:57 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:58.819: INFO: Container dapi-container ready: false, restart count 0 Aug 18 11:47:58.819: INFO: termination-message-container0695240e-6103-4528-845b-e45cb7a8bd7f started at 2021-08-18 11:43:31 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:58.819: INFO: Container termination-message-container ready: false, restart count 0 Aug 18 11:47:58.819: INFO: kube-flannel-q78nd started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:47:58.819: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:47:58.819: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:47:58.819: INFO: prometheus-k8s-0 started at 2021-08-18 08:34:03 +0000 UTC (0+5 container statuses recorded) Aug 18 11:47:58.819: INFO: Container custom-metrics-apiserver ready: true, restart count 0 Aug 18 11:47:58.819: INFO: Container grafana ready: true, restart count 0 Aug 18 11:47:58.819: INFO: Container prometheus ready: true, restart count 1 Aug 18 11:47:58.819: INFO: Container prometheus-config-reloader ready: true, restart count 0 Aug 18 11:47:58.819: INFO: Container rules-configmap-reloader ready: true, restart count 0 Aug 18 11:47:58.819: INFO: kube-multus-ds-amd64-rrvmb started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:58.819: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:47:58.819: INFO: node-feature-discovery-worker-pflgw started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:58.819: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:47:58.819: INFO: node-exporter-kcwvn started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:47:58.819: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:47:58.819: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:47:58.819: INFO: pod-exec-websocket-bcecdfc1-0c3c-45a9-8652-d4ffebd4fba3 started at 2021-08-18 11:45:21 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:58.819: INFO: Container main ready: false, restart count 0 Aug 18 11:47:58.820: INFO: ss-0 started at 2021-08-18 11:47:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:58.820: INFO: Container webserver ready: false, restart count 0 W0818 11:47:58.834420 31 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:47:58.932: INFO: Latency metrics for node node1 Aug 18 11:47:58.932: INFO: Logging node info for node node2 Aug 18 11:47:58.934: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 1d01177e-3dbb-48a1-a0bc-d18af27ab7f8 70371 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:d1:47:f8:1d:22"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:36 +0000 UTC,LastTransitionTime:2021-08-18 08:26:36 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:47:58 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:47:58 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:47:58 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:47:58 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:dc1f286135c145349b8a016880b65a2f,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:037e7e2d-94e9-42f4-a719-896e5005ac70,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:47:58.935: INFO: Logging kubelet events for node node2 Aug 18 11:47:58.938: INFO: Logging pods the kubelet thinks is on node node2 Aug 18 11:47:58.988: INFO: cmk-748rz started at 2021-08-18 08:32:53 +0000 UTC (0+2 container statuses recorded) Aug 18 11:47:58.988: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:47:58.988: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:47:58.988: INFO: condition-test-qm24x started at 2021-08-18 11:47:55 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:58.988: INFO: Container httpd ready: false, restart count 0 Aug 18 11:47:58.988: INFO: kube-proxy-qkj9c started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:58.988: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:47:58.988: INFO: node-feature-discovery-worker-hzpf5 started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:58.988: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:47:58.988: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-c82pt started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:58.988: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:47:58.988: INFO: prometheus-operator-5bb8cb9d8f-k97ws started at 2021-08-18 08:33:38 +0000 UTC (0+2 container statuses recorded) Aug 18 11:47:58.988: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:47:58.988: INFO: Container prometheus-operator ready: true, restart count 0 Aug 18 11:47:58.988: INFO: kube-multus-ds-amd64-rvzsg started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:58.988: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:47:58.988: INFO: collectd-67ntq started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:47:58.988: INFO: Container collectd ready: true, restart count 0 Aug 18 11:47:58.988: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:47:58.988: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:47:58.988: INFO: ss-0 started at 2021-08-18 11:46:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:58.988: INFO: Container webserver ready: false, restart count 0 Aug 18 11:47:58.988: INFO: server started at 2021-08-18 11:44:57 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:58.988: INFO: Container agnhost-container ready: true, restart count 0 Aug 18 11:47:58.988: INFO: cmk-webhook-6c9d5f8578-7cxjr started at 2021-08-18 08:32:53 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:58.988: INFO: Container cmk-webhook ready: true, restart count 0 Aug 18 11:47:58.988: INFO: tester started at 2021-08-18 11:45:01 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:58.988: INFO: Container tester ready: false, restart count 0 Aug 18 11:47:58.988: INFO: kube-flannel-h7t5h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:47:58.988: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:47:58.988: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:47:58.988: INFO: node-exporter-lrrf2 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:47:58.988: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:47:58.988: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:47:58.988: INFO: pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70 started at 2021-08-18 11:46:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:58.988: INFO: Container env-test ready: false, restart count 0 Aug 18 11:47:58.988: INFO: nginx-proxy-node2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:58.988: INFO: Container nginx-proxy ready: true, restart count 1 Aug 18 11:47:58.988: INFO: cmk-init-discover-node2-6b2kz started at 2021-08-18 08:32:30 +0000 UTC (0+3 container statuses recorded) Aug 18 11:47:58.988: INFO: Container discover ready: false, restart count 0 Aug 18 11:47:58.988: INFO: Container init ready: false, restart count 0 Aug 18 11:47:58.988: INFO: Container install ready: false, restart count 0 Aug 18 11:47:58.988: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-7rn45 started at 2021-08-18 08:36:42 +0000 UTC (0+2 container statuses recorded) Aug 18 11:47:58.988: INFO: Container tas-controller ready: true, restart count 0 Aug 18 11:47:58.988: INFO: Container tas-extender ready: true, restart count 0 Aug 18 11:47:58.988: INFO: fail-once-local-pk5cs started at 2021-08-18 11:34:14 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:58.988: INFO: Container c ready: false, restart count 0 Aug 18 11:47:58.988: INFO: kubernetes-dashboard-86c6f9df5b-qrtdk started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:47:58.988: INFO: Container kubernetes-dashboard ready: true, restart count 2 W0818 11:47:59.001051 31 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:47:59.632: INFO: Latency metrics for node node2 Aug 18 11:47:59.632: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "container-runtime-4667" for this suite. • Failure [301.044 seconds] [k8s.io] Container Runtime /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 blackbox test /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/runtime.go:41 on terminated container /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/runtime.go:134 should report termination message [LinuxOnly] from log output if TerminationMessagePolicy FallbackToLogsOnError is set [NodeConformance] [Conformance] [It] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:47:58.629: Timed out after 300.000s. Expected : Pending to equal : Failed /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/runtime.go:154 ------------------------------ {"msg":"FAILED [k8s.io] Container Runtime blackbox test on terminated container should report termination message [LinuxOnly] from log output if TerminationMessagePolicy FallbackToLogsOnError is set [NodeConformance] [Conformance]","total":-1,"completed":0,"skipped":101,"failed":3,"failures":["[sig-apps] StatefulSet [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] should perform rolling updates and roll backs of template modifications [Conformance]","[k8s.io] Probing container should be restarted with a exec \"cat /tmp/health\" liveness probe [NodeConformance] [Conformance]","[k8s.io] Container Runtime blackbox test on terminated container should report termination message [LinuxOnly] from log output if TerminationMessagePolicy FallbackToLogsOnError is set [NodeConformance] [Conformance]"]} SSSSSSSS ------------------------------ [BeforeEach] version v1 /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:47:59.663: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename proxy STEP: Waiting for a default service account to be provisioned in namespace [It] should proxy through a service and a pod [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: starting an echo server on multiple ports STEP: creating replication controller proxy-service-kj649 in namespace proxy-9838 I0818 11:47:59.703510 31 runners.go:190] Created replication controller with name: proxy-service-kj649, namespace: proxy-9838, replica count: 1 I0818 11:48:00.754008 31 runners.go:190] proxy-service-kj649 Pods: 1 out of 1 created, 0 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0818 11:48:01.754408 31 runners.go:190] proxy-service-kj649 Pods: 1 out of 1 created, 0 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0818 11:48:02.755147 31 runners.go:190] proxy-service-kj649 Pods: 1 out of 1 created, 0 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0818 11:48:03.755650 31 runners.go:190] proxy-service-kj649 Pods: 1 out of 1 created, 0 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0818 11:48:04.756780 31 runners.go:190] proxy-service-kj649 Pods: 1 out of 1 created, 0 running, 0 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 1 runningButNotReady I0818 11:48:05.757134 31 runners.go:190] proxy-service-kj649 Pods: 1 out of 1 created, 0 running, 0 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 1 runningButNotReady I0818 11:48:06.758809 31 runners.go:190] proxy-service-kj649 Pods: 1 out of 1 created, 0 running, 0 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 1 runningButNotReady I0818 11:48:07.759169 31 runners.go:190] proxy-service-kj649 Pods: 1 out of 1 created, 1 running, 0 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady Aug 18 11:48:07.762: INFO: setup took 8.069851075s, starting test cases STEP: running 16 cases, 20 attempts per case, 320 total attempts Aug 18 11:48:07.767: INFO: (0) /api/v1/namespaces/proxy-9838/services/proxy-service-kj649:portname1/proxy/: foo (200; 4.958286ms) Aug 18 11:48:07.768: INFO: (0) /api/v1/namespaces/proxy-9838/pods/proxy-service-kj649-cnmtb/proxy/: test (200; 5.555614ms) Aug 18 11:48:07.769: INFO: (0) /api/v1/namespaces/proxy-9838/pods/proxy-service-kj649-cnmtb:162/proxy/: bar (200; 6.983347ms) Aug 18 11:48:07.769: INFO: (0) /api/v1/namespaces/proxy-9838/pods/proxy-service-kj649-cnmtb:160/proxy/: foo (200; 6.717091ms) Aug 18 11:48:07.770: INFO: (0) /api/v1/namespaces/proxy-9838/services/http:proxy-service-kj649:portname2/proxy/: bar (200; 7.657484ms) Aug 18 11:48:07.770: INFO: (0) /api/v1/namespaces/proxy-9838/services/http:proxy-service-kj649:portname1/proxy/: foo (200; 7.757864ms) Aug 18 11:48:07.770: INFO: (0) /api/v1/namespaces/proxy-9838/services/proxy-service-kj649:portname2/proxy/: bar (200; 7.618826ms) Aug 18 11:48:07.770: INFO: (0) /api/v1/namespaces/proxy-9838/pods/http:proxy-service-kj649-cnmtb:160/proxy/: foo (200; 7.816921ms) Aug 18 11:48:07.770: INFO: (0) /api/v1/namespaces/proxy-9838/pods/http:proxy-service-kj649-cnmtb:1080/proxy/: ... (200; 8.140205ms) Aug 18 11:48:07.771: INFO: (0) /api/v1/namespaces/proxy-9838/pods/proxy-service-kj649-cnmtb:1080/proxy/: test<... (200; 8.305074ms) Aug 18 11:48:07.772: INFO: (0) /api/v1/namespaces/proxy-9838/pods/http:proxy-service-kj649-cnmtb:162/proxy/: bar (200; 9.323093ms) Aug 18 11:48:07.773: INFO: (0) /api/v1/namespaces/proxy-9838/services/https:proxy-service-kj649:tlsportname2/proxy/: tls qux (200; 10.395571ms) Aug 18 11:48:07.773: INFO: (0) /api/v1/namespaces/proxy-9838/services/https:proxy-service-kj649:tlsportname1/proxy/: tls baz (200; 10.52018ms) Aug 18 11:48:07.773: INFO: (0) /api/v1/namespaces/proxy-9838/pods/https:proxy-service-kj649-cnmtb:460/proxy/: tls baz (200; 9.75754ms) Aug 18 11:48:07.773: INFO: (0) /api/v1/namespaces/proxy-9838/pods/https:proxy-service-kj649-cnmtb:462/proxy/: tls qux (200; 10.701474ms) Aug 18 11:48:07.774: INFO: (0) /api/v1/namespaces/proxy-9838/pods/https:proxy-service-kj649-cnmtb:443/proxy/: ... (200; 2.202695ms) Aug 18 11:48:07.777: INFO: (1) /api/v1/namespaces/proxy-9838/pods/https:proxy-service-kj649-cnmtb:443/proxy/: test (200; 2.364318ms) Aug 18 11:48:07.777: INFO: (1) /api/v1/namespaces/proxy-9838/pods/http:proxy-service-kj649-cnmtb:162/proxy/: bar (200; 2.43179ms) Aug 18 11:48:07.777: INFO: (1) /api/v1/namespaces/proxy-9838/pods/proxy-service-kj649-cnmtb:162/proxy/: bar (200; 2.894288ms) Aug 18 11:48:07.777: INFO: (1) /api/v1/namespaces/proxy-9838/pods/http:proxy-service-kj649-cnmtb:160/proxy/: foo (200; 2.876072ms) Aug 18 11:48:07.777: INFO: (1) /api/v1/namespaces/proxy-9838/pods/proxy-service-kj649-cnmtb:1080/proxy/: test<... (200; 3.055481ms) Aug 18 11:48:07.777: INFO: (1) /api/v1/namespaces/proxy-9838/pods/https:proxy-service-kj649-cnmtb:460/proxy/: tls baz (200; 2.942673ms) Aug 18 11:48:07.778: INFO: (1) /api/v1/namespaces/proxy-9838/pods/https:proxy-service-kj649-cnmtb:462/proxy/: tls qux (200; 3.062173ms) Aug 18 11:48:07.778: INFO: (1) /api/v1/namespaces/proxy-9838/pods/proxy-service-kj649-cnmtb:160/proxy/: foo (200; 3.549866ms) Aug 18 11:48:07.778: INFO: (1) /api/v1/namespaces/proxy-9838/services/http:proxy-service-kj649:portname2/proxy/: bar (200; 3.443936ms) Aug 18 11:48:07.778: INFO: (1) /api/v1/namespaces/proxy-9838/services/proxy-service-kj649:portname1/proxy/: foo (200; 3.634253ms) Aug 18 11:48:07.778: INFO: (1) /api/v1/namespaces/proxy-9838/services/proxy-service-kj649:portname2/proxy/: bar (200; 3.373469ms) Aug 18 11:48:07.778: INFO: (1) /api/v1/namespaces/proxy-9838/services/http:proxy-service-kj649:portname1/proxy/: foo (200; 3.631616ms) Aug 18 11:48:07.778: INFO: (1) /api/v1/namespaces/proxy-9838/services/https:proxy-service-kj649:tlsportname1/proxy/: tls baz (200; 3.965521ms) Aug 18 11:48:07.779: INFO: (1) /api/v1/namespaces/proxy-9838/services/https:proxy-service-kj649:tlsportname2/proxy/: tls qux (200; 4.020356ms) Aug 18 11:48:07.781: INFO: (2) /api/v1/namespaces/proxy-9838/pods/http:proxy-service-kj649-cnmtb:162/proxy/: bar (200; 1.973943ms) Aug 18 11:48:07.781: INFO: (2) /api/v1/namespaces/proxy-9838/services/proxy-service-kj649:portname1/proxy/: foo (200; 2.457883ms) Aug 18 11:48:07.781: INFO: (2) /api/v1/namespaces/proxy-9838/pods/proxy-service-kj649-cnmtb/proxy/: test (200; 2.397729ms) Aug 18 11:48:07.782: INFO: (2) /api/v1/namespaces/proxy-9838/pods/proxy-service-kj649-cnmtb:160/proxy/: foo (200; 2.718482ms) Aug 18 11:48:07.782: INFO: (2) /api/v1/namespaces/proxy-9838/pods/https:proxy-service-kj649-cnmtb:462/proxy/: tls qux (200; 2.79513ms) Aug 18 11:48:07.782: INFO: (2) /api/v1/namespaces/proxy-9838/pods/proxy-service-kj649-cnmtb:162/proxy/: bar (200; 2.932097ms) Aug 18 11:48:07.782: INFO: (2) /api/v1/namespaces/proxy-9838/pods/https:proxy-service-kj649-cnmtb:460/proxy/: tls baz (200; 2.887394ms) Aug 18 11:48:07.782: INFO: (2) /api/v1/namespaces/proxy-9838/services/http:proxy-service-kj649:portname2/proxy/: bar (200; 3.514526ms) Aug 18 11:48:07.782: INFO: (2) /api/v1/namespaces/proxy-9838/pods/http:proxy-service-kj649-cnmtb:160/proxy/: foo (200; 3.412639ms) Aug 18 11:48:07.782: INFO: (2) /api/v1/namespaces/proxy-9838/pods/http:proxy-service-kj649-cnmtb:1080/proxy/: ... (200; 3.476027ms) Aug 18 11:48:07.782: INFO: (2) /api/v1/namespaces/proxy-9838/pods/https:proxy-service-kj649-cnmtb:443/proxy/: test<... (200; 3.379252ms) Aug 18 11:48:07.782: INFO: (2) /api/v1/namespaces/proxy-9838/services/http:proxy-service-kj649:portname1/proxy/: foo (200; 3.499988ms) Aug 18 11:48:07.783: INFO: (2) /api/v1/namespaces/proxy-9838/services/https:proxy-service-kj649:tlsportname1/proxy/: tls baz (200; 3.924745ms) Aug 18 11:48:07.783: INFO: (2) /api/v1/namespaces/proxy-9838/services/https:proxy-service-kj649:tlsportname2/proxy/: tls qux (200; 3.909273ms) Aug 18 11:48:07.783: INFO: (2) /api/v1/namespaces/proxy-9838/services/proxy-service-kj649:portname2/proxy/: bar (200; 4.068401ms) Aug 18 11:48:07.785: INFO: (3) /api/v1/namespaces/proxy-9838/pods/proxy-service-kj649-cnmtb:162/proxy/: bar (200; 2.069332ms) Aug 18 11:48:07.785: INFO: (3) /api/v1/namespaces/proxy-9838/pods/http:proxy-service-kj649-cnmtb:162/proxy/: bar (200; 2.250342ms) Aug 18 11:48:07.786: INFO: (3) /api/v1/namespaces/proxy-9838/pods/proxy-service-kj649-cnmtb:160/proxy/: foo (200; 2.413818ms) Aug 18 11:48:07.786: INFO: (3) /api/v1/namespaces/proxy-9838/pods/https:proxy-service-kj649-cnmtb:460/proxy/: tls baz (200; 2.536873ms) Aug 18 11:48:07.786: INFO: (3) /api/v1/namespaces/proxy-9838/pods/https:proxy-service-kj649-cnmtb:443/proxy/: test<... (200; 2.662272ms) Aug 18 11:48:07.786: INFO: (3) /api/v1/namespaces/proxy-9838/pods/https:proxy-service-kj649-cnmtb:462/proxy/: tls qux (200; 2.91291ms) Aug 18 11:48:07.786: INFO: (3) /api/v1/namespaces/proxy-9838/services/https:proxy-service-kj649:tlsportname2/proxy/: tls qux (200; 3.141952ms) Aug 18 11:48:07.787: INFO: (3) /api/v1/namespaces/proxy-9838/pods/http:proxy-service-kj649-cnmtb:160/proxy/: foo (200; 3.57183ms) Aug 18 11:48:07.787: INFO: (3) /api/v1/namespaces/proxy-9838/pods/http:proxy-service-kj649-cnmtb:1080/proxy/: ... (200; 3.542821ms) Aug 18 11:48:07.787: INFO: (3) /api/v1/namespaces/proxy-9838/services/proxy-service-kj649:portname2/proxy/: bar (200; 3.674585ms) Aug 18 11:48:07.787: INFO: (3) /api/v1/namespaces/proxy-9838/services/https:proxy-service-kj649:tlsportname1/proxy/: tls baz (200; 3.813316ms) Aug 18 11:48:07.787: INFO: (3) /api/v1/namespaces/proxy-9838/pods/proxy-service-kj649-cnmtb/proxy/: test (200; 3.597811ms) Aug 18 11:48:07.787: INFO: (3) /api/v1/namespaces/proxy-9838/services/http:proxy-service-kj649:portname2/proxy/: bar (200; 3.99196ms) Aug 18 11:48:07.787: INFO: (3) /api/v1/namespaces/proxy-9838/services/http:proxy-service-kj649:portname1/proxy/: foo (200; 3.979814ms) Aug 18 11:48:07.789: INFO: (4) /api/v1/namespaces/proxy-9838/pods/https:proxy-service-kj649-cnmtb:462/proxy/: tls qux (200; 2.162443ms) Aug 18 11:48:07.790: INFO: (4) /api/v1/namespaces/proxy-9838/pods/https:proxy-service-kj649-cnmtb:460/proxy/: tls baz (200; 2.500375ms) Aug 18 11:48:07.790: INFO: (4) /api/v1/namespaces/proxy-9838/pods/http:proxy-service-kj649-cnmtb:162/proxy/: bar (200; 2.626986ms) Aug 18 11:48:07.790: INFO: (4) /api/v1/namespaces/proxy-9838/pods/proxy-service-kj649-cnmtb:162/proxy/: bar (200; 2.415154ms) Aug 18 11:48:07.790: INFO: (4) /api/v1/namespaces/proxy-9838/pods/http:proxy-service-kj649-cnmtb:1080/proxy/: ... (200; 2.445724ms) Aug 18 11:48:07.790: INFO: (4) /api/v1/namespaces/proxy-9838/pods/proxy-service-kj649-cnmtb:1080/proxy/: test<... (200; 2.716596ms) Aug 18 11:48:07.790: INFO: (4) /api/v1/namespaces/proxy-9838/pods/proxy-service-kj649-cnmtb:160/proxy/: foo (200; 3.012396ms) Aug 18 11:48:07.791: INFO: (4) /api/v1/namespaces/proxy-9838/services/proxy-service-kj649:portname2/proxy/: bar (200; 3.036434ms) Aug 18 11:48:07.791: INFO: (4) /api/v1/namespaces/proxy-9838/pods/proxy-service-kj649-cnmtb/proxy/: test (200; 3.129141ms) Aug 18 11:48:07.791: INFO: (4) /api/v1/namespaces/proxy-9838/pods/https:proxy-service-kj649-cnmtb:443/proxy/: test<... (200; 2.471691ms) Aug 18 11:48:07.795: INFO: (5) /api/v1/namespaces/proxy-9838/pods/proxy-service-kj649-cnmtb/proxy/: test (200; 2.958978ms) Aug 18 11:48:07.795: INFO: (5) /api/v1/namespaces/proxy-9838/pods/proxy-service-kj649-cnmtb:162/proxy/: bar (200; 3.260049ms) Aug 18 11:48:07.795: INFO: (5) /api/v1/namespaces/proxy-9838/pods/proxy-service-kj649-cnmtb:160/proxy/: foo (200; 3.222939ms) Aug 18 11:48:07.795: INFO: (5) /api/v1/namespaces/proxy-9838/pods/http:proxy-service-kj649-cnmtb:1080/proxy/: ... (200; 3.197094ms) Aug 18 11:48:07.795: INFO: (5) /api/v1/namespaces/proxy-9838/pods/http:proxy-service-kj649-cnmtb:162/proxy/: bar (200; 3.361329ms) Aug 18 11:48:07.795: INFO: (5) /api/v1/namespaces/proxy-9838/pods/https:proxy-service-kj649-cnmtb:462/proxy/: tls qux (200; 3.32806ms) Aug 18 11:48:07.795: INFO: (5) /api/v1/namespaces/proxy-9838/pods/http:proxy-service-kj649-cnmtb:160/proxy/: foo (200; 3.388256ms) Aug 18 11:48:07.795: INFO: (5) /api/v1/namespaces/proxy-9838/pods/https:proxy-service-kj649-cnmtb:443/proxy/: ... (200; 1.877049ms) Aug 18 11:48:07.798: INFO: (6) /api/v1/namespaces/proxy-9838/pods/http:proxy-service-kj649-cnmtb:162/proxy/: bar (200; 2.108359ms) Aug 18 11:48:07.798: INFO: (6) /api/v1/namespaces/proxy-9838/pods/https:proxy-service-kj649-cnmtb:460/proxy/: tls baz (200; 2.299176ms) Aug 18 11:48:07.798: INFO: (6) /api/v1/namespaces/proxy-9838/pods/http:proxy-service-kj649-cnmtb:160/proxy/: foo (200; 2.224108ms) Aug 18 11:48:07.799: INFO: (6) /api/v1/namespaces/proxy-9838/pods/proxy-service-kj649-cnmtb:1080/proxy/: test<... (200; 2.63838ms) Aug 18 11:48:07.799: INFO: (6) /api/v1/namespaces/proxy-9838/pods/proxy-service-kj649-cnmtb:160/proxy/: foo (200; 2.740764ms) Aug 18 11:48:07.799: INFO: (6) /api/v1/namespaces/proxy-9838/pods/https:proxy-service-kj649-cnmtb:462/proxy/: tls qux (200; 2.790744ms) Aug 18 11:48:07.799: INFO: (6) /api/v1/namespaces/proxy-9838/pods/proxy-service-kj649-cnmtb/proxy/: test (200; 2.912061ms) Aug 18 11:48:07.799: INFO: (6) /api/v1/namespaces/proxy-9838/services/http:proxy-service-kj649:portname1/proxy/: foo (200; 3.222243ms) Aug 18 11:48:07.800: INFO: (6) /api/v1/namespaces/proxy-9838/pods/proxy-service-kj649-cnmtb:162/proxy/: bar (200; 3.482084ms) Aug 18 11:48:07.800: INFO: (6) /api/v1/namespaces/proxy-9838/pods/https:proxy-service-kj649-cnmtb:443/proxy/: test<... (200; 2.289238ms) Aug 18 11:48:07.803: INFO: (7) /api/v1/namespaces/proxy-9838/pods/https:proxy-service-kj649-cnmtb:462/proxy/: tls qux (200; 2.460608ms) Aug 18 11:48:07.804: INFO: (7) /api/v1/namespaces/proxy-9838/pods/http:proxy-service-kj649-cnmtb:1080/proxy/: ... (200; 2.699416ms) Aug 18 11:48:07.804: INFO: (7) /api/v1/namespaces/proxy-9838/pods/http:proxy-service-kj649-cnmtb:162/proxy/: bar (200; 2.601686ms) Aug 18 11:48:07.804: INFO: (7) /api/v1/namespaces/proxy-9838/pods/proxy-service-kj649-cnmtb/proxy/: test (200; 2.766771ms) Aug 18 11:48:07.804: INFO: (7) /api/v1/namespaces/proxy-9838/pods/proxy-service-kj649-cnmtb:160/proxy/: foo (200; 2.804608ms) Aug 18 11:48:07.804: INFO: (7) /api/v1/namespaces/proxy-9838/services/proxy-service-kj649:portname1/proxy/: foo (200; 2.881107ms) Aug 18 11:48:07.804: INFO: (7) /api/v1/namespaces/proxy-9838/services/https:proxy-service-kj649:tlsportname1/proxy/: tls baz (200; 3.163797ms) Aug 18 11:48:07.804: INFO: (7) /api/v1/namespaces/proxy-9838/services/http:proxy-service-kj649:portname2/proxy/: bar (200; 3.411831ms) Aug 18 11:48:07.804: INFO: (7) /api/v1/namespaces/proxy-9838/pods/http:proxy-service-kj649-cnmtb:160/proxy/: foo (200; 3.439741ms) Aug 18 11:48:07.804: INFO: (7) /api/v1/namespaces/proxy-9838/services/proxy-service-kj649:portname2/proxy/: bar (200; 3.423781ms) Aug 18 11:48:07.804: INFO: (7) /api/v1/namespaces/proxy-9838/pods/proxy-service-kj649-cnmtb:162/proxy/: bar (200; 3.377001ms) Aug 18 11:48:07.804: INFO: (7) /api/v1/namespaces/proxy-9838/services/https:proxy-service-kj649:tlsportname2/proxy/: tls qux (200; 3.572336ms) Aug 18 11:48:07.804: INFO: (7) /api/v1/namespaces/proxy-9838/services/http:proxy-service-kj649:portname1/proxy/: foo (200; 3.463202ms) Aug 18 11:48:07.807: INFO: (8) /api/v1/namespaces/proxy-9838/pods/https:proxy-service-kj649-cnmtb:443/proxy/: ... (200; 2.032884ms) Aug 18 11:48:07.807: INFO: (8) /api/v1/namespaces/proxy-9838/pods/proxy-service-kj649-cnmtb:162/proxy/: bar (200; 2.532096ms) Aug 18 11:48:07.807: INFO: (8) /api/v1/namespaces/proxy-9838/pods/proxy-service-kj649-cnmtb/proxy/: test (200; 2.44334ms) Aug 18 11:48:07.807: INFO: (8) /api/v1/namespaces/proxy-9838/pods/http:proxy-service-kj649-cnmtb:162/proxy/: bar (200; 2.527521ms) Aug 18 11:48:07.807: INFO: (8) /api/v1/namespaces/proxy-9838/pods/proxy-service-kj649-cnmtb:1080/proxy/: test<... (200; 2.795029ms) Aug 18 11:48:07.808: INFO: (8) /api/v1/namespaces/proxy-9838/services/proxy-service-kj649:portname2/proxy/: bar (200; 2.918695ms) Aug 18 11:48:07.808: INFO: (8) /api/v1/namespaces/proxy-9838/pods/proxy-service-kj649-cnmtb:160/proxy/: foo (200; 2.982339ms) Aug 18 11:48:07.808: INFO: (8) /api/v1/namespaces/proxy-9838/services/https:proxy-service-kj649:tlsportname1/proxy/: tls baz (200; 3.186946ms) Aug 18 11:48:07.808: INFO: (8) /api/v1/namespaces/proxy-9838/pods/http:proxy-service-kj649-cnmtb:160/proxy/: foo (200; 2.946165ms) Aug 18 11:48:07.808: INFO: (8) /api/v1/namespaces/proxy-9838/services/http:proxy-service-kj649:portname1/proxy/: foo (200; 3.402365ms) Aug 18 11:48:07.808: INFO: (8) /api/v1/namespaces/proxy-9838/pods/https:proxy-service-kj649-cnmtb:460/proxy/: tls baz (200; 3.357653ms) Aug 18 11:48:07.808: INFO: (8) /api/v1/namespaces/proxy-9838/pods/https:proxy-service-kj649-cnmtb:462/proxy/: tls qux (200; 3.40675ms) Aug 18 11:48:07.808: INFO: (8) /api/v1/namespaces/proxy-9838/services/proxy-service-kj649:portname1/proxy/: foo (200; 3.64752ms) Aug 18 11:48:07.808: INFO: (8) /api/v1/namespaces/proxy-9838/services/https:proxy-service-kj649:tlsportname2/proxy/: tls qux (200; 3.742686ms) Aug 18 11:48:07.809: INFO: (8) /api/v1/namespaces/proxy-9838/services/http:proxy-service-kj649:portname2/proxy/: bar (200; 4.051331ms) Aug 18 11:48:07.811: INFO: (9) /api/v1/namespaces/proxy-9838/pods/proxy-service-kj649-cnmtb:160/proxy/: foo (200; 2.167627ms) Aug 18 11:48:07.811: INFO: (9) /api/v1/namespaces/proxy-9838/pods/proxy-service-kj649-cnmtb/proxy/: test (200; 2.190665ms) Aug 18 11:48:07.811: INFO: (9) /api/v1/namespaces/proxy-9838/pods/https:proxy-service-kj649-cnmtb:443/proxy/: ... (200; 2.304284ms) Aug 18 11:48:07.811: INFO: (9) /api/v1/namespaces/proxy-9838/pods/proxy-service-kj649-cnmtb:162/proxy/: bar (200; 2.476178ms) Aug 18 11:48:07.812: INFO: (9) /api/v1/namespaces/proxy-9838/services/https:proxy-service-kj649:tlsportname1/proxy/: tls baz (200; 3.001632ms) Aug 18 11:48:07.812: INFO: (9) /api/v1/namespaces/proxy-9838/pods/http:proxy-service-kj649-cnmtb:160/proxy/: foo (200; 2.980621ms) Aug 18 11:48:07.812: INFO: (9) /api/v1/namespaces/proxy-9838/pods/http:proxy-service-kj649-cnmtb:162/proxy/: bar (200; 3.072386ms) Aug 18 11:48:07.812: INFO: (9) /api/v1/namespaces/proxy-9838/pods/https:proxy-service-kj649-cnmtb:460/proxy/: tls baz (200; 3.117477ms) Aug 18 11:48:07.812: INFO: (9) /api/v1/namespaces/proxy-9838/pods/proxy-service-kj649-cnmtb:1080/proxy/: test<... (200; 3.150654ms) Aug 18 11:48:07.812: INFO: (9) /api/v1/namespaces/proxy-9838/services/http:proxy-service-kj649:portname1/proxy/: foo (200; 3.380056ms) Aug 18 11:48:07.812: INFO: (9) /api/v1/namespaces/proxy-9838/pods/https:proxy-service-kj649-cnmtb:462/proxy/: tls qux (200; 3.2861ms) Aug 18 11:48:07.812: INFO: (9) /api/v1/namespaces/proxy-9838/services/proxy-service-kj649:portname1/proxy/: foo (200; 3.536859ms) Aug 18 11:48:07.812: INFO: (9) /api/v1/namespaces/proxy-9838/services/proxy-service-kj649:portname2/proxy/: bar (200; 3.652879ms) Aug 18 11:48:07.813: INFO: (9) /api/v1/namespaces/proxy-9838/services/http:proxy-service-kj649:portname2/proxy/: bar (200; 3.785806ms) Aug 18 11:48:07.813: INFO: (9) /api/v1/namespaces/proxy-9838/services/https:proxy-service-kj649:tlsportname2/proxy/: tls qux (200; 4.379322ms) Aug 18 11:48:07.815: INFO: (10) /api/v1/namespaces/proxy-9838/pods/http:proxy-service-kj649-cnmtb:1080/proxy/: ... (200; 2.040628ms) Aug 18 11:48:07.816: INFO: (10) /api/v1/namespaces/proxy-9838/pods/proxy-service-kj649-cnmtb:162/proxy/: bar (200; 2.292163ms) Aug 18 11:48:07.816: INFO: (10) /api/v1/namespaces/proxy-9838/pods/proxy-service-kj649-cnmtb/proxy/: test (200; 2.674157ms) Aug 18 11:48:07.816: INFO: (10) /api/v1/namespaces/proxy-9838/pods/https:proxy-service-kj649-cnmtb:460/proxy/: tls baz (200; 2.62358ms) Aug 18 11:48:07.816: INFO: (10) /api/v1/namespaces/proxy-9838/pods/proxy-service-kj649-cnmtb:1080/proxy/: test<... (200; 2.675061ms) Aug 18 11:48:07.816: INFO: (10) /api/v1/namespaces/proxy-9838/pods/https:proxy-service-kj649-cnmtb:443/proxy/: ... (200; 2.668936ms) Aug 18 11:48:07.820: INFO: (11) /api/v1/namespaces/proxy-9838/pods/proxy-service-kj649-cnmtb:160/proxy/: foo (200; 2.455819ms) Aug 18 11:48:07.820: INFO: (11) /api/v1/namespaces/proxy-9838/pods/https:proxy-service-kj649-cnmtb:460/proxy/: tls baz (200; 2.720101ms) Aug 18 11:48:07.820: INFO: (11) /api/v1/namespaces/proxy-9838/pods/https:proxy-service-kj649-cnmtb:462/proxy/: tls qux (200; 2.778422ms) Aug 18 11:48:07.820: INFO: (11) /api/v1/namespaces/proxy-9838/pods/proxy-service-kj649-cnmtb/proxy/: test (200; 2.848584ms) Aug 18 11:48:07.820: INFO: (11) /api/v1/namespaces/proxy-9838/pods/http:proxy-service-kj649-cnmtb:162/proxy/: bar (200; 2.718123ms) Aug 18 11:48:07.821: INFO: (11) /api/v1/namespaces/proxy-9838/pods/proxy-service-kj649-cnmtb:162/proxy/: bar (200; 3.015648ms) Aug 18 11:48:07.821: INFO: (11) /api/v1/namespaces/proxy-9838/pods/proxy-service-kj649-cnmtb:1080/proxy/: test<... (200; 3.073022ms) Aug 18 11:48:07.821: INFO: (11) /api/v1/namespaces/proxy-9838/services/http:proxy-service-kj649:portname1/proxy/: foo (200; 3.161808ms) Aug 18 11:48:07.821: INFO: (11) /api/v1/namespaces/proxy-9838/pods/https:proxy-service-kj649-cnmtb:443/proxy/: ... (200; 2.378214ms) Aug 18 11:48:07.824: INFO: (12) /api/v1/namespaces/proxy-9838/pods/http:proxy-service-kj649-cnmtb:162/proxy/: bar (200; 2.694592ms) Aug 18 11:48:07.825: INFO: (12) /api/v1/namespaces/proxy-9838/pods/https:proxy-service-kj649-cnmtb:460/proxy/: tls baz (200; 2.866891ms) Aug 18 11:48:07.825: INFO: (12) /api/v1/namespaces/proxy-9838/pods/proxy-service-kj649-cnmtb/proxy/: test (200; 2.879693ms) Aug 18 11:48:07.825: INFO: (12) /api/v1/namespaces/proxy-9838/pods/http:proxy-service-kj649-cnmtb:160/proxy/: foo (200; 2.977651ms) Aug 18 11:48:07.825: INFO: (12) /api/v1/namespaces/proxy-9838/pods/proxy-service-kj649-cnmtb:1080/proxy/: test<... (200; 3.148328ms) Aug 18 11:48:07.825: INFO: (12) /api/v1/namespaces/proxy-9838/services/http:proxy-service-kj649:portname1/proxy/: foo (200; 3.258509ms) Aug 18 11:48:07.825: INFO: (12) /api/v1/namespaces/proxy-9838/services/proxy-service-kj649:portname1/proxy/: foo (200; 3.622801ms) Aug 18 11:48:07.825: INFO: (12) /api/v1/namespaces/proxy-9838/pods/proxy-service-kj649-cnmtb:160/proxy/: foo (200; 3.470006ms) Aug 18 11:48:07.825: INFO: (12) /api/v1/namespaces/proxy-9838/services/http:proxy-service-kj649:portname2/proxy/: bar (200; 3.756161ms) Aug 18 11:48:07.825: INFO: (12) /api/v1/namespaces/proxy-9838/services/proxy-service-kj649:portname2/proxy/: bar (200; 3.746045ms) Aug 18 11:48:07.825: INFO: (12) /api/v1/namespaces/proxy-9838/services/https:proxy-service-kj649:tlsportname1/proxy/: tls baz (200; 3.662171ms) Aug 18 11:48:07.826: INFO: (12) /api/v1/namespaces/proxy-9838/services/https:proxy-service-kj649:tlsportname2/proxy/: tls qux (200; 3.955443ms) Aug 18 11:48:07.828: INFO: (13) /api/v1/namespaces/proxy-9838/pods/proxy-service-kj649-cnmtb:1080/proxy/: test<... (200; 2.138045ms) Aug 18 11:48:07.828: INFO: (13) /api/v1/namespaces/proxy-9838/pods/proxy-service-kj649-cnmtb:160/proxy/: foo (200; 2.044918ms) Aug 18 11:48:07.828: INFO: (13) /api/v1/namespaces/proxy-9838/pods/http:proxy-service-kj649-cnmtb:1080/proxy/: ... (200; 2.110159ms) Aug 18 11:48:07.828: INFO: (13) /api/v1/namespaces/proxy-9838/pods/http:proxy-service-kj649-cnmtb:162/proxy/: bar (200; 2.603519ms) Aug 18 11:48:07.829: INFO: (13) /api/v1/namespaces/proxy-9838/pods/https:proxy-service-kj649-cnmtb:443/proxy/: test (200; 3.140926ms) Aug 18 11:48:07.829: INFO: (13) /api/v1/namespaces/proxy-9838/pods/proxy-service-kj649-cnmtb:162/proxy/: bar (200; 3.244496ms) Aug 18 11:48:07.829: INFO: (13) /api/v1/namespaces/proxy-9838/services/proxy-service-kj649:portname2/proxy/: bar (200; 3.541021ms) Aug 18 11:48:07.829: INFO: (13) /api/v1/namespaces/proxy-9838/services/https:proxy-service-kj649:tlsportname1/proxy/: tls baz (200; 3.482968ms) Aug 18 11:48:07.829: INFO: (13) /api/v1/namespaces/proxy-9838/services/https:proxy-service-kj649:tlsportname2/proxy/: tls qux (200; 3.366919ms) Aug 18 11:48:07.830: INFO: (13) /api/v1/namespaces/proxy-9838/services/http:proxy-service-kj649:portname2/proxy/: bar (200; 3.798017ms) Aug 18 11:48:07.830: INFO: (13) /api/v1/namespaces/proxy-9838/services/http:proxy-service-kj649:portname1/proxy/: foo (200; 3.921413ms) Aug 18 11:48:07.830: INFO: (13) /api/v1/namespaces/proxy-9838/services/proxy-service-kj649:portname1/proxy/: foo (200; 3.965598ms) Aug 18 11:48:07.832: INFO: (14) /api/v1/namespaces/proxy-9838/pods/proxy-service-kj649-cnmtb/proxy/: test (200; 2.236442ms) Aug 18 11:48:07.833: INFO: (14) /api/v1/namespaces/proxy-9838/pods/proxy-service-kj649-cnmtb:160/proxy/: foo (200; 2.544678ms) Aug 18 11:48:07.833: INFO: (14) /api/v1/namespaces/proxy-9838/pods/http:proxy-service-kj649-cnmtb:162/proxy/: bar (200; 2.678555ms) Aug 18 11:48:07.833: INFO: (14) /api/v1/namespaces/proxy-9838/pods/https:proxy-service-kj649-cnmtb:460/proxy/: tls baz (200; 2.880851ms) Aug 18 11:48:07.833: INFO: (14) /api/v1/namespaces/proxy-9838/pods/http:proxy-service-kj649-cnmtb:160/proxy/: foo (200; 2.825775ms) Aug 18 11:48:07.833: INFO: (14) /api/v1/namespaces/proxy-9838/pods/http:proxy-service-kj649-cnmtb:1080/proxy/: ... (200; 2.772213ms) Aug 18 11:48:07.833: INFO: (14) /api/v1/namespaces/proxy-9838/pods/proxy-service-kj649-cnmtb:162/proxy/: bar (200; 2.914055ms) Aug 18 11:48:07.833: INFO: (14) /api/v1/namespaces/proxy-9838/services/proxy-service-kj649:portname2/proxy/: bar (200; 3.195653ms) Aug 18 11:48:07.834: INFO: (14) /api/v1/namespaces/proxy-9838/pods/proxy-service-kj649-cnmtb:1080/proxy/: test<... (200; 3.7631ms) Aug 18 11:48:07.834: INFO: (14) /api/v1/namespaces/proxy-9838/services/proxy-service-kj649:portname1/proxy/: foo (200; 3.850701ms) Aug 18 11:48:07.834: INFO: (14) /api/v1/namespaces/proxy-9838/pods/https:proxy-service-kj649-cnmtb:443/proxy/: test<... (200; 2.289442ms) Aug 18 11:48:07.838: INFO: (15) /api/v1/namespaces/proxy-9838/pods/http:proxy-service-kj649-cnmtb:160/proxy/: foo (200; 2.651087ms) Aug 18 11:48:07.838: INFO: (15) /api/v1/namespaces/proxy-9838/pods/proxy-service-kj649-cnmtb/proxy/: test (200; 3.192211ms) Aug 18 11:48:07.838: INFO: (15) /api/v1/namespaces/proxy-9838/pods/http:proxy-service-kj649-cnmtb:162/proxy/: bar (200; 3.075317ms) Aug 18 11:48:07.838: INFO: (15) /api/v1/namespaces/proxy-9838/pods/proxy-service-kj649-cnmtb:162/proxy/: bar (200; 3.106509ms) Aug 18 11:48:07.838: INFO: (15) /api/v1/namespaces/proxy-9838/services/https:proxy-service-kj649:tlsportname1/proxy/: tls baz (200; 3.260013ms) Aug 18 11:48:07.838: INFO: (15) /api/v1/namespaces/proxy-9838/pods/http:proxy-service-kj649-cnmtb:1080/proxy/: ... (200; 3.149188ms) Aug 18 11:48:07.838: INFO: (15) /api/v1/namespaces/proxy-9838/services/proxy-service-kj649:portname2/proxy/: bar (200; 3.468885ms) Aug 18 11:48:07.838: INFO: (15) /api/v1/namespaces/proxy-9838/services/https:proxy-service-kj649:tlsportname2/proxy/: tls qux (200; 3.452527ms) Aug 18 11:48:07.838: INFO: (15) /api/v1/namespaces/proxy-9838/pods/https:proxy-service-kj649-cnmtb:443/proxy/: ... (200; 2.523033ms) Aug 18 11:48:07.842: INFO: (16) /api/v1/namespaces/proxy-9838/pods/https:proxy-service-kj649-cnmtb:443/proxy/: test (200; 2.476206ms) Aug 18 11:48:07.842: INFO: (16) /api/v1/namespaces/proxy-9838/pods/https:proxy-service-kj649-cnmtb:460/proxy/: tls baz (200; 2.466184ms) Aug 18 11:48:07.842: INFO: (16) /api/v1/namespaces/proxy-9838/pods/proxy-service-kj649-cnmtb:162/proxy/: bar (200; 2.354171ms) Aug 18 11:48:07.842: INFO: (16) /api/v1/namespaces/proxy-9838/pods/http:proxy-service-kj649-cnmtb:162/proxy/: bar (200; 2.55723ms) Aug 18 11:48:07.842: INFO: (16) /api/v1/namespaces/proxy-9838/pods/proxy-service-kj649-cnmtb:160/proxy/: foo (200; 2.844765ms) Aug 18 11:48:07.842: INFO: (16) /api/v1/namespaces/proxy-9838/pods/https:proxy-service-kj649-cnmtb:462/proxy/: tls qux (200; 2.89634ms) Aug 18 11:48:07.842: INFO: (16) /api/v1/namespaces/proxy-9838/pods/http:proxy-service-kj649-cnmtb:160/proxy/: foo (200; 2.986902ms) Aug 18 11:48:07.842: INFO: (16) /api/v1/namespaces/proxy-9838/pods/proxy-service-kj649-cnmtb:1080/proxy/: test<... (200; 3.015551ms) Aug 18 11:48:07.843: INFO: (16) /api/v1/namespaces/proxy-9838/services/proxy-service-kj649:portname2/proxy/: bar (200; 3.582839ms) Aug 18 11:48:07.843: INFO: (16) /api/v1/namespaces/proxy-9838/services/https:proxy-service-kj649:tlsportname1/proxy/: tls baz (200; 3.796247ms) Aug 18 11:48:07.843: INFO: (16) /api/v1/namespaces/proxy-9838/services/http:proxy-service-kj649:portname1/proxy/: foo (200; 3.903772ms) Aug 18 11:48:07.843: INFO: (16) /api/v1/namespaces/proxy-9838/services/https:proxy-service-kj649:tlsportname2/proxy/: tls qux (200; 4.324709ms) Aug 18 11:48:07.843: INFO: (16) /api/v1/namespaces/proxy-9838/services/http:proxy-service-kj649:portname2/proxy/: bar (200; 4.380912ms) Aug 18 11:48:07.843: INFO: (16) /api/v1/namespaces/proxy-9838/services/proxy-service-kj649:portname1/proxy/: foo (200; 4.232266ms) Aug 18 11:48:07.846: INFO: (17) /api/v1/namespaces/proxy-9838/pods/proxy-service-kj649-cnmtb/proxy/: test (200; 2.13851ms) Aug 18 11:48:07.846: INFO: (17) /api/v1/namespaces/proxy-9838/pods/proxy-service-kj649-cnmtb:1080/proxy/: test<... (200; 2.112249ms) Aug 18 11:48:07.846: INFO: (17) /api/v1/namespaces/proxy-9838/pods/proxy-service-kj649-cnmtb:162/proxy/: bar (200; 2.237298ms) Aug 18 11:48:07.846: INFO: (17) /api/v1/namespaces/proxy-9838/pods/https:proxy-service-kj649-cnmtb:443/proxy/: ... (200; 3.239487ms) Aug 18 11:48:07.847: INFO: (17) /api/v1/namespaces/proxy-9838/pods/proxy-service-kj649-cnmtb:160/proxy/: foo (200; 3.415211ms) Aug 18 11:48:07.847: INFO: (17) /api/v1/namespaces/proxy-9838/services/https:proxy-service-kj649:tlsportname1/proxy/: tls baz (200; 3.337816ms) Aug 18 11:48:07.847: INFO: (17) /api/v1/namespaces/proxy-9838/services/proxy-service-kj649:portname2/proxy/: bar (200; 3.545372ms) Aug 18 11:48:07.847: INFO: (17) /api/v1/namespaces/proxy-9838/services/https:proxy-service-kj649:tlsportname2/proxy/: tls qux (200; 3.661215ms) Aug 18 11:48:07.848: INFO: (17) /api/v1/namespaces/proxy-9838/services/proxy-service-kj649:portname1/proxy/: foo (200; 3.850645ms) Aug 18 11:48:07.850: INFO: (18) /api/v1/namespaces/proxy-9838/pods/http:proxy-service-kj649-cnmtb:1080/proxy/: ... (200; 1.920437ms) Aug 18 11:48:07.850: INFO: (18) /api/v1/namespaces/proxy-9838/pods/proxy-service-kj649-cnmtb/proxy/: test (200; 2.167505ms) Aug 18 11:48:07.850: INFO: (18) /api/v1/namespaces/proxy-9838/pods/proxy-service-kj649-cnmtb:1080/proxy/: test<... (200; 2.020427ms) Aug 18 11:48:07.850: INFO: (18) /api/v1/namespaces/proxy-9838/pods/https:proxy-service-kj649-cnmtb:460/proxy/: tls baz (200; 2.436965ms) Aug 18 11:48:07.850: INFO: (18) /api/v1/namespaces/proxy-9838/pods/proxy-service-kj649-cnmtb:162/proxy/: bar (200; 2.442241ms) Aug 18 11:48:07.850: INFO: (18) /api/v1/namespaces/proxy-9838/pods/http:proxy-service-kj649-cnmtb:162/proxy/: bar (200; 2.446166ms) Aug 18 11:48:07.850: INFO: (18) /api/v1/namespaces/proxy-9838/pods/http:proxy-service-kj649-cnmtb:160/proxy/: foo (200; 2.608524ms) Aug 18 11:48:07.850: INFO: (18) /api/v1/namespaces/proxy-9838/pods/https:proxy-service-kj649-cnmtb:443/proxy/: ... (200; 3.067829ms) Aug 18 11:48:07.855: INFO: (19) /api/v1/namespaces/proxy-9838/pods/https:proxy-service-kj649-cnmtb:460/proxy/: tls baz (200; 2.993668ms) Aug 18 11:48:07.855: INFO: (19) /api/v1/namespaces/proxy-9838/pods/proxy-service-kj649-cnmtb:1080/proxy/: test<... (200; 3.087853ms) Aug 18 11:48:07.855: INFO: (19) /api/v1/namespaces/proxy-9838/pods/proxy-service-kj649-cnmtb/proxy/: test (200; 3.240459ms) Aug 18 11:48:07.855: INFO: (19) /api/v1/namespaces/proxy-9838/pods/proxy-service-kj649-cnmtb:160/proxy/: foo (200; 3.013158ms) Aug 18 11:48:07.855: INFO: (19) /api/v1/namespaces/proxy-9838/services/https:proxy-service-kj649:tlsportname1/proxy/: tls baz (200; 3.309657ms) Aug 18 11:48:07.855: INFO: (19) /api/v1/namespaces/proxy-9838/pods/https:proxy-service-kj649-cnmtb:443/proxy/: >> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename kubelet-test STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [k8s.io] Kubelet /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/kubelet.go:38 [BeforeEach] when scheduling a busybox command that always fails in a pod /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/kubelet.go:82 [It] should be possible to delete [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 [AfterEach] [k8s.io] Kubelet /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:48:10.073: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "kubelet-test-9530" for this suite. • ------------------------------ {"msg":"PASSED [k8s.io] Kubelet when scheduling a busybox command that always fails in a pod should be possible to delete [NodeConformance] [Conformance]","total":-1,"completed":2,"skipped":110,"failed":3,"failures":["[sig-apps] StatefulSet [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] should perform rolling updates and roll backs of template modifications [Conformance]","[k8s.io] Probing container should be restarted with a exec \"cat /tmp/health\" liveness probe [NodeConformance] [Conformance]","[k8s.io] Container Runtime blackbox test on terminated container should report termination message [LinuxOnly] from log output if TerminationMessagePolicy FallbackToLogsOnError is set [NodeConformance] [Conformance]"]} SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-cli] Kubectl client /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:48:10.174: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename kubectl STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-cli] Kubectl client /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/kubectl.go:247 [It] should support proxy with --port 0 [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: starting the proxy server Aug 18 11:48:10.193: INFO: Asynchronously running '/usr/local/bin/kubectl kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-2004 proxy -p 0 --disable-filter' STEP: curling proxy /api/ output [AfterEach] [sig-cli] Kubectl client /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:48:10.311: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "kubectl-2004" for this suite. • ------------------------------ {"msg":"PASSED [sig-cli] Kubectl client Proxy server should support proxy with --port 0 [Conformance]","total":-1,"completed":3,"skipped":164,"failed":3,"failures":["[sig-apps] StatefulSet [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] should perform rolling updates and roll backs of template modifications [Conformance]","[k8s.io] Probing container should be restarted with a exec \"cat /tmp/health\" liveness probe [NodeConformance] [Conformance]","[k8s.io] Container Runtime blackbox test on terminated container should report termination message [LinuxOnly] from log output if TerminationMessagePolicy FallbackToLogsOnError is set [NodeConformance] [Conformance]"]} SSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-storage] EmptyDir volumes /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:48:10.366: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename emptydir STEP: Waiting for a default service account to be provisioned in namespace [It] should support (non-root,0666,tmpfs) [LinuxOnly] [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating a pod to test emptydir 0666 on tmpfs Aug 18 11:48:10.399: INFO: Waiting up to 5m0s for pod "pod-9c53ed67-1cb3-412f-8b53-c4b1245d7bcd" in namespace "emptydir-8466" to be "Succeeded or Failed" Aug 18 11:48:10.401: INFO: Pod "pod-9c53ed67-1cb3-412f-8b53-c4b1245d7bcd": Phase="Pending", Reason="", readiness=false. Elapsed: 1.850872ms Aug 18 11:48:12.403: INFO: Pod "pod-9c53ed67-1cb3-412f-8b53-c4b1245d7bcd": Phase="Pending", Reason="", readiness=false. Elapsed: 2.004458095s Aug 18 11:48:14.406: INFO: Pod "pod-9c53ed67-1cb3-412f-8b53-c4b1245d7bcd": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.00746078s STEP: Saw pod success Aug 18 11:48:14.406: INFO: Pod "pod-9c53ed67-1cb3-412f-8b53-c4b1245d7bcd" satisfied condition "Succeeded or Failed" Aug 18 11:48:14.410: INFO: Trying to get logs from node node1 pod pod-9c53ed67-1cb3-412f-8b53-c4b1245d7bcd container test-container: STEP: delete the pod Aug 18 11:48:14.424: INFO: Waiting for pod pod-9c53ed67-1cb3-412f-8b53-c4b1245d7bcd to disappear Aug 18 11:48:14.426: INFO: Pod pod-9c53ed67-1cb3-412f-8b53-c4b1245d7bcd no longer exists [AfterEach] [sig-storage] EmptyDir volumes /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:48:14.426: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "emptydir-8466" for this suite. • ------------------------------ {"msg":"PASSED [sig-storage] EmptyDir volumes should support (non-root,0666,tmpfs) [LinuxOnly] [NodeConformance] [Conformance]","total":-1,"completed":4,"skipped":189,"failed":3,"failures":["[sig-apps] StatefulSet [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] should perform rolling updates and roll backs of template modifications [Conformance]","[k8s.io] Probing container should be restarted with a exec \"cat /tmp/health\" liveness probe [NodeConformance] [Conformance]","[k8s.io] Container Runtime blackbox test on terminated container should report termination message [LinuxOnly] from log output if TerminationMessagePolicy FallbackToLogsOnError is set [NodeConformance] [Conformance]"]} SSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [k8s.io] Container Runtime /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:43:31.274: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename container-runtime STEP: Waiting for a default service account to be provisioned in namespace [It] should report termination message [LinuxOnly] if TerminationMessagePath is set as non-root user and at a non-default path [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: create the container STEP: wait for the container to reach Succeeded Aug 18 11:48:31.309: FAIL: Timed out after 300.000s. Expected : Pending to equal : Succeeded Full Stack Trace k8s.io/kubernetes/test/e2e/common.glob..func25.1.2.1(0x4c650ad, 0x1d, 0xc00057fba0, 0x1e, 0xc00441f860, 0x2, 0x2, 0xc0001d7b40, 0x1, 0x1, ...) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/runtime.go:154 +0x3f1 k8s.io/kubernetes/test/e2e/common.glob..func25.1.2.3() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/runtime.go:211 +0x292 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc002593080) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc002593080) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc002593080, 0x4deb2c0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] Container Runtime /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "container-runtime-6008". STEP: Found 9 events. Aug 18 11:48:31.322: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for termination-message-container0695240e-6103-4528-845b-e45cb7a8bd7f: { } Scheduled: Successfully assigned container-runtime-6008/termination-message-container0695240e-6103-4528-845b-e45cb7a8bd7f to node1 Aug 18 11:48:31.322: INFO: At 2021-08-18 11:43:32 +0000 UTC - event for termination-message-container0695240e-6103-4528-845b-e45cb7a8bd7f: {multus } AddedInterface: Add eth0 [10.244.4.62/24] Aug 18 11:48:31.322: INFO: At 2021-08-18 11:43:32 +0000 UTC - event for termination-message-container0695240e-6103-4528-845b-e45cb7a8bd7f: {kubelet node1} Pulling: Pulling image "docker.io/library/busybox:1.29" Aug 18 11:48:31.322: INFO: At 2021-08-18 11:43:33 +0000 UTC - event for termination-message-container0695240e-6103-4528-845b-e45cb7a8bd7f: {kubelet node1} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit Aug 18 11:48:31.322: INFO: At 2021-08-18 11:43:33 +0000 UTC - event for termination-message-container0695240e-6103-4528-845b-e45cb7a8bd7f: {kubelet node1} Failed: Error: ErrImagePull Aug 18 11:48:31.322: INFO: At 2021-08-18 11:43:34 +0000 UTC - event for termination-message-container0695240e-6103-4528-845b-e45cb7a8bd7f: {kubelet node1} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Aug 18 11:48:31.322: INFO: At 2021-08-18 11:43:36 +0000 UTC - event for termination-message-container0695240e-6103-4528-845b-e45cb7a8bd7f: {multus } AddedInterface: Add eth0 [10.244.4.63/24] Aug 18 11:48:31.322: INFO: At 2021-08-18 11:43:36 +0000 UTC - event for termination-message-container0695240e-6103-4528-845b-e45cb7a8bd7f: {kubelet node1} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" Aug 18 11:48:31.322: INFO: At 2021-08-18 11:43:36 +0000 UTC - event for termination-message-container0695240e-6103-4528-845b-e45cb7a8bd7f: {kubelet node1} Failed: Error: ImagePullBackOff Aug 18 11:48:31.325: INFO: POD NODE PHASE GRACE CONDITIONS Aug 18 11:48:31.325: INFO: Aug 18 11:48:31.330: INFO: Logging node info for node master1 Aug 18 11:48:31.335: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 ebb211fa-503f-4cfe-b1ed-c95d27a70e6e 70702 0 2021-08-18 08:20:52 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"3a:82:be:72:b5:15"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:20:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:20:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:25:59 +0000 UTC,LastTransitionTime:2021-08-18 08:25:59 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:48:27 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:48:27 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:48:27 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:48:27 +0000 UTC,LastTransitionTime:2021-08-18 08:25:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:58c3e57359b641ad92fa1959f2fecf5d,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:012cd796-2076-45d6-8b14-d3e0451b1e64,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[@ :],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:48:31.336: INFO: Logging kubelet events for node master1 Aug 18 11:48:31.337: INFO: Logging pods the kubelet thinks is on node master1 Aug 18 11:48:31.346: INFO: kube-controller-manager-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:48:31.346: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:48:31.346: INFO: kube-multus-ds-amd64-kbcp6 started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:48:31.346: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:48:31.346: INFO: docker-registry-docker-registry-56cbc7bc58-49kl2 started at 2021-08-18 08:26:23 +0000 UTC (0+2 container statuses recorded) Aug 18 11:48:31.346: INFO: Container docker-registry ready: true, restart count 0 Aug 18 11:48:31.346: INFO: Container nginx ready: true, restart count 0 Aug 18 11:48:31.346: INFO: node-exporter-5hwz9 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:48:31.346: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:48:31.346: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:48:31.346: INFO: kube-apiserver-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:48:31.346: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:48:31.346: INFO: kube-proxy-vqk4v started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:48:31.346: INFO: Container kube-proxy ready: true, restart count 1 Aug 18 11:48:31.346: INFO: kube-flannel-q64cq started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:48:31.346: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:48:31.346: INFO: Container kube-flannel ready: true, restart count 3 Aug 18 11:48:31.346: INFO: coredns-7677f9bb54-kn2qg started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:48:31.346: INFO: Container coredns ready: true, restart count 2 Aug 18 11:48:31.346: INFO: kube-scheduler-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:48:31.346: INFO: Container kube-scheduler ready: true, restart count 0 W0818 11:48:31.358769 36 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:48:31.382: INFO: Latency metrics for node master1 Aug 18 11:48:31.383: INFO: Logging node info for node master2 Aug 18 11:48:31.385: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 78946293-3abe-4442-84d4-8ed6b1d15ce0 70689 0 2021-08-18 08:21:31 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"7e:f5:c2:cc:3a:b4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:21:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:21:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-08-18 08:29:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:48:25 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:48:25 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:48:25 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:48:25 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0c44122c7a7248c18d8571e1cc667258,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:0cd329f2-48e0-4c8f-b8b9-fa3ae0ed8406,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:48:31.385: INFO: Logging kubelet events for node master2 Aug 18 11:48:31.388: INFO: Logging pods the kubelet thinks is on node master2 Aug 18 11:48:31.396: INFO: node-exporter-48nfx started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:48:31.396: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:48:31.396: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:48:31.396: INFO: kube-apiserver-master2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:48:31.396: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:48:31.396: INFO: kube-scheduler-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:48:31.396: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:48:31.396: INFO: kube-multus-ds-amd64-mld8g started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:48:31.396: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:48:31.396: INFO: dns-autoscaler-5b7b5c9b6f-hh47r started at 2021-08-18 08:23:57 +0000 UTC (0+1 container statuses recorded) Aug 18 11:48:31.396: INFO: Container autoscaler ready: true, restart count 2 Aug 18 11:48:31.396: INFO: node-feature-discovery-controller-5bf5c49849-mq57c started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:48:31.396: INFO: Container nfd-controller ready: true, restart count 0 Aug 18 11:48:31.396: INFO: kube-controller-manager-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:48:31.396: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:48:31.396: INFO: kube-proxy-kh2l9 started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:48:31.396: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:48:31.396: INFO: kube-flannel-pp56h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:48:31.396: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:48:31.396: INFO: Container kube-flannel ready: true, restart count 1 W0818 11:48:31.409501 36 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:48:31.433: INFO: Latency metrics for node master2 Aug 18 11:48:31.433: INFO: Logging node info for node master3 Aug 18 11:48:31.436: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 44feac2b-9447-4be2-9fcd-62f836d67c72 70721 0 2021-08-18 08:21:41 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"86:e4:31:99:58:40"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {kubelet Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:48:31 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:48:31 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:48:31 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:48:31 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1fae19ae59884c44899bcd08aa243244,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:5db926c5-6530-4635-a0d5-806974a3b732,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:48:31.436: INFO: Logging kubelet events for node master3 Aug 18 11:48:31.438: INFO: Logging pods the kubelet thinks is on node master3 Aug 18 11:48:31.446: INFO: kube-scheduler-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:48:31.446: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:48:31.446: INFO: kube-apiserver-master3 started at 2021-08-18 08:29:12 +0000 UTC (0+1 container statuses recorded) Aug 18 11:48:31.446: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:48:31.446: INFO: kube-proxy-sd5lc started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:48:31.446: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:48:31.446: INFO: kube-flannel-x6tlr started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:48:31.446: INFO: Init container install-cni ready: true, restart count 1 Aug 18 11:48:31.446: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:48:31.446: INFO: kube-multus-ds-amd64-bkw6c started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:48:31.446: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:48:31.446: INFO: coredns-7677f9bb54-5hxfh started at 2021-08-18 08:23:54 +0000 UTC (0+1 container statuses recorded) Aug 18 11:48:31.446: INFO: Container coredns ready: true, restart count 1 Aug 18 11:48:31.446: INFO: node-exporter-vq7d8 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:48:31.446: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:48:31.446: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:48:31.446: INFO: kube-controller-manager-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:48:31.446: INFO: Container kube-controller-manager ready: true, restart count 2 W0818 11:48:31.459764 36 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:48:31.487: INFO: Latency metrics for node master3 Aug 18 11:48:31.487: INFO: Logging node info for node node1 Aug 18 11:48:31.490: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 84defabd-6ebf-43ec-a629-44c6713da9c9 70673 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"9a:87:55:36:7b:df"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:13 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:35 +0000 UTC,LastTransitionTime:2021-08-18 08:26:35 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:48:21 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:48:21 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:48:21 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:48:21 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:69946ff2b7bc462fa25eb7adb4703c23,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:736dc52f-f5e3-494e-86ca-01eedbea015c,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:a7cea43d9d2f67c38fbf0407786edbe660ee9072945f7bb272b55fd255e8eaca opnfv/barometer-collectd:stable],SizeBytes:1075746799,},ContainerImage{Names:[@ :],SizeBytes:1003788820,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[aquasec/kube-hunter@sha256:2be6820bc1d7e0f57193a9a27d5a3e16b2fd93c53747b03ce8ca48c6fc323781 aquasec/kube-hunter:0.3.1],SizeBytes:347611549,},ContainerImage{Names:[golang@sha256:db2475a1dbb2149508e5db31d7d77a75e6600d54be645f37681f03f2762169ba golang:alpine3.12],SizeBytes:301186719,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:de25c7fc6c4f3a27c7f0c2dff454e4671823a34d88abd533f210848d527e0fbb alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:48:31.491: INFO: Logging kubelet events for node node1 Aug 18 11:48:31.493: INFO: Logging pods the kubelet thinks is on node node1 Aug 18 11:48:31.693: INFO: node-feature-discovery-worker-pflgw started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:48:31.693: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:48:31.693: INFO: node-exporter-kcwvn started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:48:31.693: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:48:31.693: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:48:31.693: INFO: pod-exec-websocket-bcecdfc1-0c3c-45a9-8652-d4ffebd4fba3 started at 2021-08-18 11:45:21 +0000 UTC (0+1 container statuses recorded) Aug 18 11:48:31.693: INFO: Container main ready: false, restart count 0 Aug 18 11:48:31.693: INFO: ss-0 started at 2021-08-18 11:47:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:48:31.693: INFO: Container webserver ready: false, restart count 0 Aug 18 11:48:31.693: INFO: liveness-a8284de2-60b4-401e-9834-2a71d7c4dcb6 started at 2021-08-18 11:48:14 +0000 UTC (0+1 container statuses recorded) Aug 18 11:48:31.693: INFO: Container liveness ready: true, restart count 0 Aug 18 11:48:31.693: INFO: kube-multus-ds-amd64-rrvmb started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:48:31.693: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:48:31.693: INFO: kubernetes-metrics-scraper-678c97765c-9nsv5 started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:48:31.693: INFO: Container kubernetes-metrics-scraper ready: true, restart count 2 Aug 18 11:48:31.693: INFO: cmk-init-discover-node1-bxznx started at 2021-08-18 08:32:10 +0000 UTC (0+3 container statuses recorded) Aug 18 11:48:31.693: INFO: Container discover ready: false, restart count 0 Aug 18 11:48:31.693: INFO: Container init ready: false, restart count 0 Aug 18 11:48:31.693: INFO: Container install ready: false, restart count 0 Aug 18 11:48:31.693: INFO: cmk-d8r27 started at 2021-08-18 08:32:52 +0000 UTC (0+2 container statuses recorded) Aug 18 11:48:31.693: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:48:31.693: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:48:31.693: INFO: collectd-xdprr started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:48:31.693: INFO: Container collectd ready: true, restart count 0 Aug 18 11:48:31.693: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:48:31.693: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:48:31.693: INFO: kube-proxy-p6jvp started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:48:31.693: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:48:31.693: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-vsxvg started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:48:31.693: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:48:31.693: INFO: fail-once-local-8rxnh started at 2021-08-18 11:34:14 +0000 UTC (0+1 container statuses recorded) Aug 18 11:48:31.693: INFO: Container c ready: false, restart count 0 Aug 18 11:48:31.693: INFO: pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975 started at 2021-08-18 11:47:15 +0000 UTC (0+1 container statuses recorded) Aug 18 11:48:31.693: INFO: Container secret-env-test ready: false, restart count 0 Aug 18 11:48:31.693: INFO: var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209 started at 2021-08-18 11:47:57 +0000 UTC (0+1 container statuses recorded) Aug 18 11:48:31.693: INFO: Container dapi-container ready: false, restart count 0 Aug 18 11:48:31.693: INFO: nginx-proxy-node1 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:48:31.693: INFO: Container nginx-proxy ready: true, restart count 2 Aug 18 11:48:31.693: INFO: prometheus-k8s-0 started at 2021-08-18 08:34:03 +0000 UTC (0+5 container statuses recorded) Aug 18 11:48:31.693: INFO: Container custom-metrics-apiserver ready: true, restart count 0 Aug 18 11:48:31.693: INFO: Container grafana ready: true, restart count 0 Aug 18 11:48:31.693: INFO: Container prometheus ready: true, restart count 1 Aug 18 11:48:31.693: INFO: Container prometheus-config-reloader ready: true, restart count 0 Aug 18 11:48:31.693: INFO: Container rules-configmap-reloader ready: true, restart count 0 Aug 18 11:48:31.693: INFO: kube-flannel-q78nd started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:48:31.693: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:48:31.693: INFO: Container kube-flannel ready: true, restart count 1 W0818 11:48:31.705112 36 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:48:31.739: INFO: Latency metrics for node node1 Aug 18 11:48:31.739: INFO: Logging node info for node node2 Aug 18 11:48:31.742: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 1d01177e-3dbb-48a1-a0bc-d18af27ab7f8 70710 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:d1:47:f8:1d:22"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:36 +0000 UTC,LastTransitionTime:2021-08-18 08:26:36 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:48:28 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:48:28 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:48:28 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:48:28 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:dc1f286135c145349b8a016880b65a2f,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:037e7e2d-94e9-42f4-a719-896e5005ac70,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:48:31.742: INFO: Logging kubelet events for node node2 Aug 18 11:48:31.744: INFO: Logging pods the kubelet thinks is on node node2 Aug 18 11:48:31.756: INFO: kubernetes-dashboard-86c6f9df5b-qrtdk started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:48:31.756: INFO: Container kubernetes-dashboard ready: true, restart count 2 Aug 18 11:48:31.756: INFO: cmk-748rz started at 2021-08-18 08:32:53 +0000 UTC (0+2 container statuses recorded) Aug 18 11:48:31.756: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:48:31.756: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:48:31.756: INFO: node-feature-discovery-worker-hzpf5 started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:48:31.756: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:48:31.756: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-c82pt started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:48:31.756: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:48:31.756: INFO: prometheus-operator-5bb8cb9d8f-k97ws started at 2021-08-18 08:33:38 +0000 UTC (0+2 container statuses recorded) Aug 18 11:48:31.756: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:48:31.756: INFO: Container prometheus-operator ready: true, restart count 0 Aug 18 11:48:31.756: INFO: kube-proxy-qkj9c started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:48:31.756: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:48:31.756: INFO: collectd-67ntq started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:48:31.756: INFO: Container collectd ready: true, restart count 0 Aug 18 11:48:31.756: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:48:31.756: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:48:31.756: INFO: ss-0 started at 2021-08-18 11:46:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:48:31.756: INFO: Container webserver ready: false, restart count 0 Aug 18 11:48:31.756: INFO: server started at 2021-08-18 11:44:57 +0000 UTC (0+1 container statuses recorded) Aug 18 11:48:31.756: INFO: Container agnhost-container ready: true, restart count 0 Aug 18 11:48:31.756: INFO: kube-multus-ds-amd64-rvzsg started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:48:31.756: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:48:31.756: INFO: tester started at 2021-08-18 11:45:01 +0000 UTC (0+1 container statuses recorded) Aug 18 11:48:31.756: INFO: Container tester ready: false, restart count 0 Aug 18 11:48:31.756: INFO: cmk-webhook-6c9d5f8578-7cxjr started at 2021-08-18 08:32:53 +0000 UTC (0+1 container statuses recorded) Aug 18 11:48:31.756: INFO: Container cmk-webhook ready: true, restart count 0 Aug 18 11:48:31.756: INFO: node-exporter-lrrf2 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:48:31.756: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:48:31.756: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:48:31.756: INFO: kube-flannel-h7t5h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:48:31.756: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:48:31.756: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:48:31.756: INFO: pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70 started at 2021-08-18 11:46:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:48:31.756: INFO: Container env-test ready: false, restart count 0 Aug 18 11:48:31.756: INFO: cmk-init-discover-node2-6b2kz started at 2021-08-18 08:32:30 +0000 UTC (0+3 container statuses recorded) Aug 18 11:48:31.756: INFO: Container discover ready: false, restart count 0 Aug 18 11:48:31.756: INFO: Container init ready: false, restart count 0 Aug 18 11:48:31.756: INFO: Container install ready: false, restart count 0 Aug 18 11:48:31.756: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-7rn45 started at 2021-08-18 08:36:42 +0000 UTC (0+2 container statuses recorded) Aug 18 11:48:31.756: INFO: Container tas-controller ready: true, restart count 0 Aug 18 11:48:31.756: INFO: Container tas-extender ready: true, restart count 0 Aug 18 11:48:31.756: INFO: fail-once-local-pk5cs started at 2021-08-18 11:34:14 +0000 UTC (0+1 container statuses recorded) Aug 18 11:48:31.756: INFO: Container c ready: false, restart count 0 Aug 18 11:48:31.756: INFO: nginx-proxy-node2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:48:31.756: INFO: Container nginx-proxy ready: true, restart count 1 W0818 11:48:31.769612 36 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:48:31.801: INFO: Latency metrics for node node2 Aug 18 11:48:31.801: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "container-runtime-6008" for this suite. • Failure [300.536 seconds] [k8s.io] Container Runtime /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 blackbox test /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/runtime.go:41 on terminated container /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/runtime.go:134 should report termination message [LinuxOnly] if TerminationMessagePath is set as non-root user and at a non-default path [NodeConformance] [Conformance] [It] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:48:31.309: Timed out after 300.000s. Expected : Pending to equal : Succeeded /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/runtime.go:154 ------------------------------ {"msg":"FAILED [k8s.io] Container Runtime blackbox test on terminated container should report termination message [LinuxOnly] if TerminationMessagePath is set as non-root user and at a non-default path [NodeConformance] [Conformance]","total":-1,"completed":25,"skipped":654,"failed":4,"failures":["[sig-network] Services should be able to create a functioning NodePort service [Conformance]","[k8s.io] Pods should support retrieving logs from the container over websockets [NodeConformance] [Conformance]","[k8s.io] InitContainer [NodeConformance] should not start app containers if init containers fail on a RestartAlways pod [Conformance]","[k8s.io] Container Runtime blackbox test on terminated container should report termination message [LinuxOnly] if TerminationMessagePath is set as non-root user and at a non-default path [NodeConformance] [Conformance]"]} SSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:48:31.865: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename webhook STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:87 STEP: Setting up server cert STEP: Create role binding to let webhook read extension-apiserver-authentication STEP: Deploying the webhook pod STEP: Wait for the deployment to be ready Aug 18 11:48:32.157: INFO: deployment "sample-webhook-deployment" doesn't have the required revision set Aug 18 11:48:34.168: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764884112, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764884112, loc:(*time.Location)(0x77169a0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764884112, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764884112, loc:(*time.Location)(0x77169a0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-cbccbf6bb\" is progressing."}}, CollisionCount:(*int32)(nil)} STEP: Deploying the webhook service STEP: Verifying the service has paired with the endpoint Aug 18 11:48:37.177: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1 [It] should mutate pod and apply defaults after mutation [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Registering the mutating pod webhook via the AdmissionRegistration API STEP: create a pod that should be updated by the webhook [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:48:37.220: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "webhook-9935" for this suite. STEP: Destroying namespace "webhook-9935-markers" for this suite. [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:102 • [SLOW TEST:5.392 seconds] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23 should mutate pod and apply defaults after mutation [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should mutate pod and apply defaults after mutation [Conformance]","total":-1,"completed":26,"skipped":677,"failed":4,"failures":["[sig-network] Services should be able to create a functioning NodePort service [Conformance]","[k8s.io] Pods should support retrieving logs from the container over websockets [NodeConformance] [Conformance]","[k8s.io] InitContainer [NodeConformance] should not start app containers if init containers fail on a RestartAlways pod [Conformance]","[k8s.io] Container Runtime blackbox test on terminated container should report termination message [LinuxOnly] if TerminationMessagePath is set as non-root user and at a non-default path [NodeConformance] [Conformance]"]} SSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [k8s.io] Docker Containers /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:48:37.301: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename containers STEP: Waiting for a default service account to be provisioned in namespace [It] should be able to override the image's default arguments (docker cmd) [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating a pod to test override arguments Aug 18 11:48:37.332: INFO: Waiting up to 5m0s for pod "client-containers-c168f86e-d52d-45e1-81f7-8b62bc447656" in namespace "containers-6041" to be "Succeeded or Failed" Aug 18 11:48:37.335: INFO: Pod "client-containers-c168f86e-d52d-45e1-81f7-8b62bc447656": Phase="Pending", Reason="", readiness=false. Elapsed: 2.579164ms Aug 18 11:48:39.338: INFO: Pod "client-containers-c168f86e-d52d-45e1-81f7-8b62bc447656": Phase="Pending", Reason="", readiness=false. Elapsed: 2.005735716s Aug 18 11:48:41.342: INFO: Pod "client-containers-c168f86e-d52d-45e1-81f7-8b62bc447656": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.009448776s STEP: Saw pod success Aug 18 11:48:41.342: INFO: Pod "client-containers-c168f86e-d52d-45e1-81f7-8b62bc447656" satisfied condition "Succeeded or Failed" Aug 18 11:48:41.345: INFO: Trying to get logs from node node2 pod client-containers-c168f86e-d52d-45e1-81f7-8b62bc447656 container test-container: STEP: delete the pod Aug 18 11:48:41.360: INFO: Waiting for pod client-containers-c168f86e-d52d-45e1-81f7-8b62bc447656 to disappear Aug 18 11:48:41.363: INFO: Pod client-containers-c168f86e-d52d-45e1-81f7-8b62bc447656 no longer exists [AfterEach] [k8s.io] Docker Containers /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:48:41.363: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "containers-6041" for this suite. • ------------------------------ {"msg":"PASSED [k8s.io] Docker Containers should be able to override the image's default arguments (docker cmd) [NodeConformance] [Conformance]","total":-1,"completed":27,"skipped":702,"failed":4,"failures":["[sig-network] Services should be able to create a functioning NodePort service [Conformance]","[k8s.io] Pods should support retrieving logs from the container over websockets [NodeConformance] [Conformance]","[k8s.io] InitContainer [NodeConformance] should not start app containers if init containers fail on a RestartAlways pod [Conformance]","[k8s.io] Container Runtime blackbox test on terminated container should report termination message [LinuxOnly] if TerminationMessagePath is set as non-root user and at a non-default path [NodeConformance] [Conformance]"]} SSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [k8s.io] Probing container /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:48:14.486: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename container-probe STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [k8s.io] Probing container /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:54 [It] should be restarted with a /healthz http liveness probe [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating pod liveness-a8284de2-60b4-401e-9834-2a71d7c4dcb6 in namespace container-probe-8374 Aug 18 11:48:18.525: INFO: Started pod liveness-a8284de2-60b4-401e-9834-2a71d7c4dcb6 in namespace container-probe-8374 STEP: checking the pod's current state and verifying that restartCount is present Aug 18 11:48:18.527: INFO: Initial restart count of pod liveness-a8284de2-60b4-401e-9834-2a71d7c4dcb6 is 0 Aug 18 11:48:44.578: INFO: Restart count of pod container-probe-8374/liveness-a8284de2-60b4-401e-9834-2a71d7c4dcb6 is now 1 (26.050560118s elapsed) STEP: deleting the pod [AfterEach] [k8s.io] Probing container /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:48:44.585: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "container-probe-8374" for this suite. • [SLOW TEST:30.106 seconds] [k8s.io] Probing container /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 should be restarted with a /healthz http liveness probe [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [k8s.io] Probing container should be restarted with a /healthz http liveness probe [NodeConformance] [Conformance]","total":-1,"completed":5,"skipped":217,"failed":3,"failures":["[sig-apps] StatefulSet [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] should perform rolling updates and roll backs of template modifications [Conformance]","[k8s.io] Probing container should be restarted with a exec \"cat /tmp/health\" liveness probe [NodeConformance] [Conformance]","[k8s.io] Container Runtime blackbox test on terminated container should report termination message [LinuxOnly] from log output if TerminationMessagePolicy FallbackToLogsOnError is set [NodeConformance] [Conformance]"]} SSSSSSSS ------------------------------ [BeforeEach] [sig-apps] ReplicaSet /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:48:41.401: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename replicaset STEP: Waiting for a default service account to be provisioned in namespace [It] should serve a basic image on each replica with a public image [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:48:41.422: INFO: Creating ReplicaSet my-hostname-basic-7ea0aff8-046e-4f79-ba43-14cc8a01827d Aug 18 11:48:41.429: INFO: Pod name my-hostname-basic-7ea0aff8-046e-4f79-ba43-14cc8a01827d: Found 0 pods out of 1 Aug 18 11:48:46.432: INFO: Pod name my-hostname-basic-7ea0aff8-046e-4f79-ba43-14cc8a01827d: Found 1 pods out of 1 Aug 18 11:48:46.433: INFO: Ensuring a pod for ReplicaSet "my-hostname-basic-7ea0aff8-046e-4f79-ba43-14cc8a01827d" is running Aug 18 11:48:46.435: INFO: Pod "my-hostname-basic-7ea0aff8-046e-4f79-ba43-14cc8a01827d-swlfk" is running (conditions: [{Type:Initialized Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2021-08-18 11:48:41 +0000 UTC Reason: Message:} {Type:Ready Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2021-08-18 11:48:45 +0000 UTC Reason: Message:} {Type:ContainersReady Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2021-08-18 11:48:45 +0000 UTC Reason: Message:} {Type:PodScheduled Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2021-08-18 11:48:41 +0000 UTC Reason: Message:}]) Aug 18 11:48:46.436: INFO: Trying to dial the pod Aug 18 11:48:51.445: INFO: Controller my-hostname-basic-7ea0aff8-046e-4f79-ba43-14cc8a01827d: Got expected result from replica 1 [my-hostname-basic-7ea0aff8-046e-4f79-ba43-14cc8a01827d-swlfk]: "my-hostname-basic-7ea0aff8-046e-4f79-ba43-14cc8a01827d-swlfk", 1 of 1 required successes so far [AfterEach] [sig-apps] ReplicaSet /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:48:51.445: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "replicaset-5685" for this suite. • [SLOW TEST:10.051 seconds] [sig-apps] ReplicaSet /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/framework.go:23 should serve a basic image on each replica with a public image [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-apps] ReplicaSet should serve a basic image on each replica with a public image [Conformance]","total":-1,"completed":28,"skipped":718,"failed":4,"failures":["[sig-network] Services should be able to create a functioning NodePort service [Conformance]","[k8s.io] Pods should support retrieving logs from the container over websockets [NodeConformance] [Conformance]","[k8s.io] InitContainer [NodeConformance] should not start app containers if init containers fail on a RestartAlways pod [Conformance]","[k8s.io] Container Runtime blackbox test on terminated container should report termination message [LinuxOnly] if TerminationMessagePath is set as non-root user and at a non-default path [NodeConformance] [Conformance]"]} SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-storage] Projected downwardAPI /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:48:51.512: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename projected STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-storage] Projected downwardAPI /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/projected_downwardapi.go:42 [It] should provide container's memory limit [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating a pod to test downward API volume plugin Aug 18 11:48:51.546: INFO: Waiting up to 5m0s for pod "downwardapi-volume-b4e130bc-8b63-4ece-af0b-e056f58c7d8d" in namespace "projected-8529" to be "Succeeded or Failed" Aug 18 11:48:51.549: INFO: Pod "downwardapi-volume-b4e130bc-8b63-4ece-af0b-e056f58c7d8d": Phase="Pending", Reason="", readiness=false. Elapsed: 2.74257ms Aug 18 11:48:53.552: INFO: Pod "downwardapi-volume-b4e130bc-8b63-4ece-af0b-e056f58c7d8d": Phase="Pending", Reason="", readiness=false. Elapsed: 2.006091717s Aug 18 11:48:55.559: INFO: Pod "downwardapi-volume-b4e130bc-8b63-4ece-af0b-e056f58c7d8d": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.01270491s STEP: Saw pod success Aug 18 11:48:55.559: INFO: Pod "downwardapi-volume-b4e130bc-8b63-4ece-af0b-e056f58c7d8d" satisfied condition "Succeeded or Failed" Aug 18 11:48:55.561: INFO: Trying to get logs from node node2 pod downwardapi-volume-b4e130bc-8b63-4ece-af0b-e056f58c7d8d container client-container: STEP: delete the pod Aug 18 11:48:55.574: INFO: Waiting for pod downwardapi-volume-b4e130bc-8b63-4ece-af0b-e056f58c7d8d to disappear Aug 18 11:48:55.576: INFO: Pod downwardapi-volume-b4e130bc-8b63-4ece-af0b-e056f58c7d8d no longer exists [AfterEach] [sig-storage] Projected downwardAPI /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:48:55.576: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "projected-8529" for this suite. • ------------------------------ {"msg":"PASSED [sig-storage] Projected downwardAPI should provide container's memory limit [NodeConformance] [Conformance]","total":-1,"completed":29,"skipped":752,"failed":4,"failures":["[sig-network] Services should be able to create a functioning NodePort service [Conformance]","[k8s.io] Pods should support retrieving logs from the container over websockets [NodeConformance] [Conformance]","[k8s.io] InitContainer [NodeConformance] should not start app containers if init containers fail on a RestartAlways pod [Conformance]","[k8s.io] Container Runtime blackbox test on terminated container should report termination message [LinuxOnly] if TerminationMessagePath is set as non-root user and at a non-default path [NodeConformance] [Conformance]"]} SS ------------------------------ [BeforeEach] [sig-network] Networking /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:48:44.609: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename pod-network-test STEP: Waiting for a default service account to be provisioned in namespace [It] should function for node-pod communication: http [LinuxOnly] [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Performing setup for networking test in namespace pod-network-test-1127 STEP: creating a selector STEP: Creating the service pods in kubernetes Aug 18 11:48:44.630: INFO: Waiting up to 10m0s for all (but 0) nodes to be schedulable Aug 18 11:48:44.664: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Aug 18 11:48:46.667: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Aug 18 11:48:48.668: INFO: The status of Pod netserver-0 is Running (Ready = false) Aug 18 11:48:50.668: INFO: The status of Pod netserver-0 is Running (Ready = false) Aug 18 11:48:52.668: INFO: The status of Pod netserver-0 is Running (Ready = false) Aug 18 11:48:54.667: INFO: The status of Pod netserver-0 is Running (Ready = false) Aug 18 11:48:56.667: INFO: The status of Pod netserver-0 is Running (Ready = false) Aug 18 11:48:58.667: INFO: The status of Pod netserver-0 is Running (Ready = false) Aug 18 11:49:00.670: INFO: The status of Pod netserver-0 is Running (Ready = false) Aug 18 11:49:02.667: INFO: The status of Pod netserver-0 is Running (Ready = false) Aug 18 11:49:04.668: INFO: The status of Pod netserver-0 is Running (Ready = false) Aug 18 11:49:06.667: INFO: The status of Pod netserver-0 is Running (Ready = true) Aug 18 11:49:06.672: INFO: The status of Pod netserver-1 is Running (Ready = true) STEP: Creating test pods Aug 18 11:49:10.711: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s --max-time 15 --connect-timeout 1 http://10.244.4.86:8080/hostName | grep -v '^\s*$'] Namespace:pod-network-test-1127 PodName:host-test-container-pod ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:false} Aug 18 11:49:10.711: INFO: >>> kubeConfig: /root/.kube/config Aug 18 11:49:10.818: INFO: Found all expected endpoints: [netserver-0] Aug 18 11:49:10.821: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s --max-time 15 --connect-timeout 1 http://10.244.3.75:8080/hostName | grep -v '^\s*$'] Namespace:pod-network-test-1127 PodName:host-test-container-pod ContainerName:agnhost-container Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:false} Aug 18 11:49:10.821: INFO: >>> kubeConfig: /root/.kube/config Aug 18 11:49:10.923: INFO: Found all expected endpoints: [netserver-1] [AfterEach] [sig-network] Networking /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:49:10.923: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "pod-network-test-1127" for this suite. • [SLOW TEST:26.326 seconds] [sig-network] Networking /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/networking.go:26 Granular Checks: Pods /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/networking.go:29 should function for node-pod communication: http [LinuxOnly] [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-network] Networking Granular Checks: Pods should function for node-pod communication: http [LinuxOnly] [NodeConformance] [Conformance]","total":-1,"completed":6,"skipped":225,"failed":3,"failures":["[sig-apps] StatefulSet [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] should perform rolling updates and roll backs of template modifications [Conformance]","[k8s.io] Probing container should be restarted with a exec \"cat /tmp/health\" liveness probe [NodeConformance] [Conformance]","[k8s.io] Container Runtime blackbox test on terminated container should report termination message [LinuxOnly] from log output if TerminationMessagePolicy FallbackToLogsOnError is set [NodeConformance] [Conformance]"]} SSSSSS ------------------------------ [BeforeEach] [sig-apps] Job /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:34:14.304: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename job STEP: Waiting for a default service account to be provisioned in namespace [It] should run a job to completion when tasks sometimes fail and are locally restarted [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating a job STEP: Ensuring job reaches completions Aug 18 11:49:14.334: FAIL: failed to ensure job completion in namespace: job-5303 Unexpected error: <*errors.errorString | 0xc0002f61f0>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/apps.glob..func6.3() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/job.go:113 +0x33f k8s.io/kubernetes/test/e2e.RunE2ETests(0xc0027eb380) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc0027eb380) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc0027eb380, 0x4deb2c0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [sig-apps] Job /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "job-5303". STEP: Found 18 events. Aug 18 11:49:14.338: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for fail-once-local-8rxnh: { } Scheduled: Successfully assigned job-5303/fail-once-local-8rxnh to node1 Aug 18 11:49:14.338: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for fail-once-local-pk5cs: { } Scheduled: Successfully assigned job-5303/fail-once-local-pk5cs to node2 Aug 18 11:49:14.338: INFO: At 2021-08-18 11:34:14 +0000 UTC - event for fail-once-local: {job-controller } SuccessfulCreate: Created pod: fail-once-local-pk5cs Aug 18 11:49:14.338: INFO: At 2021-08-18 11:34:14 +0000 UTC - event for fail-once-local: {job-controller } SuccessfulCreate: Created pod: fail-once-local-8rxnh Aug 18 11:49:14.338: INFO: At 2021-08-18 11:34:15 +0000 UTC - event for fail-once-local-8rxnh: {multus } AddedInterface: Add eth0 [10.244.4.24/24] Aug 18 11:49:14.338: INFO: At 2021-08-18 11:34:15 +0000 UTC - event for fail-once-local-pk5cs: {kubelet node2} Pulling: Pulling image "docker.io/library/busybox:1.29" Aug 18 11:49:14.338: INFO: At 2021-08-18 11:34:15 +0000 UTC - event for fail-once-local-pk5cs: {multus } AddedInterface: Add eth0 [10.244.3.20/24] Aug 18 11:49:14.338: INFO: At 2021-08-18 11:34:16 +0000 UTC - event for fail-once-local-8rxnh: {kubelet node1} Pulling: Pulling image "docker.io/library/busybox:1.29" Aug 18 11:49:14.338: INFO: At 2021-08-18 11:34:16 +0000 UTC - event for fail-once-local-pk5cs: {kubelet node2} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit Aug 18 11:49:14.338: INFO: At 2021-08-18 11:34:16 +0000 UTC - event for fail-once-local-pk5cs: {kubelet node2} Failed: Error: ErrImagePull Aug 18 11:49:14.338: INFO: At 2021-08-18 11:34:17 +0000 UTC - event for fail-once-local-8rxnh: {kubelet node1} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit Aug 18 11:49:14.338: INFO: At 2021-08-18 11:34:17 +0000 UTC - event for fail-once-local-8rxnh: {kubelet node1} Failed: Error: ImagePullBackOff Aug 18 11:49:14.338: INFO: At 2021-08-18 11:34:17 +0000 UTC - event for fail-once-local-8rxnh: {kubelet node1} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" Aug 18 11:49:14.338: INFO: At 2021-08-18 11:34:17 +0000 UTC - event for fail-once-local-8rxnh: {kubelet node1} Failed: Error: ErrImagePull Aug 18 11:49:14.338: INFO: At 2021-08-18 11:34:17 +0000 UTC - event for fail-once-local-pk5cs: {kubelet node2} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Aug 18 11:49:14.338: INFO: At 2021-08-18 11:34:19 +0000 UTC - event for fail-once-local-pk5cs: {multus } AddedInterface: Add eth0 [10.244.3.21/24] Aug 18 11:49:14.338: INFO: At 2021-08-18 11:34:19 +0000 UTC - event for fail-once-local-pk5cs: {kubelet node2} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" Aug 18 11:49:14.338: INFO: At 2021-08-18 11:34:19 +0000 UTC - event for fail-once-local-pk5cs: {kubelet node2} Failed: Error: ImagePullBackOff Aug 18 11:49:14.340: INFO: POD NODE PHASE GRACE CONDITIONS Aug 18 11:49:14.340: INFO: fail-once-local-8rxnh node1 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:34:14 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:34:14 +0000 UTC ContainersNotReady containers with unready status: [c]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:34:14 +0000 UTC ContainersNotReady containers with unready status: [c]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:34:14 +0000 UTC }] Aug 18 11:49:14.340: INFO: fail-once-local-pk5cs node2 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:34:14 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:34:14 +0000 UTC ContainersNotReady containers with unready status: [c]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:34:14 +0000 UTC ContainersNotReady containers with unready status: [c]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:34:14 +0000 UTC }] Aug 18 11:49:14.340: INFO: Aug 18 11:49:14.344: INFO: Logging node info for node master1 Aug 18 11:49:14.346: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 ebb211fa-503f-4cfe-b1ed-c95d27a70e6e 71147 0 2021-08-18 08:20:52 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"3a:82:be:72:b5:15"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:20:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:20:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:25:59 +0000 UTC,LastTransitionTime:2021-08-18 08:25:59 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:49:07 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:49:07 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:49:07 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:49:07 +0000 UTC,LastTransitionTime:2021-08-18 08:25:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:58c3e57359b641ad92fa1959f2fecf5d,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:012cd796-2076-45d6-8b14-d3e0451b1e64,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[@ :],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:49:14.347: INFO: Logging kubelet events for node master1 Aug 18 11:49:14.349: INFO: Logging pods the kubelet thinks is on node master1 Aug 18 11:49:14.357: INFO: kube-apiserver-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:49:14.357: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:49:14.357: INFO: kube-proxy-vqk4v started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:49:14.357: INFO: Container kube-proxy ready: true, restart count 1 Aug 18 11:49:14.357: INFO: kube-flannel-q64cq started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:49:14.358: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:49:14.358: INFO: Container kube-flannel ready: true, restart count 3 Aug 18 11:49:14.358: INFO: coredns-7677f9bb54-kn2qg started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:49:14.358: INFO: Container coredns ready: true, restart count 2 Aug 18 11:49:14.358: INFO: kube-scheduler-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:49:14.358: INFO: Container kube-scheduler ready: true, restart count 0 Aug 18 11:49:14.358: INFO: kube-controller-manager-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:49:14.358: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:49:14.358: INFO: kube-multus-ds-amd64-kbcp6 started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:49:14.358: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:49:14.358: INFO: docker-registry-docker-registry-56cbc7bc58-49kl2 started at 2021-08-18 08:26:23 +0000 UTC (0+2 container statuses recorded) Aug 18 11:49:14.358: INFO: Container docker-registry ready: true, restart count 0 Aug 18 11:49:14.358: INFO: Container nginx ready: true, restart count 0 Aug 18 11:49:14.358: INFO: node-exporter-5hwz9 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:49:14.358: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:49:14.358: INFO: Container node-exporter ready: true, restart count 0 W0818 11:49:14.370473 38 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:49:14.399: INFO: Latency metrics for node master1 Aug 18 11:49:14.400: INFO: Logging node info for node master2 Aug 18 11:49:14.402: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 78946293-3abe-4442-84d4-8ed6b1d15ce0 71130 0 2021-08-18 08:21:31 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"7e:f5:c2:cc:3a:b4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:21:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:21:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-08-18 08:29:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:49:06 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:49:06 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:49:06 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:49:06 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0c44122c7a7248c18d8571e1cc667258,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:0cd329f2-48e0-4c8f-b8b9-fa3ae0ed8406,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:49:14.402: INFO: Logging kubelet events for node master2 Aug 18 11:49:14.404: INFO: Logging pods the kubelet thinks is on node master2 Aug 18 11:49:14.413: INFO: kube-apiserver-master2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:49:14.413: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:49:14.413: INFO: kube-scheduler-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:49:14.413: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:49:14.413: INFO: kube-multus-ds-amd64-mld8g started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:49:14.413: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:49:14.413: INFO: dns-autoscaler-5b7b5c9b6f-hh47r started at 2021-08-18 08:23:57 +0000 UTC (0+1 container statuses recorded) Aug 18 11:49:14.413: INFO: Container autoscaler ready: true, restart count 2 Aug 18 11:49:14.413: INFO: node-feature-discovery-controller-5bf5c49849-mq57c started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:49:14.413: INFO: Container nfd-controller ready: true, restart count 0 Aug 18 11:49:14.413: INFO: node-exporter-48nfx started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:49:14.413: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:49:14.413: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:49:14.413: INFO: kube-controller-manager-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:49:14.413: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:49:14.413: INFO: kube-proxy-kh2l9 started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:49:14.413: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:49:14.413: INFO: kube-flannel-pp56h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:49:14.413: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:49:14.413: INFO: Container kube-flannel ready: true, restart count 1 W0818 11:49:14.425643 38 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:49:14.455: INFO: Latency metrics for node master2 Aug 18 11:49:14.455: INFO: Logging node info for node master3 Aug 18 11:49:14.457: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 44feac2b-9447-4be2-9fcd-62f836d67c72 71181 0 2021-08-18 08:21:41 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"86:e4:31:99:58:40"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {kubelet Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:49:11 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:49:11 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:49:11 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:49:11 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1fae19ae59884c44899bcd08aa243244,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:5db926c5-6530-4635-a0d5-806974a3b732,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:49:14.458: INFO: Logging kubelet events for node master3 Aug 18 11:49:14.460: INFO: Logging pods the kubelet thinks is on node master3 Aug 18 11:49:14.467: INFO: kube-apiserver-master3 started at 2021-08-18 08:29:12 +0000 UTC (0+1 container statuses recorded) Aug 18 11:49:14.467: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:49:14.467: INFO: kube-proxy-sd5lc started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:49:14.467: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:49:14.467: INFO: kube-flannel-x6tlr started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:49:14.467: INFO: Init container install-cni ready: true, restart count 1 Aug 18 11:49:14.467: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:49:14.467: INFO: kube-multus-ds-amd64-bkw6c started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:49:14.467: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:49:14.467: INFO: coredns-7677f9bb54-5hxfh started at 2021-08-18 08:23:54 +0000 UTC (0+1 container statuses recorded) Aug 18 11:49:14.467: INFO: Container coredns ready: true, restart count 1 Aug 18 11:49:14.467: INFO: node-exporter-vq7d8 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:49:14.467: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:49:14.467: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:49:14.467: INFO: kube-controller-manager-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:49:14.467: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:49:14.467: INFO: kube-scheduler-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:49:14.467: INFO: Container kube-scheduler ready: true, restart count 2 W0818 11:49:14.479030 38 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:49:14.507: INFO: Latency metrics for node master3 Aug 18 11:49:14.507: INFO: Logging node info for node node1 Aug 18 11:49:14.509: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 84defabd-6ebf-43ec-a629-44c6713da9c9 71196 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"9a:87:55:36:7b:df"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:13 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:35 +0000 UTC,LastTransitionTime:2021-08-18 08:26:35 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:49:13 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:49:13 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:49:13 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:49:13 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:69946ff2b7bc462fa25eb7adb4703c23,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:736dc52f-f5e3-494e-86ca-01eedbea015c,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:a7cea43d9d2f67c38fbf0407786edbe660ee9072945f7bb272b55fd255e8eaca opnfv/barometer-collectd:stable],SizeBytes:1075746799,},ContainerImage{Names:[@ :],SizeBytes:1003788820,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[aquasec/kube-hunter@sha256:2be6820bc1d7e0f57193a9a27d5a3e16b2fd93c53747b03ce8ca48c6fc323781 aquasec/kube-hunter:0.3.1],SizeBytes:347611549,},ContainerImage{Names:[golang@sha256:db2475a1dbb2149508e5db31d7d77a75e6600d54be645f37681f03f2762169ba golang:alpine3.12],SizeBytes:301186719,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:de25c7fc6c4f3a27c7f0c2dff454e4671823a34d88abd533f210848d527e0fbb alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:49:14.510: INFO: Logging kubelet events for node node1 Aug 18 11:49:14.512: INFO: Logging pods the kubelet thinks is on node node1 Aug 18 11:49:14.528: INFO: kube-flannel-q78nd started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:49:14.528: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:49:14.528: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:49:14.528: INFO: prometheus-k8s-0 started at 2021-08-18 08:34:03 +0000 UTC (0+5 container statuses recorded) Aug 18 11:49:14.528: INFO: Container custom-metrics-apiserver ready: true, restart count 0 Aug 18 11:49:14.528: INFO: Container grafana ready: true, restart count 0 Aug 18 11:49:14.528: INFO: Container prometheus ready: true, restart count 1 Aug 18 11:49:14.528: INFO: Container prometheus-config-reloader ready: true, restart count 0 Aug 18 11:49:14.528: INFO: Container rules-configmap-reloader ready: true, restart count 0 Aug 18 11:49:14.528: INFO: pod-exec-websocket-bcecdfc1-0c3c-45a9-8652-d4ffebd4fba3 started at 2021-08-18 11:45:21 +0000 UTC (0+1 container statuses recorded) Aug 18 11:49:14.528: INFO: Container main ready: false, restart count 0 Aug 18 11:49:14.528: INFO: ss-0 started at 2021-08-18 11:47:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:49:14.528: INFO: Container webserver ready: false, restart count 0 Aug 18 11:49:14.528: INFO: kube-multus-ds-amd64-rrvmb started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:49:14.528: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:49:14.528: INFO: node-feature-discovery-worker-pflgw started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:49:14.528: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:49:14.528: INFO: node-exporter-kcwvn started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:49:14.528: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:49:14.528: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:49:14.528: INFO: cmk-d8r27 started at 2021-08-18 08:32:52 +0000 UTC (0+2 container statuses recorded) Aug 18 11:49:14.528: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:49:14.528: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:49:14.528: INFO: collectd-xdprr started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:49:14.528: INFO: Container collectd ready: true, restart count 0 Aug 18 11:49:14.528: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:49:14.528: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:49:14.528: INFO: netserver-0 started at 2021-08-18 11:48:44 +0000 UTC (0+1 container statuses recorded) Aug 18 11:49:14.528: INFO: Container webserver ready: true, restart count 0 Aug 18 11:49:14.528: INFO: test-container-pod started at 2021-08-18 11:49:06 +0000 UTC (0+1 container statuses recorded) Aug 18 11:49:14.528: INFO: Container webserver ready: true, restart count 0 Aug 18 11:49:14.528: INFO: kube-proxy-p6jvp started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:49:14.528: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:49:14.528: INFO: kubernetes-metrics-scraper-678c97765c-9nsv5 started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:49:14.528: INFO: Container kubernetes-metrics-scraper ready: true, restart count 2 Aug 18 11:49:14.528: INFO: cmk-init-discover-node1-bxznx started at 2021-08-18 08:32:10 +0000 UTC (0+3 container statuses recorded) Aug 18 11:49:14.528: INFO: Container discover ready: false, restart count 0 Aug 18 11:49:14.528: INFO: Container init ready: false, restart count 0 Aug 18 11:49:14.528: INFO: Container install ready: false, restart count 0 Aug 18 11:49:14.528: INFO: pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975 started at 2021-08-18 11:47:15 +0000 UTC (0+1 container statuses recorded) Aug 18 11:49:14.528: INFO: Container secret-env-test ready: false, restart count 0 Aug 18 11:49:14.528: INFO: var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209 started at 2021-08-18 11:47:57 +0000 UTC (0+1 container statuses recorded) Aug 18 11:49:14.528: INFO: Container dapi-container ready: false, restart count 0 Aug 18 11:49:14.528: INFO: nginx-proxy-node1 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:49:14.528: INFO: Container nginx-proxy ready: true, restart count 2 Aug 18 11:49:14.528: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-vsxvg started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:49:14.528: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:49:14.528: INFO: fail-once-local-8rxnh started at 2021-08-18 11:34:14 +0000 UTC (0+1 container statuses recorded) Aug 18 11:49:14.528: INFO: Container c ready: false, restart count 0 W0818 11:49:14.540685 38 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:49:14.569: INFO: Latency metrics for node node1 Aug 18 11:49:14.569: INFO: Logging node info for node node2 Aug 18 11:49:14.572: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 1d01177e-3dbb-48a1-a0bc-d18af27ab7f8 71166 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:d1:47:f8:1d:22"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:36 +0000 UTC,LastTransitionTime:2021-08-18 08:26:36 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:49:09 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:49:09 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:49:09 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:49:09 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:dc1f286135c145349b8a016880b65a2f,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:037e7e2d-94e9-42f4-a719-896e5005ac70,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:49:14.573: INFO: Logging kubelet events for node node2 Aug 18 11:49:14.575: INFO: Logging pods the kubelet thinks is on node node2 Aug 18 11:49:14.588: INFO: fail-once-local-pk5cs started at 2021-08-18 11:34:14 +0000 UTC (0+1 container statuses recorded) Aug 18 11:49:14.588: INFO: Container c ready: false, restart count 0 Aug 18 11:49:14.588: INFO: nginx-proxy-node2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:49:14.588: INFO: Container nginx-proxy ready: true, restart count 1 Aug 18 11:49:14.588: INFO: cmk-init-discover-node2-6b2kz started at 2021-08-18 08:32:30 +0000 UTC (0+3 container statuses recorded) Aug 18 11:49:14.588: INFO: Container discover ready: false, restart count 0 Aug 18 11:49:14.588: INFO: Container init ready: false, restart count 0 Aug 18 11:49:14.588: INFO: Container install ready: false, restart count 0 Aug 18 11:49:14.588: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-7rn45 started at 2021-08-18 08:36:42 +0000 UTC (0+2 container statuses recorded) Aug 18 11:49:14.588: INFO: Container tas-controller ready: true, restart count 0 Aug 18 11:49:14.588: INFO: Container tas-extender ready: true, restart count 0 Aug 18 11:49:14.588: INFO: kubernetes-dashboard-86c6f9df5b-qrtdk started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:49:14.588: INFO: Container kubernetes-dashboard ready: true, restart count 2 Aug 18 11:49:14.588: INFO: host-test-container-pod started at 2021-08-18 11:49:06 +0000 UTC (0+1 container statuses recorded) Aug 18 11:49:14.588: INFO: Container agnhost-container ready: true, restart count 0 Aug 18 11:49:14.588: INFO: cmk-748rz started at 2021-08-18 08:32:53 +0000 UTC (0+2 container statuses recorded) Aug 18 11:49:14.588: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:49:14.588: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:49:14.588: INFO: prometheus-operator-5bb8cb9d8f-k97ws started at 2021-08-18 08:33:38 +0000 UTC (0+2 container statuses recorded) Aug 18 11:49:14.588: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:49:14.588: INFO: Container prometheus-operator ready: true, restart count 0 Aug 18 11:49:14.588: INFO: kube-proxy-qkj9c started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:49:14.588: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:49:14.588: INFO: node-feature-discovery-worker-hzpf5 started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:49:14.588: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:49:14.588: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-c82pt started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:49:14.588: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:49:14.588: INFO: server started at 2021-08-18 11:44:57 +0000 UTC (0+1 container statuses recorded) Aug 18 11:49:14.588: INFO: Container agnhost-container ready: true, restart count 0 Aug 18 11:49:14.588: INFO: bin-falsea5f6898f-c6c3-4680-9cbd-f4985908f73e started at 2021-08-18 11:49:10 +0000 UTC (0+1 container statuses recorded) Aug 18 11:49:14.588: INFO: Container bin-falsea5f6898f-c6c3-4680-9cbd-f4985908f73e ready: false, restart count 0 Aug 18 11:49:14.588: INFO: kube-multus-ds-amd64-rvzsg started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:49:14.588: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:49:14.588: INFO: collectd-67ntq started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:49:14.588: INFO: Container collectd ready: true, restart count 0 Aug 18 11:49:14.588: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:49:14.588: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:49:14.588: INFO: ss-0 started at 2021-08-18 11:46:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:49:14.588: INFO: Container webserver ready: false, restart count 0 Aug 18 11:49:14.588: INFO: cmk-webhook-6c9d5f8578-7cxjr started at 2021-08-18 08:32:53 +0000 UTC (0+1 container statuses recorded) Aug 18 11:49:14.588: INFO: Container cmk-webhook ready: true, restart count 0 Aug 18 11:49:14.588: INFO: netserver-1 started at 2021-08-18 11:48:44 +0000 UTC (0+1 container statuses recorded) Aug 18 11:49:14.588: INFO: Container webserver ready: true, restart count 0 Aug 18 11:49:14.588: INFO: tester started at 2021-08-18 11:45:01 +0000 UTC (0+1 container statuses recorded) Aug 18 11:49:14.588: INFO: Container tester ready: false, restart count 0 Aug 18 11:49:14.588: INFO: kube-flannel-h7t5h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:49:14.588: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:49:14.588: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:49:14.588: INFO: node-exporter-lrrf2 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:49:14.588: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:49:14.588: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:49:14.588: INFO: pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70 started at 2021-08-18 11:46:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:49:14.588: INFO: Container env-test ready: false, restart count 0 W0818 11:49:14.599979 38 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:49:14.635: INFO: Latency metrics for node node2 Aug 18 11:49:14.635: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "job-5303" for this suite. • Failure [900.339 seconds] [sig-apps] Job /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/framework.go:23 should run a job to completion when tasks sometimes fail and are locally restarted [Conformance] [It] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:49:14.334: failed to ensure job completion in namespace: job-5303 Unexpected error: <*errors.errorString | 0xc0002f61f0>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/job.go:113 ------------------------------ {"msg":"FAILED [sig-apps] Job should run a job to completion when tasks sometimes fail and are locally restarted [Conformance]","total":-1,"completed":24,"skipped":591,"failed":2,"failures":["[k8s.io] Pods should be submitted and removed [NodeConformance] [Conformance]","[sig-apps] Job should run a job to completion when tasks sometimes fail and are locally restarted [Conformance]"]} SSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:48:55.590: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename crd-publish-openapi STEP: Waiting for a default service account to be provisioned in namespace [It] removes definition from spec when one version gets changed to not be served [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: set up a multi version CRD Aug 18 11:48:55.611: INFO: >>> kubeConfig: /root/.kube/config STEP: mark a version not serverd STEP: check the unserved version gets removed STEP: check the other version is not changed [AfterEach] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:49:16.244: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "crd-publish-openapi-65" for this suite. • [SLOW TEST:20.661 seconds] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23 removes definition from spec when one version gets changed to not be served [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] removes definition from spec when one version gets changed to not be served [Conformance]","total":-1,"completed":30,"skipped":754,"failed":4,"failures":["[sig-network] Services should be able to create a functioning NodePort service [Conformance]","[k8s.io] Pods should support retrieving logs from the container over websockets [NodeConformance] [Conformance]","[k8s.io] InitContainer [NodeConformance] should not start app containers if init containers fail on a RestartAlways pod [Conformance]","[k8s.io] Container Runtime blackbox test on terminated container should report termination message [LinuxOnly] if TerminationMessagePath is set as non-root user and at a non-default path [NodeConformance] [Conformance]"]} SSSS ------------------------------ [BeforeEach] [sig-storage] ConfigMap /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:49:14.683: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename configmap STEP: Waiting for a default service account to be provisioned in namespace [It] should be consumable in multiple volumes in the same pod [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating configMap with name configmap-test-volume-5b37f625-44f7-40e1-b8c7-02f26327fcb0 STEP: Creating a pod to test consume configMaps Aug 18 11:49:14.724: INFO: Waiting up to 5m0s for pod "pod-configmaps-b4a6b3fc-c2c8-429c-a4f3-e0643266d7cc" in namespace "configmap-8983" to be "Succeeded or Failed" Aug 18 11:49:14.728: INFO: Pod "pod-configmaps-b4a6b3fc-c2c8-429c-a4f3-e0643266d7cc": Phase="Pending", Reason="", readiness=false. Elapsed: 3.827525ms Aug 18 11:49:16.731: INFO: Pod "pod-configmaps-b4a6b3fc-c2c8-429c-a4f3-e0643266d7cc": Phase="Pending", Reason="", readiness=false. Elapsed: 2.007134128s Aug 18 11:49:18.737: INFO: Pod "pod-configmaps-b4a6b3fc-c2c8-429c-a4f3-e0643266d7cc": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.012619128s STEP: Saw pod success Aug 18 11:49:18.737: INFO: Pod "pod-configmaps-b4a6b3fc-c2c8-429c-a4f3-e0643266d7cc" satisfied condition "Succeeded or Failed" Aug 18 11:49:18.740: INFO: Trying to get logs from node node1 pod pod-configmaps-b4a6b3fc-c2c8-429c-a4f3-e0643266d7cc container configmap-volume-test: STEP: delete the pod Aug 18 11:49:18.754: INFO: Waiting for pod pod-configmaps-b4a6b3fc-c2c8-429c-a4f3-e0643266d7cc to disappear Aug 18 11:49:18.756: INFO: Pod pod-configmaps-b4a6b3fc-c2c8-429c-a4f3-e0643266d7cc no longer exists [AfterEach] [sig-storage] ConfigMap /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:49:18.756: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "configmap-8983" for this suite. • ------------------------------ {"msg":"PASSED [sig-storage] ConfigMap should be consumable in multiple volumes in the same pod [NodeConformance] [Conformance]","total":-1,"completed":25,"skipped":614,"failed":2,"failures":["[k8s.io] Pods should be submitted and removed [NodeConformance] [Conformance]","[sig-apps] Job should run a job to completion when tasks sometimes fail and are locally restarted [Conformance]"]} SSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-storage] Secrets /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:49:16.261: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename secrets STEP: Waiting for a default service account to be provisioned in namespace [It] optional updates should be reflected in volume [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating secret with name s-test-opt-del-6173c064-ddc2-4785-abb8-078da579cc21 STEP: Creating secret with name s-test-opt-upd-922b6166-7300-4015-b90e-d90a83893cc9 STEP: Creating the pod STEP: Deleting secret s-test-opt-del-6173c064-ddc2-4785-abb8-078da579cc21 STEP: Updating secret s-test-opt-upd-922b6166-7300-4015-b90e-d90a83893cc9 STEP: Creating secret with name s-test-opt-create-409d7258-689c-488d-bd4d-5549abc5c87c STEP: waiting to observe update in volume [AfterEach] [sig-storage] Secrets /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:49:24.370: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "secrets-3515" for this suite. • [SLOW TEST:8.117 seconds] [sig-storage] Secrets /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/secrets_volume.go:36 optional updates should be reflected in volume [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-storage] Secrets optional updates should be reflected in volume [NodeConformance] [Conformance]","total":-1,"completed":31,"skipped":758,"failed":4,"failures":["[sig-network] Services should be able to create a functioning NodePort service [Conformance]","[k8s.io] Pods should support retrieving logs from the container over websockets [NodeConformance] [Conformance]","[k8s.io] InitContainer [NodeConformance] should not start app containers if init containers fail on a RestartAlways pod [Conformance]","[k8s.io] Container Runtime blackbox test on terminated container should report termination message [LinuxOnly] if TerminationMessagePath is set as non-root user and at a non-default path [NodeConformance] [Conformance]"]} SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-auth] ServiceAccounts /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:49:24.438: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename svcaccounts STEP: Waiting for a default service account to be provisioned in namespace [It] should run through the lifecycle of a ServiceAccount [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: creating a ServiceAccount STEP: watching for the ServiceAccount to be added STEP: patching the ServiceAccount STEP: finding ServiceAccount in list of all ServiceAccounts (by LabelSelector) STEP: deleting the ServiceAccount [AfterEach] [sig-auth] ServiceAccounts /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:49:24.496: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "svcaccounts-9957" for this suite. • ------------------------------ {"msg":"PASSED [sig-auth] ServiceAccounts should run through the lifecycle of a ServiceAccount [Conformance]","total":-1,"completed":32,"skipped":791,"failed":4,"failures":["[sig-network] Services should be able to create a functioning NodePort service [Conformance]","[k8s.io] Pods should support retrieving logs from the container over websockets [NodeConformance] [Conformance]","[k8s.io] InitContainer [NodeConformance] should not start app containers if init containers fail on a RestartAlways pod [Conformance]","[k8s.io] Container Runtime blackbox test on terminated container should report termination message [LinuxOnly] if TerminationMessagePath is set as non-root user and at a non-default path [NodeConformance] [Conformance]"]} SSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-apps] Deployment /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:49:24.551: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename deployment STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-apps] Deployment /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/deployment.go:78 [It] RecreateDeployment should delete old pods and create new ones [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:49:24.570: INFO: Creating deployment "test-recreate-deployment" Aug 18 11:49:24.576: INFO: Waiting deployment "test-recreate-deployment" to be updated to revision 1 Aug 18 11:49:24.580: INFO: deployment "test-recreate-deployment" doesn't have the required revision set Aug 18 11:49:26.586: INFO: Waiting deployment "test-recreate-deployment" to complete Aug 18 11:49:26.589: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764884164, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764884164, loc:(*time.Location)(0x77169a0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764884164, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764884164, loc:(*time.Location)(0x77169a0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-c96cf48f\" is progressing."}}, CollisionCount:(*int32)(nil)} Aug 18 11:49:28.592: INFO: Triggering a new rollout for deployment "test-recreate-deployment" Aug 18 11:49:28.599: INFO: Updating deployment test-recreate-deployment Aug 18 11:49:28.599: INFO: Watching deployment "test-recreate-deployment" to verify that new pods will not run with olds pods [AfterEach] [sig-apps] Deployment /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/deployment.go:72 Aug 18 11:49:28.636: INFO: Deployment "test-recreate-deployment": &Deployment{ObjectMeta:{test-recreate-deployment deployment-1953 /apis/apps/v1/namespaces/deployment-1953/deployments/test-recreate-deployment c0c234a6-72a1-4282-b720-66190a341351 71485 2 2021-08-18 11:49:24 +0000 UTC map[name:sample-pod-3] map[deployment.kubernetes.io/revision:2] [] [] [{e2e.test Update apps/v1 2021-08-18 11:49:28 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{".":{},"f:name":{}}},"f:spec":{"f:progressDeadlineSeconds":{},"f:replicas":{},"f:revisionHistoryLimit":{},"f:selector":{"f:matchLabels":{".":{},"f:name":{}}},"f:strategy":{"f:type":{}},"f:template":{"f:metadata":{"f:labels":{".":{},"f:name":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"httpd\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}}}} {kube-controller-manager Update apps/v1 2021-08-18 11:49:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:deployment.kubernetes.io/revision":{}}},"f:status":{"f:conditions":{".":{},"k:{\"type\":\"Available\"}":{".":{},"f:lastTransitionTime":{},"f:lastUpdateTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Progressing\"}":{".":{},"f:lastTransitionTime":{},"f:lastUpdateTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:observedGeneration":{},"f:replicas":{},"f:unavailableReplicas":{},"f:updatedReplicas":{}}}}]},Spec:DeploymentSpec{Replicas:*1,Selector:&v1.LabelSelector{MatchLabels:map[string]string{name: sample-pod-3,},MatchExpressions:[]LabelSelectorRequirement{},},Template:{{ 0 0001-01-01 00:00:00 +0000 UTC map[name:sample-pod-3] map[] [] [] []} {[] [] [{httpd docker.io/library/httpd:2.4.38-alpine [] [] [] [] [] {map[] map[]} [] [] nil nil nil nil /dev/termination-log File IfNotPresent SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,} false false false}] [] Always 0xc00494b2f8 ClusterFirst map[] false false false &PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,} [] nil default-scheduler [] [] nil [] map[] [] }},Strategy:DeploymentStrategy{Type:Recreate,RollingUpdate:nil,},MinReadySeconds:0,RevisionHistoryLimit:*10,Paused:false,ProgressDeadlineSeconds:*600,},Status:DeploymentStatus{ObservedGeneration:2,Replicas:1,UpdatedReplicas:1,AvailableReplicas:0,UnavailableReplicas:1,Conditions:[]DeploymentCondition{DeploymentCondition{Type:Available,Status:False,Reason:MinimumReplicasUnavailable,Message:Deployment does not have minimum availability.,LastUpdateTime:2021-08-18 11:49:28 +0000 UTC,LastTransitionTime:2021-08-18 11:49:28 +0000 UTC,},DeploymentCondition{Type:Progressing,Status:True,Reason:ReplicaSetUpdated,Message:ReplicaSet "test-recreate-deployment-f79dd4667" is progressing.,LastUpdateTime:2021-08-18 11:49:28 +0000 UTC,LastTransitionTime:2021-08-18 11:49:24 +0000 UTC,},},ReadyReplicas:0,CollisionCount:nil,},} Aug 18 11:49:28.640: INFO: New ReplicaSet "test-recreate-deployment-f79dd4667" of Deployment "test-recreate-deployment": &ReplicaSet{ObjectMeta:{test-recreate-deployment-f79dd4667 deployment-1953 /apis/apps/v1/namespaces/deployment-1953/replicasets/test-recreate-deployment-f79dd4667 d3002fb8-07a5-47f1-af0c-550ca51518a0 71483 1 2021-08-18 11:49:28 +0000 UTC map[name:sample-pod-3 pod-template-hash:f79dd4667] map[deployment.kubernetes.io/desired-replicas:1 deployment.kubernetes.io/max-replicas:1 deployment.kubernetes.io/revision:2] [{apps/v1 Deployment test-recreate-deployment c0c234a6-72a1-4282-b720-66190a341351 0xc00494b9d0 0xc00494b9d1}] [] [{kube-controller-manager Update apps/v1 2021-08-18 11:49:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:deployment.kubernetes.io/desired-replicas":{},"f:deployment.kubernetes.io/max-replicas":{},"f:deployment.kubernetes.io/revision":{}},"f:labels":{".":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"c0c234a6-72a1-4282-b720-66190a341351\"}":{".":{},"f:apiVersion":{},"f:blockOwnerDeletion":{},"f:controller":{},"f:kind":{},"f:name":{},"f:uid":{}}}},"f:spec":{"f:replicas":{},"f:selector":{"f:matchLabels":{".":{},"f:name":{},"f:pod-template-hash":{}}},"f:template":{"f:metadata":{"f:labels":{".":{},"f:name":{},"f:pod-template-hash":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"httpd\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}},"f:status":{"f:fullyLabeledReplicas":{},"f:observedGeneration":{},"f:replicas":{}}}}]},Spec:ReplicaSetSpec{Replicas:*1,Selector:&v1.LabelSelector{MatchLabels:map[string]string{name: sample-pod-3,pod-template-hash: f79dd4667,},MatchExpressions:[]LabelSelectorRequirement{},},Template:{{ 0 0001-01-01 00:00:00 +0000 UTC map[name:sample-pod-3 pod-template-hash:f79dd4667] map[] [] [] []} {[] [] [{httpd docker.io/library/httpd:2.4.38-alpine [] [] [] [] [] {map[] map[]} [] [] nil nil nil nil /dev/termination-log File IfNotPresent SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,} false false false}] [] Always 0xc00494ba48 ClusterFirst map[] false false false &PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,} [] nil default-scheduler [] [] nil [] map[] [] }},MinReadySeconds:0,},Status:ReplicaSetStatus{Replicas:1,FullyLabeledReplicas:1,ObservedGeneration:1,ReadyReplicas:0,AvailableReplicas:0,Conditions:[]ReplicaSetCondition{},},} Aug 18 11:49:28.640: INFO: All old ReplicaSets of Deployment "test-recreate-deployment": Aug 18 11:49:28.640: INFO: &ReplicaSet{ObjectMeta:{test-recreate-deployment-c96cf48f deployment-1953 /apis/apps/v1/namespaces/deployment-1953/replicasets/test-recreate-deployment-c96cf48f 20af26de-bf50-4107-bef5-4cc0613749c3 71472 2 2021-08-18 11:49:24 +0000 UTC map[name:sample-pod-3 pod-template-hash:c96cf48f] map[deployment.kubernetes.io/desired-replicas:1 deployment.kubernetes.io/max-replicas:1 deployment.kubernetes.io/revision:1] [{apps/v1 Deployment test-recreate-deployment c0c234a6-72a1-4282-b720-66190a341351 0xc00494b8cf 0xc00494b8e0}] [] [{kube-controller-manager Update apps/v1 2021-08-18 11:49:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:deployment.kubernetes.io/desired-replicas":{},"f:deployment.kubernetes.io/max-replicas":{},"f:deployment.kubernetes.io/revision":{}},"f:labels":{".":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"c0c234a6-72a1-4282-b720-66190a341351\"}":{".":{},"f:apiVersion":{},"f:blockOwnerDeletion":{},"f:controller":{},"f:kind":{},"f:name":{},"f:uid":{}}}},"f:spec":{"f:replicas":{},"f:selector":{"f:matchLabels":{".":{},"f:name":{},"f:pod-template-hash":{}}},"f:template":{"f:metadata":{"f:labels":{".":{},"f:name":{},"f:pod-template-hash":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"agnhost\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}},"f:status":{"f:observedGeneration":{},"f:replicas":{}}}}]},Spec:ReplicaSetSpec{Replicas:*0,Selector:&v1.LabelSelector{MatchLabels:map[string]string{name: sample-pod-3,pod-template-hash: c96cf48f,},MatchExpressions:[]LabelSelectorRequirement{},},Template:{{ 0 0001-01-01 00:00:00 +0000 UTC map[name:sample-pod-3 pod-template-hash:c96cf48f] map[] [] [] []} {[] [] [{agnhost k8s.gcr.io/e2e-test-images/agnhost:2.20 [] [] [] [] [] {map[] map[]} [] [] nil nil nil nil /dev/termination-log File IfNotPresent SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,} false false false}] [] Always 0xc00494b958 ClusterFirst map[] false false false &PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,} [] nil default-scheduler [] [] nil [] map[] [] }},MinReadySeconds:0,},Status:ReplicaSetStatus{Replicas:0,FullyLabeledReplicas:0,ObservedGeneration:2,ReadyReplicas:0,AvailableReplicas:0,Conditions:[]ReplicaSetCondition{},},} Aug 18 11:49:28.643: INFO: Pod "test-recreate-deployment-f79dd4667-mwf9h" is not available: &Pod{ObjectMeta:{test-recreate-deployment-f79dd4667-mwf9h test-recreate-deployment-f79dd4667- deployment-1953 /api/v1/namespaces/deployment-1953/pods/test-recreate-deployment-f79dd4667-mwf9h 400fac53-a676-48c2-9a91-f0be9fb63a94 71486 0 2021-08-18 11:49:28 +0000 UTC map[name:sample-pod-3 pod-template-hash:f79dd4667] map[kubernetes.io/psp:collectd] [{apps/v1 ReplicaSet test-recreate-deployment-f79dd4667 d3002fb8-07a5-47f1-af0c-550ca51518a0 0xc00497203f 0xc004972050}] [] [{kube-controller-manager Update v1 2021-08-18 11:49:28 +0000 UTC FieldsV1 {"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"d3002fb8-07a5-47f1-af0c-550ca51518a0\"}":{".":{},"f:apiVersion":{},"f:blockOwnerDeletion":{},"f:controller":{},"f:kind":{},"f:name":{},"f:uid":{}}}},"f:spec":{"f:containers":{"k:{\"name\":\"httpd\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}} {kubelet Update v1 2021-08-18 11:49:28 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:startTime":{}}}}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:default-token-qczpm,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:&SecretVolumeSource{SecretName:default-token-qczpm,Items:[]KeyToPath{},DefaultMode:*420,Optional:nil,},NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:httpd,Image:docker.io/library/httpd:2.4.38-alpine,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:default-token-qczpm,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:Always,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*0,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:node1,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,},Status:PodStatus{Phase:Pending,Conditions:[]PodCondition{PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-08-18 11:49:28 +0000 UTC,Reason:,Message:,},PodCondition{Type:Ready,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-08-18 11:49:28 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:ContainersReady,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-08-18 11:49:28 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-08-18 11:49:28 +0000 UTC,Reason:,Message:,},},Message:,Reason:,HostIP:10.10.190.207,PodIP:,StartTime:2021-08-18 11:49:28 +0000 UTC,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:httpd,State:ContainerState{Waiting:&ContainerStateWaiting{Reason:ContainerCreating,Message:,},Running:nil,Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:false,RestartCount:0,Image:docker.io/library/httpd:2.4.38-alpine,ImageID:,ContainerID:,Started:*false,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{},EphemeralContainerStatuses:[]ContainerStatus{},},} [AfterEach] [sig-apps] Deployment /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:49:28.643: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "deployment-1953" for this suite. • ------------------------------ {"msg":"PASSED [sig-apps] Deployment RecreateDeployment should delete old pods and create new ones [Conformance]","total":-1,"completed":33,"skipped":808,"failed":4,"failures":["[sig-network] Services should be able to create a functioning NodePort service [Conformance]","[k8s.io] Pods should support retrieving logs from the container over websockets [NodeConformance] [Conformance]","[k8s.io] InitContainer [NodeConformance] should not start app containers if init containers fail on a RestartAlways pod [Conformance]","[k8s.io] Container Runtime blackbox test on terminated container should report termination message [LinuxOnly] if TerminationMessagePath is set as non-root user and at a non-default path [NodeConformance] [Conformance]"]} SSSSSS ------------------------------ [BeforeEach] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:49:18.809: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename crd-publish-openapi STEP: Waiting for a default service account to be provisioned in namespace [It] works for CRD preserving unknown fields in an embedded object [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:49:18.829: INFO: >>> kubeConfig: /root/.kube/config STEP: client-side validation (kubectl create and apply) allows request with any unknown properties Aug 18 11:49:26.696: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=crd-publish-openapi-8282 --namespace=crd-publish-openapi-8282 create -f -' Aug 18 11:49:27.140: INFO: stderr: "" Aug 18 11:49:27.140: INFO: stdout: "e2e-test-crd-publish-openapi-6267-crd.crd-publish-openapi-test-unknown-in-nested.example.com/test-cr created\n" Aug 18 11:49:27.141: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=crd-publish-openapi-8282 --namespace=crd-publish-openapi-8282 delete e2e-test-crd-publish-openapi-6267-crds test-cr' Aug 18 11:49:27.321: INFO: stderr: "" Aug 18 11:49:27.321: INFO: stdout: "e2e-test-crd-publish-openapi-6267-crd.crd-publish-openapi-test-unknown-in-nested.example.com \"test-cr\" deleted\n" Aug 18 11:49:27.321: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=crd-publish-openapi-8282 --namespace=crd-publish-openapi-8282 apply -f -' Aug 18 11:49:27.604: INFO: stderr: "" Aug 18 11:49:27.604: INFO: stdout: "e2e-test-crd-publish-openapi-6267-crd.crd-publish-openapi-test-unknown-in-nested.example.com/test-cr created\n" Aug 18 11:49:27.604: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=crd-publish-openapi-8282 --namespace=crd-publish-openapi-8282 delete e2e-test-crd-publish-openapi-6267-crds test-cr' Aug 18 11:49:27.758: INFO: stderr: "" Aug 18 11:49:27.758: INFO: stdout: "e2e-test-crd-publish-openapi-6267-crd.crd-publish-openapi-test-unknown-in-nested.example.com \"test-cr\" deleted\n" STEP: kubectl explain works to explain CR Aug 18 11:49:27.759: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=crd-publish-openapi-8282 explain e2e-test-crd-publish-openapi-6267-crds' Aug 18 11:49:28.022: INFO: stderr: "" Aug 18 11:49:28.022: INFO: stdout: "KIND: E2e-test-crd-publish-openapi-6267-crd\nVERSION: crd-publish-openapi-test-unknown-in-nested.example.com/v1\n\nDESCRIPTION:\n preserve-unknown-properties in nested field for Testing\n\nFIELDS:\n apiVersion\t\n APIVersion defines the versioned schema of this representation of an\n object. Servers should convert recognized schemas to the latest internal\n value, and may reject unrecognized values. More info:\n https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#resources\n\n kind\t\n Kind is a string value representing the REST resource this object\n represents. Servers may infer this from the endpoint the client submits\n requests to. Cannot be updated. In CamelCase. More info:\n https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#types-kinds\n\n metadata\t\n Standard object's metadata. More info:\n https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#metadata\n\n spec\t<>\n Specification of Waldo\n\n status\t\n Status of Waldo\n\n" [AfterEach] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:49:30.935: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "crd-publish-openapi-8282" for this suite. • [SLOW TEST:12.135 seconds] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23 works for CRD preserving unknown fields in an embedded object [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] works for CRD preserving unknown fields in an embedded object [Conformance]","total":-1,"completed":26,"skipped":636,"failed":2,"failures":["[k8s.io] Pods should be submitted and removed [NodeConformance] [Conformance]","[sig-apps] Job should run a job to completion when tasks sometimes fail and are locally restarted [Conformance]"]} SSS ------------------------------ [BeforeEach] [sig-storage] EmptyDir volumes /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:49:30.952: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename emptydir STEP: Waiting for a default service account to be provisioned in namespace [It] should support (root,0644,tmpfs) [LinuxOnly] [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating a pod to test emptydir 0644 on tmpfs Aug 18 11:49:30.983: INFO: Waiting up to 5m0s for pod "pod-11ae0c8a-cabc-4acb-8a15-d3c1981759b6" in namespace "emptydir-5590" to be "Succeeded or Failed" Aug 18 11:49:30.985: INFO: Pod "pod-11ae0c8a-cabc-4acb-8a15-d3c1981759b6": Phase="Pending", Reason="", readiness=false. Elapsed: 2.014286ms Aug 18 11:49:32.989: INFO: Pod "pod-11ae0c8a-cabc-4acb-8a15-d3c1981759b6": Phase="Pending", Reason="", readiness=false. Elapsed: 2.006162751s Aug 18 11:49:34.992: INFO: Pod "pod-11ae0c8a-cabc-4acb-8a15-d3c1981759b6": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.00954485s STEP: Saw pod success Aug 18 11:49:34.992: INFO: Pod "pod-11ae0c8a-cabc-4acb-8a15-d3c1981759b6" satisfied condition "Succeeded or Failed" Aug 18 11:49:34.995: INFO: Trying to get logs from node node2 pod pod-11ae0c8a-cabc-4acb-8a15-d3c1981759b6 container test-container: STEP: delete the pod Aug 18 11:49:35.011: INFO: Waiting for pod pod-11ae0c8a-cabc-4acb-8a15-d3c1981759b6 to disappear Aug 18 11:49:35.013: INFO: Pod pod-11ae0c8a-cabc-4acb-8a15-d3c1981759b6 no longer exists [AfterEach] [sig-storage] EmptyDir volumes /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:49:35.013: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "emptydir-5590" for this suite. • ------------------------------ {"msg":"PASSED [sig-storage] EmptyDir volumes should support (root,0644,tmpfs) [LinuxOnly] [NodeConformance] [Conformance]","total":-1,"completed":27,"skipped":639,"failed":2,"failures":["[k8s.io] Pods should be submitted and removed [NodeConformance] [Conformance]","[sig-apps] Job should run a job to completion when tasks sometimes fail and are locally restarted [Conformance]"]} SSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-network] Networking /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:49:35.057: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename pod-network-test STEP: Waiting for a default service account to be provisioned in namespace [It] should function for intra-pod communication: http [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Performing setup for networking test in namespace pod-network-test-1192 STEP: creating a selector STEP: Creating the service pods in kubernetes Aug 18 11:49:35.079: INFO: Waiting up to 10m0s for all (but 0) nodes to be schedulable Aug 18 11:49:35.113: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Aug 18 11:49:37.116: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Aug 18 11:49:39.116: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Aug 18 11:49:41.116: INFO: The status of Pod netserver-0 is Running (Ready = false) Aug 18 11:49:43.116: INFO: The status of Pod netserver-0 is Running (Ready = false) Aug 18 11:49:45.116: INFO: The status of Pod netserver-0 is Running (Ready = false) Aug 18 11:49:47.116: INFO: The status of Pod netserver-0 is Running (Ready = false) Aug 18 11:49:49.116: INFO: The status of Pod netserver-0 is Running (Ready = false) Aug 18 11:49:51.117: INFO: The status of Pod netserver-0 is Running (Ready = false) Aug 18 11:49:53.116: INFO: The status of Pod netserver-0 is Running (Ready = false) Aug 18 11:49:55.116: INFO: The status of Pod netserver-0 is Running (Ready = true) Aug 18 11:49:55.121: INFO: The status of Pod netserver-1 is Running (Ready = true) STEP: Creating test pods Aug 18 11:49:59.144: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s 'http://10.244.3.84:8080/dial?request=hostname&protocol=http&host=10.244.4.91&port=8080&tries=1'] Namespace:pod-network-test-1192 PodName:test-container-pod ContainerName:webserver Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:false} Aug 18 11:49:59.144: INFO: >>> kubeConfig: /root/.kube/config Aug 18 11:49:59.276: INFO: Waiting for responses: map[] Aug 18 11:49:59.278: INFO: ExecWithOptions {Command:[/bin/sh -c curl -g -q -s 'http://10.244.3.84:8080/dial?request=hostname&protocol=http&host=10.244.3.81&port=8080&tries=1'] Namespace:pod-network-test-1192 PodName:test-container-pod ContainerName:webserver Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:false} Aug 18 11:49:59.278: INFO: >>> kubeConfig: /root/.kube/config Aug 18 11:49:59.388: INFO: Waiting for responses: map[] [AfterEach] [sig-network] Networking /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:49:59.388: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "pod-network-test-1192" for this suite. • [SLOW TEST:24.338 seconds] [sig-network] Networking /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/networking.go:26 Granular Checks: Pods /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/networking.go:29 should function for intra-pod communication: http [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-network] Networking Granular Checks: Pods should function for intra-pod communication: http [NodeConformance] [Conformance]","total":-1,"completed":28,"skipped":655,"failed":2,"failures":["[k8s.io] Pods should be submitted and removed [NodeConformance] [Conformance]","[sig-apps] Job should run a job to completion when tasks sometimes fail and are locally restarted [Conformance]"]} SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-node] PodTemplates /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:49:59.480: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename podtemplate STEP: Waiting for a default service account to be provisioned in namespace [It] should delete a collection of pod templates [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Create set of pod templates Aug 18 11:49:59.504: INFO: created test-podtemplate-1 Aug 18 11:49:59.507: INFO: created test-podtemplate-2 Aug 18 11:49:59.511: INFO: created test-podtemplate-3 STEP: get a list of pod templates with a label in the current namespace STEP: delete collection of pod templates Aug 18 11:49:59.513: INFO: requesting DeleteCollection of pod templates STEP: check that the list of pod templates matches the requested quantity Aug 18 11:49:59.524: INFO: requesting list of pod templates to confirm quantity [AfterEach] [sig-node] PodTemplates /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:49:59.527: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "podtemplate-910" for this suite. • ------------------------------ {"msg":"PASSED [sig-node] PodTemplates should delete a collection of pod templates [Conformance]","total":-1,"completed":29,"skipped":694,"failed":2,"failures":["[k8s.io] Pods should be submitted and removed [NodeConformance] [Conformance]","[sig-apps] Job should run a job to completion when tasks sometimes fail and are locally restarted [Conformance]"]} SSSSSSSS ------------------------------ [BeforeEach] [k8s.io] [sig-node] PreStop /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:44:57.271: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename prestop STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [k8s.io] [sig-node] PreStop /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/pre_stop.go:157 [It] should call prestop when killing a pod [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating server pod server in namespace prestop-8076 STEP: Waiting for pods to come up. STEP: Creating tester pod tester in namespace prestop-8076 Aug 18 11:50:01.338: FAIL: waiting for tester pod to start Unexpected error: <*errors.errorString | 0xc0002c2200>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/node.testPreStop(0x5410260, 0xc003e42000, 0xc0032af870, 0xc) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/pre_stop.go:107 +0x105d k8s.io/kubernetes/test/e2e/node.glob..func11.2() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/pre_stop.go:167 +0x4d k8s.io/kubernetes/test/e2e.RunE2ETests(0xc001880c00) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc001880c00) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc001880c00, 0x4deb2c0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 STEP: Deleting the tester pod STEP: Deleting the server pod [AfterEach] [k8s.io] [sig-node] PreStop /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "prestop-8076". STEP: Found 16 events. Aug 18 11:50:01.354: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for server: { } Scheduled: Successfully assigned prestop-8076/server to node2 Aug 18 11:50:01.354: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for tester: { } Scheduled: Successfully assigned prestop-8076/tester to node2 Aug 18 11:50:01.354: INFO: At 2021-08-18 11:44:58 +0000 UTC - event for server: {kubelet node2} Pulling: Pulling image "k8s.gcr.io/e2e-test-images/agnhost:2.20" Aug 18 11:50:01.354: INFO: At 2021-08-18 11:44:58 +0000 UTC - event for server: {multus } AddedInterface: Add eth0 [10.244.3.61/24] Aug 18 11:50:01.354: INFO: At 2021-08-18 11:44:59 +0000 UTC - event for server: {kubelet node2} Pulled: Successfully pulled image "k8s.gcr.io/e2e-test-images/agnhost:2.20" in 499.899427ms Aug 18 11:50:01.354: INFO: At 2021-08-18 11:44:59 +0000 UTC - event for server: {kubelet node2} Created: Created container agnhost-container Aug 18 11:50:01.354: INFO: At 2021-08-18 11:44:59 +0000 UTC - event for server: {kubelet node2} Started: Started container agnhost-container Aug 18 11:50:01.354: INFO: At 2021-08-18 11:45:02 +0000 UTC - event for tester: {kubelet node2} Pulling: Pulling image "docker.io/library/busybox:1.29" Aug 18 11:50:01.355: INFO: At 2021-08-18 11:45:02 +0000 UTC - event for tester: {multus } AddedInterface: Add eth0 [10.244.3.62/24] Aug 18 11:50:01.355: INFO: At 2021-08-18 11:45:03 +0000 UTC - event for tester: {kubelet node2} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit Aug 18 11:50:01.355: INFO: At 2021-08-18 11:45:03 +0000 UTC - event for tester: {kubelet node2} Failed: Error: ErrImagePull Aug 18 11:50:01.355: INFO: At 2021-08-18 11:45:04 +0000 UTC - event for tester: {kubelet node2} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Aug 18 11:50:01.355: INFO: At 2021-08-18 11:45:06 +0000 UTC - event for tester: {kubelet node2} Failed: Error: ImagePullBackOff Aug 18 11:50:01.355: INFO: At 2021-08-18 11:45:06 +0000 UTC - event for tester: {multus } AddedInterface: Add eth0 [10.244.3.63/24] Aug 18 11:50:01.355: INFO: At 2021-08-18 11:45:06 +0000 UTC - event for tester: {kubelet node2} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" Aug 18 11:50:01.355: INFO: At 2021-08-18 11:50:01 +0000 UTC - event for server: {kubelet node2} Killing: Stopping container agnhost-container Aug 18 11:50:01.357: INFO: POD NODE PHASE GRACE CONDITIONS Aug 18 11:50:01.357: INFO: tester node2 Pending 30s [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:45:01 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:45:01 +0000 UTC ContainersNotReady containers with unready status: [tester]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:45:01 +0000 UTC ContainersNotReady containers with unready status: [tester]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:45:01 +0000 UTC }] Aug 18 11:50:01.357: INFO: Aug 18 11:50:01.361: INFO: Logging node info for node master1 Aug 18 11:50:01.363: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 ebb211fa-503f-4cfe-b1ed-c95d27a70e6e 71819 0 2021-08-18 08:20:52 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"3a:82:be:72:b5:15"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:20:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:20:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:25:59 +0000 UTC,LastTransitionTime:2021-08-18 08:25:59 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:49:57 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:49:57 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:49:57 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:49:57 +0000 UTC,LastTransitionTime:2021-08-18 08:25:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:58c3e57359b641ad92fa1959f2fecf5d,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:012cd796-2076-45d6-8b14-d3e0451b1e64,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[@ :],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:50:01.364: INFO: Logging kubelet events for node master1 Aug 18 11:50:01.366: INFO: Logging pods the kubelet thinks is on node master1 Aug 18 11:50:01.374: INFO: kube-apiserver-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:01.374: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:50:01.374: INFO: kube-proxy-vqk4v started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:01.374: INFO: Container kube-proxy ready: true, restart count 1 Aug 18 11:50:01.374: INFO: kube-flannel-q64cq started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:50:01.374: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:50:01.374: INFO: Container kube-flannel ready: true, restart count 3 Aug 18 11:50:01.374: INFO: coredns-7677f9bb54-kn2qg started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:01.374: INFO: Container coredns ready: true, restart count 2 Aug 18 11:50:01.374: INFO: kube-scheduler-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:01.374: INFO: Container kube-scheduler ready: true, restart count 0 Aug 18 11:50:01.374: INFO: kube-controller-manager-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:01.374: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:50:01.375: INFO: kube-multus-ds-amd64-kbcp6 started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:01.375: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:50:01.375: INFO: docker-registry-docker-registry-56cbc7bc58-49kl2 started at 2021-08-18 08:26:23 +0000 UTC (0+2 container statuses recorded) Aug 18 11:50:01.375: INFO: Container docker-registry ready: true, restart count 0 Aug 18 11:50:01.375: INFO: Container nginx ready: true, restart count 0 Aug 18 11:50:01.375: INFO: node-exporter-5hwz9 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:50:01.375: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:50:01.375: INFO: Container node-exporter ready: true, restart count 0 W0818 11:50:01.386619 26 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:50:01.410: INFO: Latency metrics for node master1 Aug 18 11:50:01.410: INFO: Logging node info for node master2 Aug 18 11:50:01.412: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 78946293-3abe-4442-84d4-8ed6b1d15ce0 71811 0 2021-08-18 08:21:31 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"7e:f5:c2:cc:3a:b4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:21:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:21:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-08-18 08:29:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:49:56 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:49:56 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:49:56 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:49:56 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0c44122c7a7248c18d8571e1cc667258,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:0cd329f2-48e0-4c8f-b8b9-fa3ae0ed8406,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:50:01.413: INFO: Logging kubelet events for node master2 Aug 18 11:50:01.415: INFO: Logging pods the kubelet thinks is on node master2 Aug 18 11:50:01.422: INFO: dns-autoscaler-5b7b5c9b6f-hh47r started at 2021-08-18 08:23:57 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:01.422: INFO: Container autoscaler ready: true, restart count 2 Aug 18 11:50:01.422: INFO: node-feature-discovery-controller-5bf5c49849-mq57c started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:01.422: INFO: Container nfd-controller ready: true, restart count 0 Aug 18 11:50:01.422: INFO: node-exporter-48nfx started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:50:01.422: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:50:01.422: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:50:01.422: INFO: kube-apiserver-master2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:01.422: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:50:01.422: INFO: kube-scheduler-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:01.422: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:50:01.422: INFO: kube-multus-ds-amd64-mld8g started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:01.422: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:50:01.422: INFO: kube-controller-manager-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:01.422: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:50:01.422: INFO: kube-proxy-kh2l9 started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:01.422: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:50:01.422: INFO: kube-flannel-pp56h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:50:01.422: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:50:01.422: INFO: Container kube-flannel ready: true, restart count 1 W0818 11:50:01.435289 26 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:50:01.463: INFO: Latency metrics for node master2 Aug 18 11:50:01.463: INFO: Logging node info for node master3 Aug 18 11:50:01.465: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 44feac2b-9447-4be2-9fcd-62f836d67c72 71785 0 2021-08-18 08:21:41 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"86:e4:31:99:58:40"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {kubelet Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:49:51 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:49:51 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:49:51 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:49:51 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1fae19ae59884c44899bcd08aa243244,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:5db926c5-6530-4635-a0d5-806974a3b732,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:50:01.466: INFO: Logging kubelet events for node master3 Aug 18 11:50:01.470: INFO: Logging pods the kubelet thinks is on node master3 Aug 18 11:50:01.479: INFO: kube-proxy-sd5lc started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:01.479: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:50:01.479: INFO: kube-flannel-x6tlr started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:50:01.479: INFO: Init container install-cni ready: true, restart count 1 Aug 18 11:50:01.479: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:50:01.479: INFO: kube-multus-ds-amd64-bkw6c started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:01.479: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:50:01.479: INFO: coredns-7677f9bb54-5hxfh started at 2021-08-18 08:23:54 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:01.479: INFO: Container coredns ready: true, restart count 1 Aug 18 11:50:01.479: INFO: node-exporter-vq7d8 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:50:01.479: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:50:01.479: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:50:01.479: INFO: kube-controller-manager-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:01.479: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:50:01.479: INFO: kube-scheduler-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:01.479: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:50:01.479: INFO: kube-apiserver-master3 started at 2021-08-18 08:29:12 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:01.479: INFO: Container kube-apiserver ready: true, restart count 0 W0818 11:50:01.493598 26 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:50:01.516: INFO: Latency metrics for node master3 Aug 18 11:50:01.516: INFO: Logging node info for node node1 Aug 18 11:50:01.519: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 84defabd-6ebf-43ec-a629-44c6713da9c9 71793 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"9a:87:55:36:7b:df"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:13 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:35 +0000 UTC,LastTransitionTime:2021-08-18 08:26:35 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:49:53 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:49:53 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:49:53 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:49:53 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:69946ff2b7bc462fa25eb7adb4703c23,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:736dc52f-f5e3-494e-86ca-01eedbea015c,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:a7cea43d9d2f67c38fbf0407786edbe660ee9072945f7bb272b55fd255e8eaca opnfv/barometer-collectd:stable],SizeBytes:1075746799,},ContainerImage{Names:[@ :],SizeBytes:1003788820,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[aquasec/kube-hunter@sha256:2be6820bc1d7e0f57193a9a27d5a3e16b2fd93c53747b03ce8ca48c6fc323781 aquasec/kube-hunter:0.3.1],SizeBytes:347611549,},ContainerImage{Names:[golang@sha256:db2475a1dbb2149508e5db31d7d77a75e6600d54be645f37681f03f2762169ba golang:alpine3.12],SizeBytes:301186719,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:de25c7fc6c4f3a27c7f0c2dff454e4671823a34d88abd533f210848d527e0fbb alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:50:01.520: INFO: Logging kubelet events for node node1 Aug 18 11:50:01.522: INFO: Logging pods the kubelet thinks is on node node1 Aug 18 11:50:01.539: INFO: pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975 started at 2021-08-18 11:47:15 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:01.539: INFO: Container secret-env-test ready: false, restart count 0 Aug 18 11:50:01.539: INFO: var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209 started at 2021-08-18 11:47:57 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:01.539: INFO: Container dapi-container ready: false, restart count 0 Aug 18 11:50:01.539: INFO: affinity-nodeport-f9b5h started at 2021-08-18 11:49:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:01.539: INFO: Container affinity-nodeport ready: false, restart count 0 Aug 18 11:50:01.539: INFO: nginx-proxy-node1 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:01.539: INFO: Container nginx-proxy ready: true, restart count 2 Aug 18 11:50:01.539: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-vsxvg started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:01.539: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:50:01.539: INFO: affinity-nodeport-timeout-6vmxz started at 2021-08-18 11:49:43 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:01.539: INFO: Container affinity-nodeport-timeout ready: true, restart count 0 Aug 18 11:50:01.539: INFO: kube-flannel-q78nd started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:50:01.539: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:50:01.539: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:50:01.539: INFO: prometheus-k8s-0 started at 2021-08-18 08:34:03 +0000 UTC (0+5 container statuses recorded) Aug 18 11:50:01.539: INFO: Container custom-metrics-apiserver ready: true, restart count 0 Aug 18 11:50:01.539: INFO: Container grafana ready: true, restart count 0 Aug 18 11:50:01.539: INFO: Container prometheus ready: true, restart count 1 Aug 18 11:50:01.539: INFO: Container prometheus-config-reloader ready: true, restart count 0 Aug 18 11:50:01.539: INFO: Container rules-configmap-reloader ready: true, restart count 0 Aug 18 11:50:01.539: INFO: pod-exec-websocket-bcecdfc1-0c3c-45a9-8652-d4ffebd4fba3 started at 2021-08-18 11:45:21 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:01.540: INFO: Container main ready: false, restart count 0 Aug 18 11:50:01.540: INFO: ss-0 started at 2021-08-18 11:47:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:01.540: INFO: Container webserver ready: false, restart count 0 Aug 18 11:50:01.540: INFO: netserver-0 started at 2021-08-18 11:49:35 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:01.540: INFO: Container webserver ready: true, restart count 0 Aug 18 11:50:01.540: INFO: execpod-affinitycdhts started at 2021-08-18 11:49:49 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:01.540: INFO: Container agnhost-container ready: true, restart count 0 Aug 18 11:50:01.540: INFO: kube-multus-ds-amd64-rrvmb started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:01.540: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:50:01.540: INFO: node-feature-discovery-worker-pflgw started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:01.540: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:50:01.540: INFO: node-exporter-kcwvn started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:50:01.540: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:50:01.540: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:50:01.540: INFO: cmk-d8r27 started at 2021-08-18 08:32:52 +0000 UTC (0+2 container statuses recorded) Aug 18 11:50:01.540: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:50:01.540: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:50:01.540: INFO: collectd-xdprr started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:50:01.540: INFO: Container collectd ready: true, restart count 0 Aug 18 11:50:01.540: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:50:01.540: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:50:01.540: INFO: kube-proxy-p6jvp started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:01.540: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:50:01.540: INFO: kubernetes-metrics-scraper-678c97765c-9nsv5 started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:01.540: INFO: Container kubernetes-metrics-scraper ready: true, restart count 2 Aug 18 11:50:01.540: INFO: cmk-init-discover-node1-bxznx started at 2021-08-18 08:32:10 +0000 UTC (0+3 container statuses recorded) Aug 18 11:50:01.540: INFO: Container discover ready: false, restart count 0 Aug 18 11:50:01.540: INFO: Container init ready: false, restart count 0 Aug 18 11:50:01.540: INFO: Container install ready: false, restart count 0 W0818 11:50:01.551435 26 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:50:01.580: INFO: Latency metrics for node node1 Aug 18 11:50:01.580: INFO: Logging node info for node node2 Aug 18 11:50:01.583: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 1d01177e-3dbb-48a1-a0bc-d18af27ab7f8 71828 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:d1:47:f8:1d:22"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:36 +0000 UTC,LastTransitionTime:2021-08-18 08:26:36 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:49:59 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:49:59 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:49:59 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:49:59 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:dc1f286135c145349b8a016880b65a2f,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:037e7e2d-94e9-42f4-a719-896e5005ac70,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:50:01.584: INFO: Logging kubelet events for node node2 Aug 18 11:50:01.586: INFO: Logging pods the kubelet thinks is on node node2 Aug 18 11:50:01.600: INFO: tester started at 2021-08-18 11:45:01 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:01.601: INFO: Container tester ready: false, restart count 0 Aug 18 11:50:01.601: INFO: cmk-webhook-6c9d5f8578-7cxjr started at 2021-08-18 08:32:53 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:01.601: INFO: Container cmk-webhook ready: true, restart count 0 Aug 18 11:50:01.601: INFO: affinity-nodeport-qvd62 started at 2021-08-18 11:49:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:01.601: INFO: Container affinity-nodeport ready: false, restart count 0 Aug 18 11:50:01.601: INFO: kube-flannel-h7t5h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:50:01.601: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:50:01.601: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:50:01.601: INFO: node-exporter-lrrf2 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:50:01.601: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:50:01.601: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:50:01.601: INFO: affinity-nodeport-timeout-qkg67 started at 2021-08-18 11:49:43 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:01.601: INFO: Container affinity-nodeport-timeout ready: true, restart count 0 Aug 18 11:50:01.601: INFO: pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70 started at 2021-08-18 11:46:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:01.601: INFO: Container env-test ready: false, restart count 0 Aug 18 11:50:01.601: INFO: netserver-1 started at 2021-08-18 11:49:35 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:01.601: INFO: Container webserver ready: true, restart count 0 Aug 18 11:50:01.601: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-7rn45 started at 2021-08-18 08:36:42 +0000 UTC (0+2 container statuses recorded) Aug 18 11:50:01.601: INFO: Container tas-controller ready: true, restart count 0 Aug 18 11:50:01.601: INFO: Container tas-extender ready: true, restart count 0 Aug 18 11:50:01.601: INFO: affinity-nodeport-cc62g started at 2021-08-18 11:49:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:01.601: INFO: Container affinity-nodeport ready: false, restart count 0 Aug 18 11:50:01.601: INFO: nginx-proxy-node2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:01.601: INFO: Container nginx-proxy ready: true, restart count 1 Aug 18 11:50:01.601: INFO: cmk-init-discover-node2-6b2kz started at 2021-08-18 08:32:30 +0000 UTC (0+3 container statuses recorded) Aug 18 11:50:01.601: INFO: Container discover ready: false, restart count 0 Aug 18 11:50:01.601: INFO: Container init ready: false, restart count 0 Aug 18 11:50:01.601: INFO: Container install ready: false, restart count 0 Aug 18 11:50:01.601: INFO: kubernetes-dashboard-86c6f9df5b-qrtdk started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:01.601: INFO: Container kubernetes-dashboard ready: true, restart count 2 Aug 18 11:50:01.601: INFO: cmk-748rz started at 2021-08-18 08:32:53 +0000 UTC (0+2 container statuses recorded) Aug 18 11:50:01.601: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:50:01.601: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:50:01.601: INFO: affinity-nodeport-timeout-jfknb started at 2021-08-18 11:49:43 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:01.601: INFO: Container affinity-nodeport-timeout ready: true, restart count 0 Aug 18 11:50:01.601: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-c82pt started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:01.601: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:50:01.601: INFO: prometheus-operator-5bb8cb9d8f-k97ws started at 2021-08-18 08:33:38 +0000 UTC (0+2 container statuses recorded) Aug 18 11:50:01.601: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:50:01.601: INFO: Container prometheus-operator ready: true, restart count 0 Aug 18 11:50:01.601: INFO: test-container-pod started at 2021-08-18 11:49:55 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:01.601: INFO: Container webserver ready: true, restart count 0 Aug 18 11:50:01.601: INFO: kube-proxy-qkj9c started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:01.601: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:50:01.601: INFO: node-feature-discovery-worker-hzpf5 started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:01.601: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:50:01.601: INFO: ss-0 started at 2021-08-18 11:46:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:01.601: INFO: Container webserver ready: false, restart count 0 Aug 18 11:50:01.601: INFO: bin-falsea5f6898f-c6c3-4680-9cbd-f4985908f73e started at 2021-08-18 11:49:10 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:01.601: INFO: Container bin-falsea5f6898f-c6c3-4680-9cbd-f4985908f73e ready: false, restart count 0 Aug 18 11:50:01.601: INFO: kube-multus-ds-amd64-rvzsg started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:01.601: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:50:01.601: INFO: collectd-67ntq started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:50:01.601: INFO: Container collectd ready: true, restart count 0 Aug 18 11:50:01.601: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:50:01.601: INFO: Container rbac-proxy ready: true, restart count 0 W0818 11:50:01.614384 26 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:50:01.644: INFO: Latency metrics for node node2 Aug 18 11:50:01.644: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "prestop-8076" for this suite. • Failure [304.383 seconds] [k8s.io] [sig-node] PreStop /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 should call prestop when killing a pod [Conformance] [It] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:50:01.338: waiting for tester pod to start Unexpected error: <*errors.errorString | 0xc0002c2200>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/pre_stop.go:107 ------------------------------ {"msg":"FAILED [k8s.io] [sig-node] PreStop should call prestop when killing a pod [Conformance]","total":-1,"completed":15,"skipped":207,"failed":4,"failures":["[sig-apps] Deployment deployment should support rollover [Conformance]","[sig-network] Services should be able to switch session affinity for NodePort service [LinuxOnly] [Conformance]","[sig-node] Downward API should provide container's limits.cpu/memory and requests.cpu/memory as env vars [NodeConformance] [Conformance]","[k8s.io] [sig-node] PreStop should call prestop when killing a pod [Conformance]"]} SSSSSSSSS ------------------------------ [BeforeEach] [sig-storage] Projected configMap /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:50:01.682: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename projected STEP: Waiting for a default service account to be provisioned in namespace [It] should be consumable from pods in volume with mappings [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating configMap with name projected-configmap-test-volume-map-26842e94-a302-4313-9d3e-b98dd8dac4f2 STEP: Creating a pod to test consume configMaps Aug 18 11:50:01.721: INFO: Waiting up to 5m0s for pod "pod-projected-configmaps-1340bf12-079b-47a3-9eba-a810f3972b42" in namespace "projected-445" to be "Succeeded or Failed" Aug 18 11:50:01.726: INFO: Pod "pod-projected-configmaps-1340bf12-079b-47a3-9eba-a810f3972b42": Phase="Pending", Reason="", readiness=false. Elapsed: 4.371822ms Aug 18 11:50:03.731: INFO: Pod "pod-projected-configmaps-1340bf12-079b-47a3-9eba-a810f3972b42": Phase="Pending", Reason="", readiness=false. Elapsed: 2.009092883s Aug 18 11:50:05.734: INFO: Pod "pod-projected-configmaps-1340bf12-079b-47a3-9eba-a810f3972b42": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.012567436s STEP: Saw pod success Aug 18 11:50:05.734: INFO: Pod "pod-projected-configmaps-1340bf12-079b-47a3-9eba-a810f3972b42" satisfied condition "Succeeded or Failed" Aug 18 11:50:05.736: INFO: Trying to get logs from node node1 pod pod-projected-configmaps-1340bf12-079b-47a3-9eba-a810f3972b42 container projected-configmap-volume-test: STEP: delete the pod Aug 18 11:50:05.749: INFO: Waiting for pod pod-projected-configmaps-1340bf12-079b-47a3-9eba-a810f3972b42 to disappear Aug 18 11:50:05.751: INFO: Pod pod-projected-configmaps-1340bf12-079b-47a3-9eba-a810f3972b42 no longer exists [AfterEach] [sig-storage] Projected configMap /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:50:05.751: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "projected-445" for this suite. • ------------------------------ {"msg":"PASSED [sig-storage] Projected configMap should be consumable from pods in volume with mappings [NodeConformance] [Conformance]","total":-1,"completed":16,"skipped":216,"failed":4,"failures":["[sig-apps] Deployment deployment should support rollover [Conformance]","[sig-network] Services should be able to switch session affinity for NodePort service [LinuxOnly] [Conformance]","[sig-node] Downward API should provide container's limits.cpu/memory and requests.cpu/memory as env vars [NodeConformance] [Conformance]","[k8s.io] [sig-node] PreStop should call prestop when killing a pod [Conformance]"]} SSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ {"msg":"PASSED [sig-cli] Kubectl client Kubectl version should check is all data is printed [Conformance]","total":-1,"completed":23,"skipped":375,"failed":3,"failures":["[sig-apps] Deployment RollingUpdateDeployment should delete old pods and create new ones [Conformance]","[sig-storage] ConfigMap binary data should be reflected in volume [NodeConformance] [Conformance]","[k8s.io] Kubelet when scheduling a busybox command in a pod should print the output to logs [NodeConformance] [Conformance]"]} [BeforeEach] [k8s.io] Pods /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:45:21.211: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename pods STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [k8s.io] Pods /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/pods.go:181 [It] should support remote command execution over websockets [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:45:21.228: INFO: >>> kubeConfig: /root/.kube/config STEP: creating the pod STEP: submitting the pod to kubernetes Aug 18 11:50:21.251: FAIL: Unexpected error: <*errors.errorString | 0xc0002801f0>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*PodClient).CreateSync(0xc0042b7340, 0xc001288000, 0x0) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:103 +0xfe k8s.io/kubernetes/test/e2e/common.glob..func18.7() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/pods.go:560 +0x48c k8s.io/kubernetes/test/e2e.RunE2ETests(0xc003602780) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc003602780) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc003602780, 0x4deb2c0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] Pods /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "pods-1730". STEP: Found 7 events. Aug 18 11:50:21.255: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for pod-exec-websocket-bcecdfc1-0c3c-45a9-8652-d4ffebd4fba3: { } Scheduled: Successfully assigned pods-1730/pod-exec-websocket-bcecdfc1-0c3c-45a9-8652-d4ffebd4fba3 to node1 Aug 18 11:50:21.255: INFO: At 2021-08-18 11:45:22 +0000 UTC - event for pod-exec-websocket-bcecdfc1-0c3c-45a9-8652-d4ffebd4fba3: {multus } AddedInterface: Add eth0 [10.244.4.67/24] Aug 18 11:50:21.255: INFO: At 2021-08-18 11:45:22 +0000 UTC - event for pod-exec-websocket-bcecdfc1-0c3c-45a9-8652-d4ffebd4fba3: {kubelet node1} Pulling: Pulling image "docker.io/library/busybox:1.29" Aug 18 11:50:21.255: INFO: At 2021-08-18 11:45:23 +0000 UTC - event for pod-exec-websocket-bcecdfc1-0c3c-45a9-8652-d4ffebd4fba3: {kubelet node1} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit Aug 18 11:50:21.255: INFO: At 2021-08-18 11:45:23 +0000 UTC - event for pod-exec-websocket-bcecdfc1-0c3c-45a9-8652-d4ffebd4fba3: {kubelet node1} Failed: Error: ErrImagePull Aug 18 11:50:21.255: INFO: At 2021-08-18 11:45:24 +0000 UTC - event for pod-exec-websocket-bcecdfc1-0c3c-45a9-8652-d4ffebd4fba3: {kubelet node1} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" Aug 18 11:50:21.255: INFO: At 2021-08-18 11:45:24 +0000 UTC - event for pod-exec-websocket-bcecdfc1-0c3c-45a9-8652-d4ffebd4fba3: {kubelet node1} Failed: Error: ImagePullBackOff Aug 18 11:50:21.258: INFO: POD NODE PHASE GRACE CONDITIONS Aug 18 11:50:21.258: INFO: pod-exec-websocket-bcecdfc1-0c3c-45a9-8652-d4ffebd4fba3 node1 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:45:21 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:45:21 +0000 UTC ContainersNotReady containers with unready status: [main]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:45:21 +0000 UTC ContainersNotReady containers with unready status: [main]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:45:21 +0000 UTC }] Aug 18 11:50:21.258: INFO: Aug 18 11:50:21.263: INFO: Logging node info for node master1 Aug 18 11:50:21.265: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 ebb211fa-503f-4cfe-b1ed-c95d27a70e6e 72101 0 2021-08-18 08:20:52 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"3a:82:be:72:b5:15"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:20:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:20:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:25:59 +0000 UTC,LastTransitionTime:2021-08-18 08:25:59 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:50:17 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:50:17 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:50:17 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:50:17 +0000 UTC,LastTransitionTime:2021-08-18 08:25:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:58c3e57359b641ad92fa1959f2fecf5d,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:012cd796-2076-45d6-8b14-d3e0451b1e64,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[@ :],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:50:21.265: INFO: Logging kubelet events for node master1 Aug 18 11:50:21.268: INFO: Logging pods the kubelet thinks is on node master1 Aug 18 11:50:21.276: INFO: kube-apiserver-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:21.276: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:50:21.276: INFO: kube-proxy-vqk4v started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:21.276: INFO: Container kube-proxy ready: true, restart count 1 Aug 18 11:50:21.276: INFO: kube-flannel-q64cq started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:50:21.276: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:50:21.276: INFO: Container kube-flannel ready: true, restart count 3 Aug 18 11:50:21.276: INFO: coredns-7677f9bb54-kn2qg started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:21.276: INFO: Container coredns ready: true, restart count 2 Aug 18 11:50:21.276: INFO: kube-scheduler-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:21.277: INFO: Container kube-scheduler ready: true, restart count 0 Aug 18 11:50:21.277: INFO: kube-controller-manager-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:21.277: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:50:21.277: INFO: kube-multus-ds-amd64-kbcp6 started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:21.277: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:50:21.277: INFO: docker-registry-docker-registry-56cbc7bc58-49kl2 started at 2021-08-18 08:26:23 +0000 UTC (0+2 container statuses recorded) Aug 18 11:50:21.277: INFO: Container docker-registry ready: true, restart count 0 Aug 18 11:50:21.277: INFO: Container nginx ready: true, restart count 0 Aug 18 11:50:21.277: INFO: node-exporter-5hwz9 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:50:21.277: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:50:21.277: INFO: Container node-exporter ready: true, restart count 0 W0818 11:50:21.290248 30 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:50:21.313: INFO: Latency metrics for node master1 Aug 18 11:50:21.313: INFO: Logging node info for node master2 Aug 18 11:50:21.315: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 78946293-3abe-4442-84d4-8ed6b1d15ce0 72099 0 2021-08-18 08:21:31 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"7e:f5:c2:cc:3a:b4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:21:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:21:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-08-18 08:29:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:50:16 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:50:16 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:50:16 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:50:16 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0c44122c7a7248c18d8571e1cc667258,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:0cd329f2-48e0-4c8f-b8b9-fa3ae0ed8406,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:50:21.316: INFO: Logging kubelet events for node master2 Aug 18 11:50:21.318: INFO: Logging pods the kubelet thinks is on node master2 Aug 18 11:50:21.327: INFO: node-feature-discovery-controller-5bf5c49849-mq57c started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:21.327: INFO: Container nfd-controller ready: true, restart count 0 Aug 18 11:50:21.327: INFO: node-exporter-48nfx started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:50:21.327: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:50:21.327: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:50:21.327: INFO: kube-apiserver-master2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:21.327: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:50:21.327: INFO: kube-scheduler-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:21.327: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:50:21.327: INFO: kube-multus-ds-amd64-mld8g started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:21.327: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:50:21.327: INFO: dns-autoscaler-5b7b5c9b6f-hh47r started at 2021-08-18 08:23:57 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:21.327: INFO: Container autoscaler ready: true, restart count 2 Aug 18 11:50:21.327: INFO: kube-controller-manager-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:21.327: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:50:21.327: INFO: kube-proxy-kh2l9 started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:21.327: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:50:21.327: INFO: kube-flannel-pp56h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:50:21.327: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:50:21.327: INFO: Container kube-flannel ready: true, restart count 1 W0818 11:50:21.339951 30 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:50:21.363: INFO: Latency metrics for node master2 Aug 18 11:50:21.363: INFO: Logging node info for node master3 Aug 18 11:50:21.365: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 44feac2b-9447-4be2-9fcd-62f836d67c72 72073 0 2021-08-18 08:21:41 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"86:e4:31:99:58:40"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {kubelet Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:50:11 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:50:11 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:50:11 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:50:11 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1fae19ae59884c44899bcd08aa243244,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:5db926c5-6530-4635-a0d5-806974a3b732,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:50:21.366: INFO: Logging kubelet events for node master3 Aug 18 11:50:21.368: INFO: Logging pods the kubelet thinks is on node master3 Aug 18 11:50:21.375: INFO: kube-scheduler-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:21.375: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:50:21.375: INFO: kube-apiserver-master3 started at 2021-08-18 08:29:12 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:21.375: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:50:21.375: INFO: kube-proxy-sd5lc started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:21.375: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:50:21.375: INFO: kube-flannel-x6tlr started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:50:21.375: INFO: Init container install-cni ready: true, restart count 1 Aug 18 11:50:21.375: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:50:21.375: INFO: kube-multus-ds-amd64-bkw6c started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:21.375: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:50:21.375: INFO: coredns-7677f9bb54-5hxfh started at 2021-08-18 08:23:54 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:21.375: INFO: Container coredns ready: true, restart count 1 Aug 18 11:50:21.375: INFO: node-exporter-vq7d8 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:50:21.375: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:50:21.375: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:50:21.375: INFO: kube-controller-manager-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:21.375: INFO: Container kube-controller-manager ready: true, restart count 2 W0818 11:50:21.386994 30 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:50:21.410: INFO: Latency metrics for node master3 Aug 18 11:50:21.410: INFO: Logging node info for node node1 Aug 18 11:50:21.412: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 84defabd-6ebf-43ec-a629-44c6713da9c9 72084 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"9a:87:55:36:7b:df"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:13 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:35 +0000 UTC,LastTransitionTime:2021-08-18 08:26:35 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:50:13 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:50:13 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:50:13 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:50:13 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:69946ff2b7bc462fa25eb7adb4703c23,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:736dc52f-f5e3-494e-86ca-01eedbea015c,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:a7cea43d9d2f67c38fbf0407786edbe660ee9072945f7bb272b55fd255e8eaca opnfv/barometer-collectd:stable],SizeBytes:1075746799,},ContainerImage{Names:[@ :],SizeBytes:1003788820,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[aquasec/kube-hunter@sha256:2be6820bc1d7e0f57193a9a27d5a3e16b2fd93c53747b03ce8ca48c6fc323781 aquasec/kube-hunter:0.3.1],SizeBytes:347611549,},ContainerImage{Names:[golang@sha256:db2475a1dbb2149508e5db31d7d77a75e6600d54be645f37681f03f2762169ba golang:alpine3.12],SizeBytes:301186719,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:de25c7fc6c4f3a27c7f0c2dff454e4671823a34d88abd533f210848d527e0fbb alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:50:21.413: INFO: Logging kubelet events for node node1 Aug 18 11:50:21.416: INFO: Logging pods the kubelet thinks is on node node1 Aug 18 11:50:21.432: INFO: cmk-d8r27 started at 2021-08-18 08:32:52 +0000 UTC (0+2 container statuses recorded) Aug 18 11:50:21.432: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:50:21.432: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:50:21.432: INFO: collectd-xdprr started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:50:21.432: INFO: Container collectd ready: true, restart count 0 Aug 18 11:50:21.432: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:50:21.432: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:50:21.432: INFO: kube-proxy-p6jvp started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:21.432: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:50:21.432: INFO: kubernetes-metrics-scraper-678c97765c-9nsv5 started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:21.432: INFO: Container kubernetes-metrics-scraper ready: true, restart count 2 Aug 18 11:50:21.432: INFO: cmk-init-discover-node1-bxznx started at 2021-08-18 08:32:10 +0000 UTC (0+3 container statuses recorded) Aug 18 11:50:21.432: INFO: Container discover ready: false, restart count 0 Aug 18 11:50:21.432: INFO: Container init ready: false, restart count 0 Aug 18 11:50:21.432: INFO: Container install ready: false, restart count 0 Aug 18 11:50:21.432: INFO: pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975 started at 2021-08-18 11:47:15 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:21.432: INFO: Container secret-env-test ready: false, restart count 0 Aug 18 11:50:21.432: INFO: var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209 started at 2021-08-18 11:47:57 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:21.432: INFO: Container dapi-container ready: false, restart count 0 Aug 18 11:50:21.432: INFO: affinity-nodeport-f9b5h started at 2021-08-18 11:49:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:21.432: INFO: Container affinity-nodeport ready: true, restart count 0 Aug 18 11:50:21.432: INFO: nginx-proxy-node1 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:21.432: INFO: Container nginx-proxy ready: true, restart count 2 Aug 18 11:50:21.432: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-vsxvg started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:21.432: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:50:21.432: INFO: affinity-nodeport-timeout-6vmxz started at 2021-08-18 11:49:43 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:21.432: INFO: Container affinity-nodeport-timeout ready: true, restart count 0 Aug 18 11:50:21.432: INFO: kube-flannel-q78nd started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:50:21.432: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:50:21.432: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:50:21.432: INFO: prometheus-k8s-0 started at 2021-08-18 08:34:03 +0000 UTC (0+5 container statuses recorded) Aug 18 11:50:21.432: INFO: Container custom-metrics-apiserver ready: true, restart count 0 Aug 18 11:50:21.432: INFO: Container grafana ready: true, restart count 0 Aug 18 11:50:21.432: INFO: Container prometheus ready: true, restart count 1 Aug 18 11:50:21.432: INFO: Container prometheus-config-reloader ready: true, restart count 0 Aug 18 11:50:21.432: INFO: Container rules-configmap-reloader ready: true, restart count 0 Aug 18 11:50:21.432: INFO: pod-exec-websocket-bcecdfc1-0c3c-45a9-8652-d4ffebd4fba3 started at 2021-08-18 11:45:21 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:21.432: INFO: Container main ready: false, restart count 0 Aug 18 11:50:21.432: INFO: ss-0 started at 2021-08-18 11:47:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:21.432: INFO: Container webserver ready: false, restart count 0 Aug 18 11:50:21.432: INFO: execpod-affinitycdhts started at 2021-08-18 11:49:49 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:21.432: INFO: Container agnhost-container ready: true, restart count 0 Aug 18 11:50:21.432: INFO: kube-multus-ds-amd64-rrvmb started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:21.432: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:50:21.432: INFO: node-feature-discovery-worker-pflgw started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:21.432: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:50:21.432: INFO: node-exporter-kcwvn started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:50:21.432: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:50:21.432: INFO: Container node-exporter ready: true, restart count 0 W0818 11:50:21.444891 30 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:50:21.477: INFO: Latency metrics for node node1 Aug 18 11:50:21.477: INFO: Logging node info for node node2 Aug 18 11:50:21.480: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 1d01177e-3dbb-48a1-a0bc-d18af27ab7f8 72109 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:d1:47:f8:1d:22"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:36 +0000 UTC,LastTransitionTime:2021-08-18 08:26:36 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:50:19 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:50:19 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:50:19 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:50:19 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:dc1f286135c145349b8a016880b65a2f,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:037e7e2d-94e9-42f4-a719-896e5005ac70,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:50:21.481: INFO: Logging kubelet events for node node2 Aug 18 11:50:21.483: INFO: Logging pods the kubelet thinks is on node node2 Aug 18 11:50:21.497: INFO: cmk-webhook-6c9d5f8578-7cxjr started at 2021-08-18 08:32:53 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:21.497: INFO: Container cmk-webhook ready: true, restart count 0 Aug 18 11:50:21.497: INFO: execpod-affinityk47wl started at 2021-08-18 11:50:05 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:21.497: INFO: Container agnhost-container ready: true, restart count 0 Aug 18 11:50:21.497: INFO: kube-flannel-h7t5h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:50:21.497: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:50:21.497: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:50:21.497: INFO: node-exporter-lrrf2 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:50:21.497: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:50:21.497: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:50:21.497: INFO: affinity-nodeport-qvd62 started at 2021-08-18 11:49:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:21.497: INFO: Container affinity-nodeport ready: true, restart count 0 Aug 18 11:50:21.497: INFO: pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70 started at 2021-08-18 11:46:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:21.497: INFO: Container env-test ready: false, restart count 0 Aug 18 11:50:21.497: INFO: affinity-nodeport-timeout-qkg67 started at 2021-08-18 11:49:43 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:21.497: INFO: Container affinity-nodeport-timeout ready: true, restart count 0 Aug 18 11:50:21.497: INFO: affinity-nodeport-cc62g started at 2021-08-18 11:49:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:21.497: INFO: Container affinity-nodeport ready: true, restart count 0 Aug 18 11:50:21.497: INFO: nginx-proxy-node2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:21.497: INFO: Container nginx-proxy ready: true, restart count 1 Aug 18 11:50:21.497: INFO: cmk-init-discover-node2-6b2kz started at 2021-08-18 08:32:30 +0000 UTC (0+3 container statuses recorded) Aug 18 11:50:21.497: INFO: Container discover ready: false, restart count 0 Aug 18 11:50:21.497: INFO: Container init ready: false, restart count 0 Aug 18 11:50:21.497: INFO: Container install ready: false, restart count 0 Aug 18 11:50:21.497: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-7rn45 started at 2021-08-18 08:36:42 +0000 UTC (0+2 container statuses recorded) Aug 18 11:50:21.497: INFO: Container tas-controller ready: true, restart count 0 Aug 18 11:50:21.497: INFO: Container tas-extender ready: true, restart count 0 Aug 18 11:50:21.497: INFO: kubernetes-dashboard-86c6f9df5b-qrtdk started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:21.497: INFO: Container kubernetes-dashboard ready: true, restart count 2 Aug 18 11:50:21.497: INFO: cmk-748rz started at 2021-08-18 08:32:53 +0000 UTC (0+2 container statuses recorded) Aug 18 11:50:21.497: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:50:21.497: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:50:21.497: INFO: affinity-nodeport-timeout-jfknb started at 2021-08-18 11:49:43 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:21.497: INFO: Container affinity-nodeport-timeout ready: true, restart count 0 Aug 18 11:50:21.497: INFO: prometheus-operator-5bb8cb9d8f-k97ws started at 2021-08-18 08:33:38 +0000 UTC (0+2 container statuses recorded) Aug 18 11:50:21.497: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:50:21.497: INFO: Container prometheus-operator ready: true, restart count 0 Aug 18 11:50:21.497: INFO: kube-proxy-qkj9c started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:21.497: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:50:21.497: INFO: node-feature-discovery-worker-hzpf5 started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:21.497: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:50:21.497: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-c82pt started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:21.497: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:50:21.497: INFO: bin-falsea5f6898f-c6c3-4680-9cbd-f4985908f73e started at 2021-08-18 11:49:10 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:21.497: INFO: Container bin-falsea5f6898f-c6c3-4680-9cbd-f4985908f73e ready: false, restart count 0 Aug 18 11:50:21.497: INFO: kube-multus-ds-amd64-rvzsg started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:21.497: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:50:21.497: INFO: collectd-67ntq started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:50:21.497: INFO: Container collectd ready: true, restart count 0 Aug 18 11:50:21.497: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:50:21.497: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:50:21.497: INFO: ss-0 started at 2021-08-18 11:46:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:50:21.497: INFO: Container webserver ready: false, restart count 0 W0818 11:50:21.510363 30 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:50:21.584: INFO: Latency metrics for node node2 Aug 18 11:50:21.584: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "pods-1730" for this suite. • Failure [300.383 seconds] [k8s.io] Pods /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 should support remote command execution over websockets [NodeConformance] [Conformance] [It] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:50:21.251: Unexpected error: <*errors.errorString | 0xc0002801f0>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:103 ------------------------------ {"msg":"FAILED [k8s.io] Pods should support remote command execution over websockets [NodeConformance] [Conformance]","total":-1,"completed":23,"skipped":375,"failed":4,"failures":["[sig-apps] Deployment RollingUpdateDeployment should delete old pods and create new ones [Conformance]","[sig-storage] ConfigMap binary data should be reflected in volume [NodeConformance] [Conformance]","[k8s.io] Kubelet when scheduling a busybox command in a pod should print the output to logs [NodeConformance] [Conformance]","[k8s.io] Pods should support remote command execution over websockets [NodeConformance] [Conformance]"]} SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-storage] EmptyDir volumes /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:50:21.729: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename emptydir STEP: Waiting for a default service account to be provisioned in namespace [It] should support (non-root,0644,tmpfs) [LinuxOnly] [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating a pod to test emptydir 0644 on tmpfs Aug 18 11:50:21.769: INFO: Waiting up to 5m0s for pod "pod-95018a05-8558-4b46-b267-28320fa98948" in namespace "emptydir-2684" to be "Succeeded or Failed" Aug 18 11:50:21.771: INFO: Pod "pod-95018a05-8558-4b46-b267-28320fa98948": Phase="Pending", Reason="", readiness=false. Elapsed: 1.893373ms Aug 18 11:50:23.774: INFO: Pod "pod-95018a05-8558-4b46-b267-28320fa98948": Phase="Pending", Reason="", readiness=false. Elapsed: 2.005432593s Aug 18 11:50:25.778: INFO: Pod "pod-95018a05-8558-4b46-b267-28320fa98948": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.009221453s STEP: Saw pod success Aug 18 11:50:25.778: INFO: Pod "pod-95018a05-8558-4b46-b267-28320fa98948" satisfied condition "Succeeded or Failed" Aug 18 11:50:25.781: INFO: Trying to get logs from node node1 pod pod-95018a05-8558-4b46-b267-28320fa98948 container test-container: STEP: delete the pod Aug 18 11:50:25.793: INFO: Waiting for pod pod-95018a05-8558-4b46-b267-28320fa98948 to disappear Aug 18 11:50:25.795: INFO: Pod pod-95018a05-8558-4b46-b267-28320fa98948 no longer exists [AfterEach] [sig-storage] EmptyDir volumes /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:50:25.795: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "emptydir-2684" for this suite. • ------------------------------ {"msg":"PASSED [sig-storage] EmptyDir volumes should support (non-root,0644,tmpfs) [LinuxOnly] [NodeConformance] [Conformance]","total":-1,"completed":24,"skipped":467,"failed":4,"failures":["[sig-apps] Deployment RollingUpdateDeployment should delete old pods and create new ones [Conformance]","[sig-storage] ConfigMap binary data should be reflected in volume [NodeConformance] [Conformance]","[k8s.io] Kubelet when scheduling a busybox command in a pod should print the output to logs [NodeConformance] [Conformance]","[k8s.io] Pods should support remote command execution over websockets [NodeConformance] [Conformance]"]} SSSSSSSSS ------------------------------ [BeforeEach] [sig-storage] Downward API volume /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:50:25.822: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename downward-api STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-storage] Downward API volume /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/downwardapi_volume.go:42 [It] should provide podname only [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating a pod to test downward API volume plugin Aug 18 11:50:25.856: INFO: Waiting up to 5m0s for pod "downwardapi-volume-f20162fc-1b88-47b2-bc70-b16ba3cdb848" in namespace "downward-api-7523" to be "Succeeded or Failed" Aug 18 11:50:25.858: INFO: Pod "downwardapi-volume-f20162fc-1b88-47b2-bc70-b16ba3cdb848": Phase="Pending", Reason="", readiness=false. Elapsed: 1.963642ms Aug 18 11:50:27.862: INFO: Pod "downwardapi-volume-f20162fc-1b88-47b2-bc70-b16ba3cdb848": Phase="Pending", Reason="", readiness=false. Elapsed: 2.005111116s Aug 18 11:50:29.865: INFO: Pod "downwardapi-volume-f20162fc-1b88-47b2-bc70-b16ba3cdb848": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.008337353s STEP: Saw pod success Aug 18 11:50:29.865: INFO: Pod "downwardapi-volume-f20162fc-1b88-47b2-bc70-b16ba3cdb848" satisfied condition "Succeeded or Failed" Aug 18 11:50:29.868: INFO: Trying to get logs from node node1 pod downwardapi-volume-f20162fc-1b88-47b2-bc70-b16ba3cdb848 container client-container: STEP: delete the pod Aug 18 11:50:29.882: INFO: Waiting for pod downwardapi-volume-f20162fc-1b88-47b2-bc70-b16ba3cdb848 to disappear Aug 18 11:50:29.883: INFO: Pod downwardapi-volume-f20162fc-1b88-47b2-bc70-b16ba3cdb848 no longer exists [AfterEach] [sig-storage] Downward API volume /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:50:29.883: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "downward-api-7523" for this suite. • ------------------------------ [BeforeEach] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:50:05.818: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename crd-publish-openapi STEP: Waiting for a default service account to be provisioned in namespace [It] works for multiple CRDs of same group and version but different kinds [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: CRs in the same group and version but different kinds (two CRDs) show up in OpenAPI documentation Aug 18 11:50:05.839: INFO: >>> kubeConfig: /root/.kube/config Aug 18 11:50:13.733: INFO: >>> kubeConfig: /root/.kube/config [AfterEach] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:50:30.414: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "crd-publish-openapi-9895" for this suite. • [SLOW TEST:24.604 seconds] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23 works for multiple CRDs of same group and version but different kinds [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] works for multiple CRDs of same group and version but different kinds [Conformance]","total":-1,"completed":17,"skipped":243,"failed":4,"failures":["[sig-apps] Deployment deployment should support rollover [Conformance]","[sig-network] Services should be able to switch session affinity for NodePort service [LinuxOnly] [Conformance]","[sig-node] Downward API should provide container's limits.cpu/memory and requests.cpu/memory as env vars [NodeConformance] [Conformance]","[k8s.io] [sig-node] PreStop should call prestop when killing a pod [Conformance]"]} SSSS ------------------------------ {"msg":"PASSED [sig-storage] Downward API volume should provide podname only [NodeConformance] [Conformance]","total":-1,"completed":25,"skipped":476,"failed":4,"failures":["[sig-apps] Deployment RollingUpdateDeployment should delete old pods and create new ones [Conformance]","[sig-storage] ConfigMap binary data should be reflected in volume [NodeConformance] [Conformance]","[k8s.io] Kubelet when scheduling a busybox command in a pod should print the output to logs [NodeConformance] [Conformance]","[k8s.io] Pods should support remote command execution over websockets [NodeConformance] [Conformance]"]} [BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:50:29.893: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename webhook STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:87 STEP: Setting up server cert STEP: Create role binding to let webhook read extension-apiserver-authentication STEP: Deploying the webhook pod STEP: Wait for the deployment to be ready Aug 18 11:50:30.220: INFO: deployment "sample-webhook-deployment" doesn't have the required revision set Aug 18 11:50:32.231: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764884230, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764884230, loc:(*time.Location)(0x77169a0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764884230, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764884230, loc:(*time.Location)(0x77169a0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-cbccbf6bb\" is progressing."}}, CollisionCount:(*int32)(nil)} STEP: Deploying the webhook service STEP: Verifying the service has paired with the endpoint Aug 18 11:50:35.243: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1 [It] should honor timeout [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Setting timeout (1s) shorter than webhook latency (5s) STEP: Registering slow webhook via the AdmissionRegistration API STEP: Request fails when timeout (1s) is shorter than slow webhook latency (5s) STEP: Having no error when timeout is shorter than webhook latency and failure policy is ignore STEP: Registering slow webhook via the AdmissionRegistration API STEP: Having no error when timeout is longer than webhook latency STEP: Registering slow webhook via the AdmissionRegistration API STEP: Having no error when timeout is empty (defaulted to 10s in v1) STEP: Registering slow webhook via the AdmissionRegistration API [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:50:47.334: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "webhook-495" for this suite. STEP: Destroying namespace "webhook-495-markers" for this suite. [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:102 • [SLOW TEST:17.476 seconds] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23 should honor timeout [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should honor timeout [Conformance]","total":-1,"completed":26,"skipped":476,"failed":4,"failures":["[sig-apps] Deployment RollingUpdateDeployment should delete old pods and create new ones [Conformance]","[sig-storage] ConfigMap binary data should be reflected in volume [NodeConformance] [Conformance]","[k8s.io] Kubelet when scheduling a busybox command in a pod should print the output to logs [NodeConformance] [Conformance]","[k8s.io] Pods should support remote command execution over websockets [NodeConformance] [Conformance]"]} SSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-storage] Downward API volume /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:50:47.419: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename downward-api STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-storage] Downward API volume /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/downwardapi_volume.go:42 [It] should update labels on modification [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating the pod Aug 18 11:50:51.981: INFO: Successfully updated pod "labelsupdatef3e840c4-50d9-420d-b2db-a71cb5a61a68" [AfterEach] [sig-storage] Downward API volume /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:50:53.994: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "downward-api-4494" for this suite. • [SLOW TEST:6.583 seconds] [sig-storage] Downward API volume /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/downwardapi_volume.go:37 should update labels on modification [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-storage] Downward API volume should update labels on modification [NodeConformance] [Conformance]","total":-1,"completed":27,"skipped":504,"failed":4,"failures":["[sig-apps] Deployment RollingUpdateDeployment should delete old pods and create new ones [Conformance]","[sig-storage] ConfigMap binary data should be reflected in volume [NodeConformance] [Conformance]","[k8s.io] Kubelet when scheduling a busybox command in a pod should print the output to logs [NodeConformance] [Conformance]","[k8s.io] Pods should support remote command execution over websockets [NodeConformance] [Conformance]"]} SSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-storage] EmptyDir volumes /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:50:54.040: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename emptydir STEP: Waiting for a default service account to be provisioned in namespace [It] volume on tmpfs should have the correct mode [LinuxOnly] [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating a pod to test emptydir volume type on tmpfs Aug 18 11:50:54.071: INFO: Waiting up to 5m0s for pod "pod-e9470003-33cd-4567-a6cc-999ef8d5efb1" in namespace "emptydir-7359" to be "Succeeded or Failed" Aug 18 11:50:54.073: INFO: Pod "pod-e9470003-33cd-4567-a6cc-999ef8d5efb1": Phase="Pending", Reason="", readiness=false. Elapsed: 2.062746ms Aug 18 11:50:56.076: INFO: Pod "pod-e9470003-33cd-4567-a6cc-999ef8d5efb1": Phase="Pending", Reason="", readiness=false. Elapsed: 2.004321587s Aug 18 11:50:58.079: INFO: Pod "pod-e9470003-33cd-4567-a6cc-999ef8d5efb1": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.007236732s STEP: Saw pod success Aug 18 11:50:58.079: INFO: Pod "pod-e9470003-33cd-4567-a6cc-999ef8d5efb1" satisfied condition "Succeeded or Failed" Aug 18 11:50:58.081: INFO: Trying to get logs from node node1 pod pod-e9470003-33cd-4567-a6cc-999ef8d5efb1 container test-container: STEP: delete the pod Aug 18 11:50:58.095: INFO: Waiting for pod pod-e9470003-33cd-4567-a6cc-999ef8d5efb1 to disappear Aug 18 11:50:58.097: INFO: Pod pod-e9470003-33cd-4567-a6cc-999ef8d5efb1 no longer exists [AfterEach] [sig-storage] EmptyDir volumes /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:50:58.097: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "emptydir-7359" for this suite. • ------------------------------ {"msg":"PASSED [sig-storage] EmptyDir volumes volume on tmpfs should have the correct mode [LinuxOnly] [NodeConformance] [Conformance]","total":-1,"completed":28,"skipped":525,"failed":4,"failures":["[sig-apps] Deployment RollingUpdateDeployment should delete old pods and create new ones [Conformance]","[sig-storage] ConfigMap binary data should be reflected in volume [NodeConformance] [Conformance]","[k8s.io] Kubelet when scheduling a busybox command in a pod should print the output to logs [NodeConformance] [Conformance]","[k8s.io] Pods should support remote command execution over websockets [NodeConformance] [Conformance]"]} SSSS ------------------------------ [BeforeEach] [sig-storage] Downward API volume /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:50:58.115: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename downward-api STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-storage] Downward API volume /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/downwardapi_volume.go:42 [It] should provide node allocatable (memory) as default memory limit if the limit is not set [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating a pod to test downward API volume plugin Aug 18 11:50:58.147: INFO: Waiting up to 5m0s for pod "downwardapi-volume-b75f0099-ae50-46e0-b313-65f52bb17fe7" in namespace "downward-api-7524" to be "Succeeded or Failed" Aug 18 11:50:58.149: INFO: Pod "downwardapi-volume-b75f0099-ae50-46e0-b313-65f52bb17fe7": Phase="Pending", Reason="", readiness=false. Elapsed: 2.194305ms Aug 18 11:51:00.154: INFO: Pod "downwardapi-volume-b75f0099-ae50-46e0-b313-65f52bb17fe7": Phase="Pending", Reason="", readiness=false. Elapsed: 2.006333624s Aug 18 11:51:02.157: INFO: Pod "downwardapi-volume-b75f0099-ae50-46e0-b313-65f52bb17fe7": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.009996694s STEP: Saw pod success Aug 18 11:51:02.157: INFO: Pod "downwardapi-volume-b75f0099-ae50-46e0-b313-65f52bb17fe7" satisfied condition "Succeeded or Failed" Aug 18 11:51:02.159: INFO: Trying to get logs from node node1 pod downwardapi-volume-b75f0099-ae50-46e0-b313-65f52bb17fe7 container client-container: STEP: delete the pod Aug 18 11:51:02.174: INFO: Waiting for pod downwardapi-volume-b75f0099-ae50-46e0-b313-65f52bb17fe7 to disappear Aug 18 11:51:02.176: INFO: Pod downwardapi-volume-b75f0099-ae50-46e0-b313-65f52bb17fe7 no longer exists [AfterEach] [sig-storage] Downward API volume /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:51:02.176: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "downward-api-7524" for this suite. • ------------------------------ {"msg":"PASSED [sig-storage] Downward API volume should provide node allocatable (memory) as default memory limit if the limit is not set [NodeConformance] [Conformance]","total":-1,"completed":29,"skipped":529,"failed":4,"failures":["[sig-apps] Deployment RollingUpdateDeployment should delete old pods and create new ones [Conformance]","[sig-storage] ConfigMap binary data should be reflected in volume [NodeConformance] [Conformance]","[k8s.io] Kubelet when scheduling a busybox command in a pod should print the output to logs [NodeConformance] [Conformance]","[k8s.io] Pods should support remote command execution over websockets [NodeConformance] [Conformance]"]} SSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:51:02.237: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename webhook STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:87 STEP: Setting up server cert STEP: Create role binding to let webhook read extension-apiserver-authentication STEP: Deploying the webhook pod STEP: Wait for the deployment to be ready Aug 18 11:51:02.757: INFO: deployment "sample-webhook-deployment" doesn't have the required revision set Aug 18 11:51:04.765: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764884262, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764884262, loc:(*time.Location)(0x77169a0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764884262, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764884262, loc:(*time.Location)(0x77169a0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-cbccbf6bb\" is progressing."}}, CollisionCount:(*int32)(nil)} STEP: Deploying the webhook service STEP: Verifying the service has paired with the endpoint Aug 18 11:51:07.776: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1 [It] should be able to deny attaching pod [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Registering the webhook via the AdmissionRegistration API STEP: create a pod STEP: 'kubectl attach' the pod, should be denied by the webhook Aug 18 11:51:11.805: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=webhook-1795 attach --namespace=webhook-1795 to-be-attached-pod -i -c=container1' Aug 18 11:51:11.978: INFO: rc: 1 [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:51:11.985: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "webhook-1795" for this suite. STEP: Destroying namespace "webhook-1795-markers" for this suite. [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:102 • [SLOW TEST:9.785 seconds] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23 should be able to deny attaching pod [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should be able to deny attaching pod [Conformance]","total":-1,"completed":30,"skipped":558,"failed":4,"failures":["[sig-apps] Deployment RollingUpdateDeployment should delete old pods and create new ones [Conformance]","[sig-storage] ConfigMap binary data should be reflected in volume [NodeConformance] [Conformance]","[k8s.io] Kubelet when scheduling a busybox command in a pod should print the output to logs [NodeConformance] [Conformance]","[k8s.io] Pods should support remote command execution over websockets [NodeConformance] [Conformance]"]} SS ------------------------------ [BeforeEach] [sig-storage] Subpath /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:51:12.029: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename subpath STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] Atomic writer volumes /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/subpath.go:38 STEP: Setting up data [It] should support subpaths with configmap pod with mountPath of existing file [LinuxOnly] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating pod pod-subpath-test-configmap-g49f STEP: Creating a pod to test atomic-volume-subpath Aug 18 11:51:12.078: INFO: Waiting up to 5m0s for pod "pod-subpath-test-configmap-g49f" in namespace "subpath-5291" to be "Succeeded or Failed" Aug 18 11:51:12.080: INFO: Pod "pod-subpath-test-configmap-g49f": Phase="Pending", Reason="", readiness=false. Elapsed: 2.073171ms Aug 18 11:51:14.082: INFO: Pod "pod-subpath-test-configmap-g49f": Phase="Pending", Reason="", readiness=false. Elapsed: 2.004422187s Aug 18 11:51:16.086: INFO: Pod "pod-subpath-test-configmap-g49f": Phase="Pending", Reason="", readiness=false. Elapsed: 4.008031186s Aug 18 11:51:18.089: INFO: Pod "pod-subpath-test-configmap-g49f": Phase="Running", Reason="", readiness=true. Elapsed: 6.010957167s Aug 18 11:51:20.091: INFO: Pod "pod-subpath-test-configmap-g49f": Phase="Running", Reason="", readiness=true. Elapsed: 8.013799368s Aug 18 11:51:22.095: INFO: Pod "pod-subpath-test-configmap-g49f": Phase="Running", Reason="", readiness=true. Elapsed: 10.017205942s Aug 18 11:51:24.097: INFO: Pod "pod-subpath-test-configmap-g49f": Phase="Running", Reason="", readiness=true. Elapsed: 12.019603929s Aug 18 11:51:26.100: INFO: Pod "pod-subpath-test-configmap-g49f": Phase="Running", Reason="", readiness=true. Elapsed: 14.022832707s Aug 18 11:51:28.104: INFO: Pod "pod-subpath-test-configmap-g49f": Phase="Running", Reason="", readiness=true. Elapsed: 16.026874745s Aug 18 11:51:30.107: INFO: Pod "pod-subpath-test-configmap-g49f": Phase="Running", Reason="", readiness=true. Elapsed: 18.029654495s Aug 18 11:51:32.110: INFO: Pod "pod-subpath-test-configmap-g49f": Phase="Running", Reason="", readiness=true. Elapsed: 20.032587639s Aug 18 11:51:34.113: INFO: Pod "pod-subpath-test-configmap-g49f": Phase="Running", Reason="", readiness=true. Elapsed: 22.035416548s Aug 18 11:51:36.116: INFO: Pod "pod-subpath-test-configmap-g49f": Phase="Running", Reason="", readiness=true. Elapsed: 24.03799774s Aug 18 11:51:38.119: INFO: Pod "pod-subpath-test-configmap-g49f": Phase="Succeeded", Reason="", readiness=false. Elapsed: 26.041619035s STEP: Saw pod success Aug 18 11:51:38.119: INFO: Pod "pod-subpath-test-configmap-g49f" satisfied condition "Succeeded or Failed" Aug 18 11:51:38.121: INFO: Trying to get logs from node node2 pod pod-subpath-test-configmap-g49f container test-container-subpath-configmap-g49f: STEP: delete the pod Aug 18 11:51:38.135: INFO: Waiting for pod pod-subpath-test-configmap-g49f to disappear Aug 18 11:51:38.136: INFO: Pod pod-subpath-test-configmap-g49f no longer exists STEP: Deleting pod pod-subpath-test-configmap-g49f Aug 18 11:51:38.136: INFO: Deleting pod "pod-subpath-test-configmap-g49f" in namespace "subpath-5291" [AfterEach] [sig-storage] Subpath /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:51:38.138: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "subpath-5291" for this suite. • [SLOW TEST:26.117 seconds] [sig-storage] Subpath /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/framework.go:23 Atomic writer volumes /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/subpath.go:34 should support subpaths with configmap pod with mountPath of existing file [LinuxOnly] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-storage] Subpath Atomic writer volumes should support subpaths with configmap pod with mountPath of existing file [LinuxOnly] [Conformance]","total":-1,"completed":31,"skipped":560,"failed":4,"failures":["[sig-apps] Deployment RollingUpdateDeployment should delete old pods and create new ones [Conformance]","[sig-storage] ConfigMap binary data should be reflected in volume [NodeConformance] [Conformance]","[k8s.io] Kubelet when scheduling a busybox command in a pod should print the output to logs [NodeConformance] [Conformance]","[k8s.io] Pods should support remote command execution over websockets [NodeConformance] [Conformance]"]} SSSSSSSS ------------------------------ [BeforeEach] [sig-api-machinery] Events /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:51:38.163: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename events STEP: Waiting for a default service account to be provisioned in namespace [It] should delete a collection of events [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Create set of events Aug 18 11:51:38.187: INFO: created test-event-1 Aug 18 11:51:38.190: INFO: created test-event-2 Aug 18 11:51:38.194: INFO: created test-event-3 STEP: get a list of Events with a label in the current namespace STEP: delete collection of events Aug 18 11:51:38.196: INFO: requesting DeleteCollection of events STEP: check that the list of events matches the requested quantity Aug 18 11:51:38.209: INFO: requesting list of events to confirm quantity [AfterEach] [sig-api-machinery] Events /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:51:38.211: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "events-543" for this suite. • ------------------------------ {"msg":"PASSED [sig-api-machinery] Events should delete a collection of events [Conformance]","total":-1,"completed":32,"skipped":568,"failed":4,"failures":["[sig-apps] Deployment RollingUpdateDeployment should delete old pods and create new ones [Conformance]","[sig-storage] ConfigMap binary data should be reflected in volume [NodeConformance] [Conformance]","[k8s.io] Kubelet when scheduling a busybox command in a pod should print the output to logs [NodeConformance] [Conformance]","[k8s.io] Pods should support remote command execution over websockets [NodeConformance] [Conformance]"]} SSSSSSS ------------------------------ [BeforeEach] [sig-node] ConfigMap /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:46:34.671: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename configmap STEP: Waiting for a default service account to be provisioned in namespace [It] should be consumable via environment variable [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating configMap configmap-6580/configmap-test-75b7cce9-8660-4cbf-8aa4-f5d04073c3f9 STEP: Creating a pod to test consume configMaps Aug 18 11:46:34.704: INFO: Waiting up to 5m0s for pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70" in namespace "configmap-6580" to be "Succeeded or Failed" Aug 18 11:46:34.706: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 2.335966ms Aug 18 11:46:36.709: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 2.005139716s Aug 18 11:46:38.712: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 4.008575924s Aug 18 11:46:40.715: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 6.011653252s Aug 18 11:46:42.719: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 8.015655227s Aug 18 11:46:44.722: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 10.018233861s Aug 18 11:46:46.725: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 12.020983391s Aug 18 11:46:48.729: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 14.025062632s Aug 18 11:46:50.733: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 16.029659492s Aug 18 11:46:52.736: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 18.032475861s Aug 18 11:46:54.740: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 20.036175185s Aug 18 11:46:56.743: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 22.039266854s Aug 18 11:46:58.747: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 24.042958412s Aug 18 11:47:00.752: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 26.047875257s Aug 18 11:47:02.755: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 28.051725774s Aug 18 11:47:04.759: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 30.055663018s Aug 18 11:47:06.762: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 32.058711559s Aug 18 11:47:08.767: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 34.06305038s Aug 18 11:47:10.770: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 36.066262078s Aug 18 11:47:12.773: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 38.069808487s Aug 18 11:47:14.777: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 40.072873329s Aug 18 11:47:16.781: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 42.077786708s Aug 18 11:47:18.785: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 44.081712193s Aug 18 11:47:20.791: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 46.086844s Aug 18 11:47:22.794: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 48.090500053s Aug 18 11:47:24.797: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 50.092960305s Aug 18 11:47:26.801: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 52.097544095s Aug 18 11:47:28.805: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 54.101662687s Aug 18 11:47:30.809: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 56.105110676s Aug 18 11:47:32.812: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 58.108305032s Aug 18 11:47:34.815: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.111660482s Aug 18 11:47:36.819: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.114867872s Aug 18 11:47:38.824: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.120551771s Aug 18 11:47:40.829: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.125653647s Aug 18 11:47:42.832: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.128321026s Aug 18 11:47:44.835: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.131582339s Aug 18 11:47:46.839: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.135316808s Aug 18 11:47:48.844: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.140680251s Aug 18 11:47:50.848: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.144771718s Aug 18 11:47:52.852: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.148613893s Aug 18 11:47:54.855: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.151825507s Aug 18 11:47:56.860: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.155923091s Aug 18 11:47:58.862: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.158662271s Aug 18 11:48:00.867: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.163072946s Aug 18 11:48:02.870: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.166062042s Aug 18 11:48:04.872: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.16816301s Aug 18 11:48:06.875: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.171505368s Aug 18 11:48:08.879: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.174967462s Aug 18 11:48:10.883: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.178899977s Aug 18 11:48:12.886: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.181979218s Aug 18 11:48:14.890: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.185983364s Aug 18 11:48:16.895: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.190874931s Aug 18 11:48:18.899: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.195275855s Aug 18 11:48:20.903: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.199807841s Aug 18 11:48:22.907: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.203654842s Aug 18 11:48:24.910: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.20667409s Aug 18 11:48:26.914: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.210743868s Aug 18 11:48:28.920: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.216050869s Aug 18 11:48:30.924: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.220345144s Aug 18 11:48:32.928: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.224645951s Aug 18 11:48:34.932: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.228598799s Aug 18 11:48:36.936: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.232604223s Aug 18 11:48:38.940: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.236701596s Aug 18 11:48:40.945: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.2414693s Aug 18 11:48:42.949: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.245681105s Aug 18 11:48:44.952: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.248792283s Aug 18 11:48:46.957: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.252874028s Aug 18 11:48:48.960: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.256099699s Aug 18 11:48:50.963: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.259246835s Aug 18 11:48:52.966: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.262521386s Aug 18 11:48:54.970: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.266427813s Aug 18 11:48:56.976: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.272178466s Aug 18 11:48:58.982: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.278514424s Aug 18 11:49:00.987: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.283721551s Aug 18 11:49:02.990: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.286586173s Aug 18 11:49:04.994: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.290433966s Aug 18 11:49:06.998: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.294768107s Aug 18 11:49:09.001: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.297668497s Aug 18 11:49:11.006: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.302628107s Aug 18 11:49:13.010: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.306482191s Aug 18 11:49:15.013: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.309493662s Aug 18 11:49:17.016: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.312021271s Aug 18 11:49:19.019: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.315648571s Aug 18 11:49:21.022: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.318514777s Aug 18 11:49:23.025: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.321700562s Aug 18 11:49:25.028: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.324489915s Aug 18 11:49:27.032: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.328267773s Aug 18 11:49:29.034: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.33075485s Aug 18 11:49:31.037: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.33356663s Aug 18 11:49:33.040: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.336756575s Aug 18 11:49:35.044: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.340678623s Aug 18 11:49:37.048: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.344728452s Aug 18 11:49:39.052: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.348008408s Aug 18 11:49:41.055: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.350838141s Aug 18 11:49:43.057: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.353333669s Aug 18 11:49:45.061: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.357646818s Aug 18 11:49:47.064: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.360642222s Aug 18 11:49:49.067: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.363150051s Aug 18 11:49:51.070: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.366668639s Aug 18 11:49:53.073: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.368998183s Aug 18 11:49:55.077: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.372903298s Aug 18 11:49:57.080: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.376823609s Aug 18 11:49:59.085: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.380960862s Aug 18 11:50:01.088: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.38391423s Aug 18 11:50:03.091: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.387474714s Aug 18 11:50:05.095: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.391533699s Aug 18 11:50:07.099: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.394886596s Aug 18 11:50:09.102: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.398244682s Aug 18 11:50:11.105: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.400893719s Aug 18 11:50:13.108: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.404613395s Aug 18 11:50:15.112: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.407884335s Aug 18 11:50:17.117: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.413100542s Aug 18 11:50:19.120: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.416260738s Aug 18 11:50:21.123: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.419557275s Aug 18 11:50:23.126: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.422656388s Aug 18 11:50:25.129: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.425588461s Aug 18 11:50:27.132: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.428518506s Aug 18 11:50:29.136: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.431887898s Aug 18 11:50:31.139: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.435819947s Aug 18 11:50:33.143: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.439669897s Aug 18 11:50:35.148: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.444650398s Aug 18 11:50:37.153: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.449085389s Aug 18 11:50:39.156: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.452564846s Aug 18 11:50:41.160: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.455953494s Aug 18 11:50:43.163: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.458843822s Aug 18 11:50:45.167: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.463512287s Aug 18 11:50:47.170: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.466752922s Aug 18 11:50:49.173: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.469800829s Aug 18 11:50:51.176: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.472266378s Aug 18 11:50:53.179: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.474932403s Aug 18 11:50:55.182: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.478202692s Aug 18 11:50:57.187: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.483633079s Aug 18 11:50:59.190: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.486472221s Aug 18 11:51:01.195: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.491204189s Aug 18 11:51:03.198: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.494500984s Aug 18 11:51:05.203: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.498952225s Aug 18 11:51:07.206: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.502511714s Aug 18 11:51:09.209: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.505268151s Aug 18 11:51:11.213: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.509554022s Aug 18 11:51:13.216: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.51281904s Aug 18 11:51:15.220: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.516269374s Aug 18 11:51:17.225: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.521165155s Aug 18 11:51:19.229: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.524895927s Aug 18 11:51:21.233: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.528864959s Aug 18 11:51:23.236: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.532725454s Aug 18 11:51:25.241: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.537549262s Aug 18 11:51:27.246: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.542272336s Aug 18 11:51:29.250: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.545882458s Aug 18 11:51:31.254: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.550107394s Aug 18 11:51:33.258: INFO: Pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.554121174s Aug 18 11:51:35.266: INFO: Failed to get logs from node "node2" pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70" container "env-test": the server rejected our request for an unknown reason (get pods pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70) STEP: delete the pod Aug 18 11:51:35.272: INFO: Waiting for pod pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70 to disappear Aug 18 11:51:35.274: INFO: Pod pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70 still exists Aug 18 11:51:37.275: INFO: Waiting for pod pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70 to disappear Aug 18 11:51:37.278: INFO: Pod pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70 still exists Aug 18 11:51:39.274: INFO: Waiting for pod pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70 to disappear Aug 18 11:51:39.277: INFO: Pod pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70 no longer exists Aug 18 11:51:39.277: FAIL: Unexpected error: <*errors.errorString | 0xc0048d96d0>: { s: "expected pod \"pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70\" success: Gave up after waiting 5m0s for pod \"pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70\" to be \"Succeeded or Failed\"", } expected pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70" success: Gave up after waiting 5m0s for pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70" to be "Succeeded or Failed" occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).testContainerOutputMatcher(0xc0001b2f20, 0x4c203ba, 0x12, 0xc004462000, 0x0, 0xc0008f9158, 0x1, 0x1, 0x4deefa8) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 +0x1ee k8s.io/kubernetes/test/e2e/framework.(*Framework).TestContainerOutput(...) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:525 k8s.io/kubernetes/test/e2e/common.glob..func1.1() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/configmap.go:80 +0x8a5 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc001a9de00) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc001a9de00) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc001a9de00, 0x4deb2c0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [sig-node] ConfigMap /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "configmap-6580". STEP: Found 7 events. Aug 18 11:51:39.282: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70: { } Scheduled: Successfully assigned configmap-6580/pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70 to node2 Aug 18 11:51:39.282: INFO: At 2021-08-18 11:46:36 +0000 UTC - event for pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70: {multus } AddedInterface: Add eth0 [10.244.3.66/24] Aug 18 11:51:39.282: INFO: At 2021-08-18 11:46:36 +0000 UTC - event for pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70: {kubelet node2} Pulling: Pulling image "docker.io/library/busybox:1.29" Aug 18 11:51:39.282: INFO: At 2021-08-18 11:46:38 +0000 UTC - event for pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70: {kubelet node2} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit Aug 18 11:51:39.282: INFO: At 2021-08-18 11:46:38 +0000 UTC - event for pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70: {kubelet node2} Failed: Error: ErrImagePull Aug 18 11:51:39.282: INFO: At 2021-08-18 11:46:39 +0000 UTC - event for pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70: {kubelet node2} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" Aug 18 11:51:39.282: INFO: At 2021-08-18 11:46:39 +0000 UTC - event for pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70: {kubelet node2} Failed: Error: ImagePullBackOff Aug 18 11:51:39.284: INFO: POD NODE PHASE GRACE CONDITIONS Aug 18 11:51:39.284: INFO: Aug 18 11:51:39.288: INFO: Logging node info for node master1 Aug 18 11:51:39.290: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 ebb211fa-503f-4cfe-b1ed-c95d27a70e6e 72800 0 2021-08-18 08:20:52 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"3a:82:be:72:b5:15"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:20:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:20:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:25:59 +0000 UTC,LastTransitionTime:2021-08-18 08:25:59 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:51:37 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:51:37 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:51:37 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:51:37 +0000 UTC,LastTransitionTime:2021-08-18 08:25:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:58c3e57359b641ad92fa1959f2fecf5d,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:012cd796-2076-45d6-8b14-d3e0451b1e64,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[@ :],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:51:39.291: INFO: Logging kubelet events for node master1 Aug 18 11:51:39.292: INFO: Logging pods the kubelet thinks is on node master1 Aug 18 11:51:39.302: INFO: kube-apiserver-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:51:39.302: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:51:39.302: INFO: kube-proxy-vqk4v started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:51:39.302: INFO: Container kube-proxy ready: true, restart count 1 Aug 18 11:51:39.302: INFO: kube-flannel-q64cq started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:51:39.302: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:51:39.302: INFO: Container kube-flannel ready: true, restart count 3 Aug 18 11:51:39.302: INFO: coredns-7677f9bb54-kn2qg started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:51:39.302: INFO: Container coredns ready: true, restart count 2 Aug 18 11:51:39.302: INFO: kube-scheduler-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:51:39.302: INFO: Container kube-scheduler ready: true, restart count 0 Aug 18 11:51:39.302: INFO: kube-controller-manager-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:51:39.302: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:51:39.302: INFO: kube-multus-ds-amd64-kbcp6 started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:51:39.302: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:51:39.302: INFO: docker-registry-docker-registry-56cbc7bc58-49kl2 started at 2021-08-18 08:26:23 +0000 UTC (0+2 container statuses recorded) Aug 18 11:51:39.302: INFO: Container docker-registry ready: true, restart count 0 Aug 18 11:51:39.302: INFO: Container nginx ready: true, restart count 0 Aug 18 11:51:39.302: INFO: node-exporter-5hwz9 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:51:39.302: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:51:39.302: INFO: Container node-exporter ready: true, restart count 0 W0818 11:51:39.314383 34 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:51:39.343: INFO: Latency metrics for node master1 Aug 18 11:51:39.343: INFO: Logging node info for node master2 Aug 18 11:51:39.346: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 78946293-3abe-4442-84d4-8ed6b1d15ce0 72798 0 2021-08-18 08:21:31 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"7e:f5:c2:cc:3a:b4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:21:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:21:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-08-18 08:29:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:51:36 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:51:36 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:51:36 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:51:36 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0c44122c7a7248c18d8571e1cc667258,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:0cd329f2-48e0-4c8f-b8b9-fa3ae0ed8406,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:51:39.346: INFO: Logging kubelet events for node master2 Aug 18 11:51:39.348: INFO: Logging pods the kubelet thinks is on node master2 Aug 18 11:51:39.359: INFO: kube-proxy-kh2l9 started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:51:39.359: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:51:39.359: INFO: kube-flannel-pp56h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:51:39.359: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:51:39.359: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:51:39.359: INFO: kube-controller-manager-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:51:39.359: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:51:39.359: INFO: kube-scheduler-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:51:39.359: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:51:39.359: INFO: kube-multus-ds-amd64-mld8g started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:51:39.359: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:51:39.359: INFO: dns-autoscaler-5b7b5c9b6f-hh47r started at 2021-08-18 08:23:57 +0000 UTC (0+1 container statuses recorded) Aug 18 11:51:39.359: INFO: Container autoscaler ready: true, restart count 2 Aug 18 11:51:39.359: INFO: node-feature-discovery-controller-5bf5c49849-mq57c started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:51:39.359: INFO: Container nfd-controller ready: true, restart count 0 Aug 18 11:51:39.359: INFO: node-exporter-48nfx started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:51:39.359: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:51:39.359: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:51:39.359: INFO: kube-apiserver-master2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:51:39.359: INFO: Container kube-apiserver ready: true, restart count 0 W0818 11:51:39.372593 34 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:51:39.398: INFO: Latency metrics for node master2 Aug 18 11:51:39.398: INFO: Logging node info for node master3 Aug 18 11:51:39.400: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 44feac2b-9447-4be2-9fcd-62f836d67c72 72777 0 2021-08-18 08:21:41 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"86:e4:31:99:58:40"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {kubelet Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:51:31 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:51:31 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:51:31 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:51:31 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1fae19ae59884c44899bcd08aa243244,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:5db926c5-6530-4635-a0d5-806974a3b732,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:51:39.401: INFO: Logging kubelet events for node master3 Aug 18 11:51:39.403: INFO: Logging pods the kubelet thinks is on node master3 Aug 18 11:51:39.414: INFO: kube-flannel-x6tlr started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:51:39.414: INFO: Init container install-cni ready: true, restart count 1 Aug 18 11:51:39.414: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:51:39.414: INFO: kube-multus-ds-amd64-bkw6c started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:51:39.414: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:51:39.414: INFO: coredns-7677f9bb54-5hxfh started at 2021-08-18 08:23:54 +0000 UTC (0+1 container statuses recorded) Aug 18 11:51:39.414: INFO: Container coredns ready: true, restart count 1 Aug 18 11:51:39.414: INFO: node-exporter-vq7d8 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:51:39.414: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:51:39.414: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:51:39.414: INFO: kube-controller-manager-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:51:39.414: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:51:39.414: INFO: kube-scheduler-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:51:39.414: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:51:39.414: INFO: kube-apiserver-master3 started at 2021-08-18 08:29:12 +0000 UTC (0+1 container statuses recorded) Aug 18 11:51:39.414: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:51:39.414: INFO: kube-proxy-sd5lc started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:51:39.414: INFO: Container kube-proxy ready: true, restart count 2 W0818 11:51:39.427742 34 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:51:39.453: INFO: Latency metrics for node master3 Aug 18 11:51:39.453: INFO: Logging node info for node node1 Aug 18 11:51:39.456: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 84defabd-6ebf-43ec-a629-44c6713da9c9 72789 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"9a:87:55:36:7b:df"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:13 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:35 +0000 UTC,LastTransitionTime:2021-08-18 08:26:35 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:51:34 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:51:34 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:51:34 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:51:34 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:69946ff2b7bc462fa25eb7adb4703c23,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:736dc52f-f5e3-494e-86ca-01eedbea015c,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:a7cea43d9d2f67c38fbf0407786edbe660ee9072945f7bb272b55fd255e8eaca opnfv/barometer-collectd:stable],SizeBytes:1075746799,},ContainerImage{Names:[@ :],SizeBytes:1003788820,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[aquasec/kube-hunter@sha256:2be6820bc1d7e0f57193a9a27d5a3e16b2fd93c53747b03ce8ca48c6fc323781 aquasec/kube-hunter:0.3.1],SizeBytes:347611549,},ContainerImage{Names:[golang@sha256:db2475a1dbb2149508e5db31d7d77a75e6600d54be645f37681f03f2762169ba golang:alpine3.12],SizeBytes:301186719,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:de25c7fc6c4f3a27c7f0c2dff454e4671823a34d88abd533f210848d527e0fbb alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:51:39.457: INFO: Logging kubelet events for node node1 Aug 18 11:51:39.459: INFO: Logging pods the kubelet thinks is on node node1 Aug 18 11:51:39.475: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-vsxvg started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:51:39.475: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:51:39.475: INFO: affinity-nodeport-timeout-6vmxz started at 2021-08-18 11:49:43 +0000 UTC (0+1 container statuses recorded) Aug 18 11:51:39.475: INFO: Container affinity-nodeport-timeout ready: true, restart count 0 Aug 18 11:51:39.475: INFO: pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975 started at 2021-08-18 11:47:15 +0000 UTC (0+1 container statuses recorded) Aug 18 11:51:39.475: INFO: Container secret-env-test ready: false, restart count 0 Aug 18 11:51:39.475: INFO: var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209 started at 2021-08-18 11:47:57 +0000 UTC (0+1 container statuses recorded) Aug 18 11:51:39.475: INFO: Container dapi-container ready: false, restart count 0 Aug 18 11:51:39.475: INFO: affinity-nodeport-f9b5h started at 2021-08-18 11:49:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:51:39.475: INFO: Container affinity-nodeport ready: true, restart count 0 Aug 18 11:51:39.475: INFO: nginx-proxy-node1 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:51:39.475: INFO: Container nginx-proxy ready: true, restart count 2 Aug 18 11:51:39.475: INFO: prometheus-k8s-0 started at 2021-08-18 08:34:03 +0000 UTC (0+5 container statuses recorded) Aug 18 11:51:39.475: INFO: Container custom-metrics-apiserver ready: true, restart count 0 Aug 18 11:51:39.475: INFO: Container grafana ready: true, restart count 0 Aug 18 11:51:39.475: INFO: Container prometheus ready: true, restart count 1 Aug 18 11:51:39.475: INFO: Container prometheus-config-reloader ready: true, restart count 0 Aug 18 11:51:39.475: INFO: Container rules-configmap-reloader ready: true, restart count 0 Aug 18 11:51:39.475: INFO: kube-flannel-q78nd started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:51:39.475: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:51:39.475: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:51:39.475: INFO: node-feature-discovery-worker-pflgw started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:51:39.475: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:51:39.475: INFO: node-exporter-kcwvn started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:51:39.475: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:51:39.475: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:51:39.476: INFO: ss-0 started at 2021-08-18 11:47:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:51:39.476: INFO: Container webserver ready: false, restart count 0 Aug 18 11:51:39.476: INFO: execpod-affinitycdhts started at 2021-08-18 11:49:49 +0000 UTC (0+1 container statuses recorded) Aug 18 11:51:39.476: INFO: Container agnhost-container ready: true, restart count 0 Aug 18 11:51:39.476: INFO: kube-multus-ds-amd64-rrvmb started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:51:39.476: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:51:39.476: INFO: kubernetes-metrics-scraper-678c97765c-9nsv5 started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:51:39.476: INFO: Container kubernetes-metrics-scraper ready: true, restart count 2 Aug 18 11:51:39.476: INFO: cmk-init-discover-node1-bxznx started at 2021-08-18 08:32:10 +0000 UTC (0+3 container statuses recorded) Aug 18 11:51:39.476: INFO: Container discover ready: false, restart count 0 Aug 18 11:51:39.476: INFO: Container init ready: false, restart count 0 Aug 18 11:51:39.476: INFO: Container install ready: false, restart count 0 Aug 18 11:51:39.476: INFO: cmk-d8r27 started at 2021-08-18 08:32:52 +0000 UTC (0+2 container statuses recorded) Aug 18 11:51:39.476: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:51:39.476: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:51:39.476: INFO: collectd-xdprr started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:51:39.476: INFO: Container collectd ready: true, restart count 0 Aug 18 11:51:39.476: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:51:39.476: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:51:39.476: INFO: kube-proxy-p6jvp started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:51:39.476: INFO: Container kube-proxy ready: true, restart count 2 W0818 11:51:39.487090 34 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:51:39.527: INFO: Latency metrics for node node1 Aug 18 11:51:39.527: INFO: Logging node info for node node2 Aug 18 11:51:39.530: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 1d01177e-3dbb-48a1-a0bc-d18af27ab7f8 72766 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:d1:47:f8:1d:22"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:36 +0000 UTC,LastTransitionTime:2021-08-18 08:26:36 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:51:29 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:51:29 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:51:29 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:51:29 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:dc1f286135c145349b8a016880b65a2f,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:037e7e2d-94e9-42f4-a719-896e5005ac70,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:51:39.531: INFO: Logging kubelet events for node node2 Aug 18 11:51:39.533: INFO: Logging pods the kubelet thinks is on node node2 Aug 18 11:51:39.625: INFO: affinity-nodeport-timeout-qkg67 started at 2021-08-18 11:49:43 +0000 UTC (0+1 container statuses recorded) Aug 18 11:51:39.625: INFO: Container affinity-nodeport-timeout ready: true, restart count 0 Aug 18 11:51:39.625: INFO: nginx-proxy-node2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:51:39.625: INFO: Container nginx-proxy ready: true, restart count 1 Aug 18 11:51:39.625: INFO: cmk-init-discover-node2-6b2kz started at 2021-08-18 08:32:30 +0000 UTC (0+3 container statuses recorded) Aug 18 11:51:39.625: INFO: Container discover ready: false, restart count 0 Aug 18 11:51:39.625: INFO: Container init ready: false, restart count 0 Aug 18 11:51:39.625: INFO: Container install ready: false, restart count 0 Aug 18 11:51:39.625: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-7rn45 started at 2021-08-18 08:36:42 +0000 UTC (0+2 container statuses recorded) Aug 18 11:51:39.625: INFO: Container tas-controller ready: true, restart count 0 Aug 18 11:51:39.625: INFO: Container tas-extender ready: true, restart count 0 Aug 18 11:51:39.625: INFO: affinity-nodeport-cc62g started at 2021-08-18 11:49:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:51:39.625: INFO: Container affinity-nodeport ready: true, restart count 0 Aug 18 11:51:39.625: INFO: kubernetes-dashboard-86c6f9df5b-qrtdk started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:51:39.625: INFO: Container kubernetes-dashboard ready: true, restart count 2 Aug 18 11:51:39.625: INFO: cmk-748rz started at 2021-08-18 08:32:53 +0000 UTC (0+2 container statuses recorded) Aug 18 11:51:39.625: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:51:39.625: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:51:39.625: INFO: affinity-nodeport-timeout-jfknb started at 2021-08-18 11:49:43 +0000 UTC (0+1 container statuses recorded) Aug 18 11:51:39.625: INFO: Container affinity-nodeport-timeout ready: true, restart count 0 Aug 18 11:51:39.625: INFO: kube-proxy-qkj9c started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:51:39.625: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:51:39.625: INFO: node-feature-discovery-worker-hzpf5 started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:51:39.626: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:51:39.626: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-c82pt started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:51:39.626: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:51:39.626: INFO: prometheus-operator-5bb8cb9d8f-k97ws started at 2021-08-18 08:33:38 +0000 UTC (0+2 container statuses recorded) Aug 18 11:51:39.626: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:51:39.626: INFO: Container prometheus-operator ready: true, restart count 0 Aug 18 11:51:39.626: INFO: bin-falsea5f6898f-c6c3-4680-9cbd-f4985908f73e started at 2021-08-18 11:49:10 +0000 UTC (0+1 container statuses recorded) Aug 18 11:51:39.626: INFO: Container bin-falsea5f6898f-c6c3-4680-9cbd-f4985908f73e ready: false, restart count 0 Aug 18 11:51:39.626: INFO: kube-multus-ds-amd64-rvzsg started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:51:39.626: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:51:39.626: INFO: collectd-67ntq started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:51:39.626: INFO: Container collectd ready: true, restart count 0 Aug 18 11:51:39.626: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:51:39.626: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:51:39.626: INFO: ss-0 started at 2021-08-18 11:46:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:51:39.626: INFO: Container webserver ready: false, restart count 0 Aug 18 11:51:39.626: INFO: downwardapi-volume-056e9014-37b7-4904-b0c1-ddd5280d4510 started at 2021-08-18 11:51:38 +0000 UTC (0+1 container statuses recorded) Aug 18 11:51:39.626: INFO: Container client-container ready: false, restart count 0 Aug 18 11:51:39.626: INFO: cmk-webhook-6c9d5f8578-7cxjr started at 2021-08-18 08:32:53 +0000 UTC (0+1 container statuses recorded) Aug 18 11:51:39.626: INFO: Container cmk-webhook ready: true, restart count 0 Aug 18 11:51:39.626: INFO: terminate-cmd-rpad23b99c9-2d62-4758-a55c-1712aba45053 started at 2021-08-18 11:50:30 +0000 UTC (0+1 container statuses recorded) Aug 18 11:51:39.626: INFO: Container terminate-cmd-rpa ready: false, restart count 0 Aug 18 11:51:39.626: INFO: kube-flannel-h7t5h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:51:39.626: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:51:39.626: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:51:39.626: INFO: node-exporter-lrrf2 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:51:39.626: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:51:39.626: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:51:39.626: INFO: affinity-nodeport-qvd62 started at 2021-08-18 11:49:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:51:39.626: INFO: Container affinity-nodeport ready: true, restart count 0 Aug 18 11:51:39.626: INFO: execpod-affinityk47wl started at 2021-08-18 11:50:05 +0000 UTC (0+1 container statuses recorded) Aug 18 11:51:39.626: INFO: Container agnhost-container ready: true, restart count 0 W0818 11:51:39.639214 34 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:51:39.719: INFO: Latency metrics for node node2 Aug 18 11:51:39.719: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "configmap-6580" for this suite. • Failure [305.056 seconds] [sig-node] ConfigMap /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/configmap.go:34 should be consumable via environment variable [NodeConformance] [Conformance] [It] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:51:39.277: Unexpected error: <*errors.errorString | 0xc0048d96d0>: { s: "expected pod \"pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70\" success: Gave up after waiting 5m0s for pod \"pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70\" to be \"Succeeded or Failed\"", } expected pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70" success: Gave up after waiting 5m0s for pod "pod-configmaps-847289cb-4a46-40bf-8a4a-18c9f1796e70" to be "Succeeded or Failed" occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 ------------------------------ {"msg":"FAILED [sig-node] ConfigMap should be consumable via environment variable [NodeConformance] [Conformance]","total":-1,"completed":12,"skipped":137,"failed":5,"failures":["[k8s.io] Variable Expansion should verify that a failing subpath expansion can be modified during the lifecycle of a container [sig-storage][Slow] [Conformance]","[sig-apps] Deployment deployment should delete old replica sets [Conformance]","[k8s.io] Variable Expansion should succeed in writing subpaths in container [sig-storage][Slow] [Conformance]","[k8s.io] Security Context When creating a pod with privileged should run the container as unprivileged when false [LinuxOnly] [NodeConformance] [Conformance]","[sig-node] ConfigMap should be consumable via environment variable [NodeConformance] [Conformance]"]} SSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-storage] Downward API volume /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:51:38.235: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename downward-api STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-storage] Downward API volume /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/downwardapi_volume.go:42 [It] should provide container's cpu limit [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating a pod to test downward API volume plugin Aug 18 11:51:38.267: INFO: Waiting up to 5m0s for pod "downwardapi-volume-056e9014-37b7-4904-b0c1-ddd5280d4510" in namespace "downward-api-9028" to be "Succeeded or Failed" Aug 18 11:51:38.269: INFO: Pod "downwardapi-volume-056e9014-37b7-4904-b0c1-ddd5280d4510": Phase="Pending", Reason="", readiness=false. Elapsed: 2.107143ms Aug 18 11:51:40.272: INFO: Pod "downwardapi-volume-056e9014-37b7-4904-b0c1-ddd5280d4510": Phase="Pending", Reason="", readiness=false. Elapsed: 2.004795499s Aug 18 11:51:42.276: INFO: Pod "downwardapi-volume-056e9014-37b7-4904-b0c1-ddd5280d4510": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.008327379s STEP: Saw pod success Aug 18 11:51:42.276: INFO: Pod "downwardapi-volume-056e9014-37b7-4904-b0c1-ddd5280d4510" satisfied condition "Succeeded or Failed" Aug 18 11:51:42.279: INFO: Trying to get logs from node node2 pod downwardapi-volume-056e9014-37b7-4904-b0c1-ddd5280d4510 container client-container: STEP: delete the pod Aug 18 11:51:42.294: INFO: Waiting for pod downwardapi-volume-056e9014-37b7-4904-b0c1-ddd5280d4510 to disappear Aug 18 11:51:42.296: INFO: Pod downwardapi-volume-056e9014-37b7-4904-b0c1-ddd5280d4510 no longer exists [AfterEach] [sig-storage] Downward API volume /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:51:42.296: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "downward-api-9028" for this suite. • ------------------------------ {"msg":"PASSED [sig-storage] Downward API volume should provide container's cpu limit [NodeConformance] [Conformance]","total":-1,"completed":33,"skipped":575,"failed":4,"failures":["[sig-apps] Deployment RollingUpdateDeployment should delete old pods and create new ones [Conformance]","[sig-storage] ConfigMap binary data should be reflected in volume [NodeConformance] [Conformance]","[k8s.io] Kubelet when scheduling a busybox command in a pod should print the output to logs [NodeConformance] [Conformance]","[k8s.io] Pods should support remote command execution over websockets [NodeConformance] [Conformance]"]} SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:51:39.760: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename services STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:782 [It] should be able to change the type from NodePort to ExternalName [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: creating a service nodeport-service with the type=NodePort in namespace services-8638 STEP: Creating active service to test reachability when its FQDN is referred as externalName for another service STEP: creating service externalsvc in namespace services-8638 STEP: creating replication controller externalsvc in namespace services-8638 I0818 11:51:39.796125 34 runners.go:190] Created replication controller with name: externalsvc, namespace: services-8638, replica count: 2 I0818 11:51:42.846722 34 runners.go:190] externalsvc Pods: 2 out of 2 created, 2 running, 0 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady STEP: changing the NodePort service to type=ExternalName Aug 18 11:51:42.863: INFO: Creating new exec pod Aug 18 11:51:46.881: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-8638 exec execpodqzpgq -- /bin/sh -x -c nslookup nodeport-service.services-8638.svc.cluster.local' Aug 18 11:51:50.679: INFO: stderr: "+ nslookup nodeport-service.services-8638.svc.cluster.local\n" Aug 18 11:51:50.679: INFO: stdout: "Server:\t\t10.233.0.3\nAddress:\t10.233.0.3#53\n\nnodeport-service.services-8638.svc.cluster.local\tcanonical name = externalsvc.services-8638.svc.cluster.local.\nName:\texternalsvc.services-8638.svc.cluster.local\nAddress: 10.233.59.50\n\n" STEP: deleting ReplicationController externalsvc in namespace services-8638, will wait for the garbage collector to delete the pods Aug 18 11:51:50.740: INFO: Deleting ReplicationController externalsvc took: 7.312631ms Aug 18 11:51:51.441: INFO: Terminating ReplicationController externalsvc pods took: 700.441068ms Aug 18 11:52:01.253: INFO: Cleaning up the NodePort to ExternalName test service [AfterEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:52:01.261: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "services-8638" for this suite. [AfterEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:786 • [SLOW TEST:21.509 seconds] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/framework.go:23 should be able to change the type from NodePort to ExternalName [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-network] Services should be able to change the type from NodePort to ExternalName [Conformance]","total":-1,"completed":13,"skipped":151,"failed":5,"failures":["[k8s.io] Variable Expansion should verify that a failing subpath expansion can be modified during the lifecycle of a container [sig-storage][Slow] [Conformance]","[sig-apps] Deployment deployment should delete old replica sets [Conformance]","[k8s.io] Variable Expansion should succeed in writing subpaths in container [sig-storage][Slow] [Conformance]","[k8s.io] Security Context When creating a pod with privileged should run the container as unprivileged when false [LinuxOnly] [NodeConformance] [Conformance]","[sig-node] ConfigMap should be consumable via environment variable [NodeConformance] [Conformance]"]} SSSSS ------------------------------ [BeforeEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:49:28.666: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename services STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:782 [It] should have session affinity timeout work for NodePort service [LinuxOnly] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: creating service in namespace services-7760 Aug 18 11:49:30.703: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec kube-proxy-mode-detector -- /bin/sh -x -c curl -q -s --connect-timeout 1 http://localhost:10249/proxyMode' Aug 18 11:49:30.965: INFO: stderr: "+ curl -q -s --connect-timeout 1 http://localhost:10249/proxyMode\n" Aug 18 11:49:30.965: INFO: stdout: "iptables" Aug 18 11:49:30.965: INFO: proxyMode: iptables Aug 18 11:49:30.970: INFO: Waiting for pod kube-proxy-mode-detector to disappear Aug 18 11:49:30.972: INFO: Pod kube-proxy-mode-detector still exists Aug 18 11:49:32.972: INFO: Waiting for pod kube-proxy-mode-detector to disappear Aug 18 11:49:32.976: INFO: Pod kube-proxy-mode-detector still exists Aug 18 11:49:34.972: INFO: Waiting for pod kube-proxy-mode-detector to disappear Aug 18 11:49:34.975: INFO: Pod kube-proxy-mode-detector still exists Aug 18 11:49:36.972: INFO: Waiting for pod kube-proxy-mode-detector to disappear Aug 18 11:49:36.975: INFO: Pod kube-proxy-mode-detector still exists Aug 18 11:49:38.973: INFO: Waiting for pod kube-proxy-mode-detector to disappear Aug 18 11:49:38.976: INFO: Pod kube-proxy-mode-detector still exists Aug 18 11:49:40.972: INFO: Waiting for pod kube-proxy-mode-detector to disappear Aug 18 11:49:40.975: INFO: Pod kube-proxy-mode-detector still exists Aug 18 11:49:42.972: INFO: Waiting for pod kube-proxy-mode-detector to disappear Aug 18 11:49:42.975: INFO: Pod kube-proxy-mode-detector no longer exists STEP: creating service affinity-nodeport-timeout in namespace services-7760 STEP: creating replication controller affinity-nodeport-timeout in namespace services-7760 I0818 11:49:42.988427 36 runners.go:190] Created replication controller with name: affinity-nodeport-timeout, namespace: services-7760, replica count: 3 I0818 11:49:46.039061 36 runners.go:190] affinity-nodeport-timeout Pods: 3 out of 3 created, 0 running, 3 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0818 11:49:49.039183 36 runners.go:190] affinity-nodeport-timeout Pods: 3 out of 3 created, 3 running, 0 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady Aug 18 11:49:49.049: INFO: Creating new exec pod Aug 18 11:49:54.072: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 affinity-nodeport-timeout 80' Aug 18 11:49:54.372: INFO: stderr: "+ nc -zv -t -w 2 affinity-nodeport-timeout 80\nConnection to affinity-nodeport-timeout 80 port [tcp/http] succeeded!\n" Aug 18 11:49:54.372: INFO: stdout: "" Aug 18 11:49:54.373: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.233.11.244 80' Aug 18 11:49:54.632: INFO: stderr: "+ nc -zv -t -w 2 10.233.11.244 80\nConnection to 10.233.11.244 80 port [tcp/http] succeeded!\n" Aug 18 11:49:54.632: INFO: stdout: "" Aug 18 11:49:54.632: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:49:54.891: INFO: rc: 1 Aug 18 11:49:54.891: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:49:55.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:49:56.133: INFO: rc: 1 Aug 18 11:49:56.133: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:49:56.891: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:49:57.163: INFO: rc: 1 Aug 18 11:49:57.163: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:49:57.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:49:58.168: INFO: rc: 1 Aug 18 11:49:58.168: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:49:58.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:49:59.161: INFO: rc: 1 Aug 18 11:49:59.161: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:49:59.891: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:50:00.328: INFO: rc: 1 Aug 18 11:50:00.328: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:00.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:50:01.144: INFO: rc: 1 Aug 18 11:50:01.144: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:01.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:50:02.191: INFO: rc: 1 Aug 18 11:50:02.191: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:02.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:50:03.339: INFO: rc: 1 Aug 18 11:50:03.339: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:03.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:50:04.126: INFO: rc: 1 Aug 18 11:50:04.126: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:04.891: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:50:05.289: INFO: rc: 1 Aug 18 11:50:05.289: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:05.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:50:06.142: INFO: rc: 1 Aug 18 11:50:06.142: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:06.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:50:07.148: INFO: rc: 1 Aug 18 11:50:07.148: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:07.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:50:08.140: INFO: rc: 1 Aug 18 11:50:08.140: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:08.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:50:09.161: INFO: rc: 1 Aug 18 11:50:09.161: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:09.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:50:10.155: INFO: rc: 1 Aug 18 11:50:10.155: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:10.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:50:11.160: INFO: rc: 1 Aug 18 11:50:11.160: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:11.891: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:50:12.152: INFO: rc: 1 Aug 18 11:50:12.152: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:12.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:50:13.157: INFO: rc: 1 Aug 18 11:50:13.157: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:13.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:50:14.160: INFO: rc: 1 Aug 18 11:50:14.160: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:14.893: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:50:15.177: INFO: rc: 1 Aug 18 11:50:15.177: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:15.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:50:16.606: INFO: rc: 1 Aug 18 11:50:16.606: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:16.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:50:17.170: INFO: rc: 1 Aug 18 11:50:17.170: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:17.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:50:18.165: INFO: rc: 1 Aug 18 11:50:18.165: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:18.891: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:50:19.176: INFO: rc: 1 Aug 18 11:50:19.176: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:19.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:50:20.164: INFO: rc: 1 Aug 18 11:50:20.164: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:20.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:50:21.133: INFO: rc: 1 Aug 18 11:50:21.133: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:21.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:50:22.149: INFO: rc: 1 Aug 18 11:50:22.149: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:22.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:50:23.578: INFO: rc: 1 Aug 18 11:50:23.578: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:23.891: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:50:24.189: INFO: rc: 1 Aug 18 11:50:24.189: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:24.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:50:25.150: INFO: rc: 1 Aug 18 11:50:25.150: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:25.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:50:26.126: INFO: rc: 1 Aug 18 11:50:26.126: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:26.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:50:27.485: INFO: rc: 1 Aug 18 11:50:27.485: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:27.891: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:50:28.198: INFO: rc: 1 Aug 18 11:50:28.198: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:28.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:50:29.145: INFO: rc: 1 Aug 18 11:50:29.145: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:29.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:50:30.143: INFO: rc: 1 Aug 18 11:50:30.143: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:30.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:50:31.421: INFO: rc: 1 Aug 18 11:50:31.421: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:31.891: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:50:32.137: INFO: rc: 1 Aug 18 11:50:32.137: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:32.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:50:33.165: INFO: rc: 1 Aug 18 11:50:33.165: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:33.891: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:50:34.165: INFO: rc: 1 Aug 18 11:50:34.165: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:34.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:50:35.142: INFO: rc: 1 Aug 18 11:50:35.142: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:35.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:50:36.182: INFO: rc: 1 Aug 18 11:50:36.182: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:36.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:50:37.135: INFO: rc: 1 Aug 18 11:50:37.135: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:37.891: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:50:38.145: INFO: rc: 1 Aug 18 11:50:38.145: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:38.891: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:50:39.242: INFO: rc: 1 Aug 18 11:50:39.242: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:39.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:50:41.386: INFO: rc: 1 Aug 18 11:50:41.387: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:41.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:50:42.345: INFO: rc: 1 Aug 18 11:50:42.345: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:42.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:50:43.647: INFO: rc: 1 Aug 18 11:50:43.647: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:43.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:50:44.229: INFO: rc: 1 Aug 18 11:50:44.229: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:44.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:50:45.152: INFO: rc: 1 Aug 18 11:50:45.152: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:45.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:50:46.374: INFO: rc: 1 Aug 18 11:50:46.374: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:46.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:50:47.148: INFO: rc: 1 Aug 18 11:50:47.148: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:47.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:50:48.191: INFO: rc: 1 Aug 18 11:50:48.192: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:48.891: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:50:49.145: INFO: rc: 1 Aug 18 11:50:49.145: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:49.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:50:50.146: INFO: rc: 1 Aug 18 11:50:50.146: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:50.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:50:51.174: INFO: rc: 1 Aug 18 11:50:51.174: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:51.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:50:52.142: INFO: rc: 1 Aug 18 11:50:52.142: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:52.891: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:50:53.167: INFO: rc: 1 Aug 18 11:50:53.167: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:53.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:50:54.160: INFO: rc: 1 Aug 18 11:50:54.160: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:54.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:50:55.511: INFO: rc: 1 Aug 18 11:50:55.511: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:55.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:50:56.185: INFO: rc: 1 Aug 18 11:50:56.185: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:56.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:50:57.174: INFO: rc: 1 Aug 18 11:50:57.174: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:57.891: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:50:58.140: INFO: rc: 1 Aug 18 11:50:58.140: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:58.891: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:50:59.660: INFO: rc: 1 Aug 18 11:50:59.660: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:59.891: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:51:00.218: INFO: rc: 1 Aug 18 11:51:00.218: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:00.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:51:01.232: INFO: rc: 1 Aug 18 11:51:01.232: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:01.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:51:02.151: INFO: rc: 1 Aug 18 11:51:02.151: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:02.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:51:03.164: INFO: rc: 1 Aug 18 11:51:03.165: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:03.891: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:51:04.167: INFO: rc: 1 Aug 18 11:51:04.167: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:04.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:51:05.141: INFO: rc: 1 Aug 18 11:51:05.141: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:05.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:51:06.142: INFO: rc: 1 Aug 18 11:51:06.142: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:06.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:51:07.130: INFO: rc: 1 Aug 18 11:51:07.130: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:07.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:51:08.154: INFO: rc: 1 Aug 18 11:51:08.154: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:08.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:51:09.222: INFO: rc: 1 Aug 18 11:51:09.222: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:09.891: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:51:10.147: INFO: rc: 1 Aug 18 11:51:10.147: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:10.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:51:11.165: INFO: rc: 1 Aug 18 11:51:11.165: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:11.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:51:12.150: INFO: rc: 1 Aug 18 11:51:12.150: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:12.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:51:13.167: INFO: rc: 1 Aug 18 11:51:13.167: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:13.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:51:14.151: INFO: rc: 1 Aug 18 11:51:14.151: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:14.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:51:15.150: INFO: rc: 1 Aug 18 11:51:15.150: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:15.891: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:51:16.171: INFO: rc: 1 Aug 18 11:51:16.173: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:16.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:51:17.181: INFO: rc: 1 Aug 18 11:51:17.181: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:17.891: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:51:18.157: INFO: rc: 1 Aug 18 11:51:18.158: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:18.891: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:51:19.169: INFO: rc: 1 Aug 18 11:51:19.169: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:19.891: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:51:20.151: INFO: rc: 1 Aug 18 11:51:20.151: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:20.891: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:51:21.167: INFO: rc: 1 Aug 18 11:51:21.168: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:21.891: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:51:22.152: INFO: rc: 1 Aug 18 11:51:22.152: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:22.891: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:51:23.182: INFO: rc: 1 Aug 18 11:51:23.182: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:23.891: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:51:24.172: INFO: rc: 1 Aug 18 11:51:24.172: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:24.891: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:51:25.137: INFO: rc: 1 Aug 18 11:51:25.137: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:25.891: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:51:26.151: INFO: rc: 1 Aug 18 11:51:26.151: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:26.891: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:51:27.181: INFO: rc: 1 Aug 18 11:51:27.181: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:27.891: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:51:28.148: INFO: rc: 1 Aug 18 11:51:28.148: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:28.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:51:29.134: INFO: rc: 1 Aug 18 11:51:29.134: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:29.891: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:51:30.146: INFO: rc: 1 Aug 18 11:51:30.146: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:30.891: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:51:31.177: INFO: rc: 1 Aug 18 11:51:31.177: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:31.891: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:51:32.151: INFO: rc: 1 Aug 18 11:51:32.151: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:32.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:51:33.142: INFO: rc: 1 Aug 18 11:51:33.142: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:33.891: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:51:34.138: INFO: rc: 1 Aug 18 11:51:34.138: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:34.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:51:35.151: INFO: rc: 1 Aug 18 11:51:35.151: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:35.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:51:36.148: INFO: rc: 1 Aug 18 11:51:36.148: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:36.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:51:37.141: INFO: rc: 1 Aug 18 11:51:37.141: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:37.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:51:38.153: INFO: rc: 1 Aug 18 11:51:38.153: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:38.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:51:39.144: INFO: rc: 1 Aug 18 11:51:39.144: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:39.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:51:40.168: INFO: rc: 1 Aug 18 11:51:40.168: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:40.891: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:51:41.400: INFO: rc: 1 Aug 18 11:51:41.400: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:41.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:51:42.157: INFO: rc: 1 Aug 18 11:51:42.157: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:42.891: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:51:43.161: INFO: rc: 1 Aug 18 11:51:43.161: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:43.891: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:51:44.331: INFO: rc: 1 Aug 18 11:51:44.331: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:44.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:51:46.097: INFO: rc: 1 Aug 18 11:51:46.097: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:46.891: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:51:50.674: INFO: rc: 1 Aug 18 11:51:50.674: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:50.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:51:51.436: INFO: rc: 1 Aug 18 11:51:51.436: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:51.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:51:52.160: INFO: rc: 1 Aug 18 11:51:52.160: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:52.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:51:53.167: INFO: rc: 1 Aug 18 11:51:53.167: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:53.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:51:54.233: INFO: rc: 1 Aug 18 11:51:54.233: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:54.892: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:51:55.133: INFO: rc: 1 Aug 18 11:51:55.133: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:55.134: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790' Aug 18 11:51:55.405: INFO: rc: 1 Aug 18 11:51:55.405: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-7760 exec execpod-affinitycdhts -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30790: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30790 nc: connect to 10.10.190.207 port 30790 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:55.406: FAIL: Unexpected error: <*errors.errorString | 0xc003a98880>: { s: "service is not reachable within 2m0s timeout on endpoint 10.10.190.207:30790 over TCP protocol", } service is not reachable within 2m0s timeout on endpoint 10.10.190.207:30790 over TCP protocol occurred Full Stack Trace k8s.io/kubernetes/test/e2e/network.execAffinityTestForSessionAffinityTimeout(0xc0007d4420, 0x5410260, 0xc002678f20, 0xc0049046c0) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:3444 +0x751 k8s.io/kubernetes/test/e2e/network.glob..func24.29() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:2525 +0x9c k8s.io/kubernetes/test/e2e.RunE2ETests(0xc002593080) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc002593080) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc002593080, 0x4deb2c0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 Aug 18 11:51:55.407: INFO: Cleaning up the exec pod STEP: deleting ReplicationController affinity-nodeport-timeout in namespace services-7760, will wait for the garbage collector to delete the pods Aug 18 11:51:55.475: INFO: Deleting ReplicationController affinity-nodeport-timeout took: 4.627286ms Aug 18 11:51:55.575: INFO: Terminating ReplicationController affinity-nodeport-timeout pods took: 100.494832ms [AfterEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "services-7760". STEP: Found 38 events. Aug 18 11:52:11.296: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for affinity-nodeport-timeout-6vmxz: { } Scheduled: Successfully assigned services-7760/affinity-nodeport-timeout-6vmxz to node1 Aug 18 11:52:11.296: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for affinity-nodeport-timeout-jfknb: { } Scheduled: Successfully assigned services-7760/affinity-nodeport-timeout-jfknb to node2 Aug 18 11:52:11.296: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for affinity-nodeport-timeout-qkg67: { } Scheduled: Successfully assigned services-7760/affinity-nodeport-timeout-qkg67 to node2 Aug 18 11:52:11.296: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for execpod-affinitycdhts: { } Scheduled: Successfully assigned services-7760/execpod-affinitycdhts to node1 Aug 18 11:52:11.297: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for kube-proxy-mode-detector: { } Scheduled: Successfully assigned services-7760/kube-proxy-mode-detector to node2 Aug 18 11:52:11.297: INFO: At 2021-08-18 11:49:29 +0000 UTC - event for kube-proxy-mode-detector: {kubelet node2} Pulled: Successfully pulled image "k8s.gcr.io/e2e-test-images/agnhost:2.20" in 455.509051ms Aug 18 11:52:11.297: INFO: At 2021-08-18 11:49:29 +0000 UTC - event for kube-proxy-mode-detector: {kubelet node2} Pulling: Pulling image "k8s.gcr.io/e2e-test-images/agnhost:2.20" Aug 18 11:52:11.297: INFO: At 2021-08-18 11:49:30 +0000 UTC - event for kube-proxy-mode-detector: {kubelet node2} Started: Started container detector Aug 18 11:52:11.297: INFO: At 2021-08-18 11:49:30 +0000 UTC - event for kube-proxy-mode-detector: {kubelet node2} Created: Created container detector Aug 18 11:52:11.297: INFO: At 2021-08-18 11:49:32 +0000 UTC - event for kube-proxy-mode-detector: {kubelet node2} Killing: Stopping container detector Aug 18 11:52:11.297: INFO: At 2021-08-18 11:49:42 +0000 UTC - event for affinity-nodeport-timeout: {replication-controller } SuccessfulCreate: Created pod: affinity-nodeport-timeout-6vmxz Aug 18 11:52:11.297: INFO: At 2021-08-18 11:49:43 +0000 UTC - event for affinity-nodeport-timeout: {replication-controller } SuccessfulCreate: Created pod: affinity-nodeport-timeout-jfknb Aug 18 11:52:11.297: INFO: At 2021-08-18 11:49:43 +0000 UTC - event for affinity-nodeport-timeout: {replication-controller } SuccessfulCreate: Created pod: affinity-nodeport-timeout-qkg67 Aug 18 11:52:11.297: INFO: At 2021-08-18 11:49:44 +0000 UTC - event for affinity-nodeport-timeout-6vmxz: {kubelet node1} Pulling: Pulling image "k8s.gcr.io/e2e-test-images/agnhost:2.20" Aug 18 11:52:11.297: INFO: At 2021-08-18 11:49:44 +0000 UTC - event for affinity-nodeport-timeout-6vmxz: {kubelet node1} Pulled: Successfully pulled image "k8s.gcr.io/e2e-test-images/agnhost:2.20" in 494.606208ms Aug 18 11:52:11.297: INFO: At 2021-08-18 11:49:44 +0000 UTC - event for affinity-nodeport-timeout-6vmxz: {multus } AddedInterface: Add eth0 [10.244.4.92/24] Aug 18 11:52:11.297: INFO: At 2021-08-18 11:49:45 +0000 UTC - event for affinity-nodeport-timeout-6vmxz: {kubelet node1} Started: Started container affinity-nodeport-timeout Aug 18 11:52:11.297: INFO: At 2021-08-18 11:49:45 +0000 UTC - event for affinity-nodeport-timeout-6vmxz: {kubelet node1} Created: Created container affinity-nodeport-timeout Aug 18 11:52:11.297: INFO: At 2021-08-18 11:49:45 +0000 UTC - event for affinity-nodeport-timeout-jfknb: {multus } AddedInterface: Add eth0 [10.244.3.82/24] Aug 18 11:52:11.297: INFO: At 2021-08-18 11:49:45 +0000 UTC - event for affinity-nodeport-timeout-jfknb: {kubelet node2} Pulling: Pulling image "k8s.gcr.io/e2e-test-images/agnhost:2.20" Aug 18 11:52:11.297: INFO: At 2021-08-18 11:49:46 +0000 UTC - event for affinity-nodeport-timeout-jfknb: {kubelet node2} Pulled: Successfully pulled image "k8s.gcr.io/e2e-test-images/agnhost:2.20" in 485.26377ms Aug 18 11:52:11.297: INFO: At 2021-08-18 11:49:46 +0000 UTC - event for affinity-nodeport-timeout-jfknb: {kubelet node2} Started: Started container affinity-nodeport-timeout Aug 18 11:52:11.297: INFO: At 2021-08-18 11:49:46 +0000 UTC - event for affinity-nodeport-timeout-jfknb: {kubelet node2} Created: Created container affinity-nodeport-timeout Aug 18 11:52:11.297: INFO: At 2021-08-18 11:49:46 +0000 UTC - event for affinity-nodeport-timeout-qkg67: {kubelet node2} Pulling: Pulling image "k8s.gcr.io/e2e-test-images/agnhost:2.20" Aug 18 11:52:11.297: INFO: At 2021-08-18 11:49:46 +0000 UTC - event for affinity-nodeport-timeout-qkg67: {multus } AddedInterface: Add eth0 [10.244.3.83/24] Aug 18 11:52:11.297: INFO: At 2021-08-18 11:49:46 +0000 UTC - event for affinity-nodeport-timeout-qkg67: {kubelet node2} Pulled: Successfully pulled image "k8s.gcr.io/e2e-test-images/agnhost:2.20" in 469.403824ms Aug 18 11:52:11.297: INFO: At 2021-08-18 11:49:46 +0000 UTC - event for affinity-nodeport-timeout-qkg67: {kubelet node2} Created: Created container affinity-nodeport-timeout Aug 18 11:52:11.297: INFO: At 2021-08-18 11:49:47 +0000 UTC - event for affinity-nodeport-timeout-qkg67: {kubelet node2} Started: Started container affinity-nodeport-timeout Aug 18 11:52:11.297: INFO: At 2021-08-18 11:49:50 +0000 UTC - event for execpod-affinitycdhts: {kubelet node1} Pulled: Successfully pulled image "k8s.gcr.io/e2e-test-images/agnhost:2.20" in 446.584605ms Aug 18 11:52:11.297: INFO: At 2021-08-18 11:49:50 +0000 UTC - event for execpod-affinitycdhts: {kubelet node1} Pulling: Pulling image "k8s.gcr.io/e2e-test-images/agnhost:2.20" Aug 18 11:52:11.297: INFO: At 2021-08-18 11:49:50 +0000 UTC - event for execpod-affinitycdhts: {multus } AddedInterface: Add eth0 [10.244.4.93/24] Aug 18 11:52:11.297: INFO: At 2021-08-18 11:49:51 +0000 UTC - event for execpod-affinitycdhts: {kubelet node1} Created: Created container agnhost-container Aug 18 11:52:11.297: INFO: At 2021-08-18 11:49:51 +0000 UTC - event for execpod-affinitycdhts: {kubelet node1} Started: Started container agnhost-container Aug 18 11:52:11.297: INFO: At 2021-08-18 11:51:55 +0000 UTC - event for affinity-nodeport-timeout: {endpoint-controller } FailedToUpdateEndpoint: Failed to update endpoint services-7760/affinity-nodeport-timeout: Operation cannot be fulfilled on endpoints "affinity-nodeport-timeout": the object has been modified; please apply your changes to the latest version and try again Aug 18 11:52:11.297: INFO: At 2021-08-18 11:51:55 +0000 UTC - event for affinity-nodeport-timeout-6vmxz: {kubelet node1} Killing: Stopping container affinity-nodeport-timeout Aug 18 11:52:11.297: INFO: At 2021-08-18 11:51:55 +0000 UTC - event for affinity-nodeport-timeout-jfknb: {kubelet node2} Killing: Stopping container affinity-nodeport-timeout Aug 18 11:52:11.297: INFO: At 2021-08-18 11:51:55 +0000 UTC - event for affinity-nodeport-timeout-qkg67: {kubelet node2} Killing: Stopping container affinity-nodeport-timeout Aug 18 11:52:11.297: INFO: At 2021-08-18 11:51:55 +0000 UTC - event for execpod-affinitycdhts: {kubelet node1} Killing: Stopping container agnhost-container Aug 18 11:52:11.299: INFO: POD NODE PHASE GRACE CONDITIONS Aug 18 11:52:11.299: INFO: Aug 18 11:52:11.303: INFO: Logging node info for node master1 Aug 18 11:52:11.305: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 ebb211fa-503f-4cfe-b1ed-c95d27a70e6e 73170 0 2021-08-18 08:20:52 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"3a:82:be:72:b5:15"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:20:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:20:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:25:59 +0000 UTC,LastTransitionTime:2021-08-18 08:25:59 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:52:07 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:52:07 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:52:07 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:52:07 +0000 UTC,LastTransitionTime:2021-08-18 08:25:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:58c3e57359b641ad92fa1959f2fecf5d,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:012cd796-2076-45d6-8b14-d3e0451b1e64,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[@ :],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:52:11.306: INFO: Logging kubelet events for node master1 Aug 18 11:52:11.308: INFO: Logging pods the kubelet thinks is on node master1 Aug 18 11:52:11.317: INFO: kube-scheduler-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:11.317: INFO: Container kube-scheduler ready: true, restart count 0 Aug 18 11:52:11.317: INFO: kube-apiserver-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:11.317: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:52:11.317: INFO: kube-proxy-vqk4v started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:11.317: INFO: Container kube-proxy ready: true, restart count 1 Aug 18 11:52:11.317: INFO: kube-flannel-q64cq started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:52:11.317: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:52:11.317: INFO: Container kube-flannel ready: true, restart count 3 Aug 18 11:52:11.317: INFO: coredns-7677f9bb54-kn2qg started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:11.317: INFO: Container coredns ready: true, restart count 2 Aug 18 11:52:11.317: INFO: node-exporter-5hwz9 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:52:11.317: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:52:11.317: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:52:11.317: INFO: kube-controller-manager-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:11.317: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:52:11.317: INFO: kube-multus-ds-amd64-kbcp6 started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:11.317: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:52:11.317: INFO: docker-registry-docker-registry-56cbc7bc58-49kl2 started at 2021-08-18 08:26:23 +0000 UTC (0+2 container statuses recorded) Aug 18 11:52:11.317: INFO: Container docker-registry ready: true, restart count 0 Aug 18 11:52:11.317: INFO: Container nginx ready: true, restart count 0 W0818 11:52:11.331064 36 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:52:11.366: INFO: Latency metrics for node master1 Aug 18 11:52:11.366: INFO: Logging node info for node master2 Aug 18 11:52:11.369: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 78946293-3abe-4442-84d4-8ed6b1d15ce0 73168 0 2021-08-18 08:21:31 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"7e:f5:c2:cc:3a:b4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:21:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:21:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-08-18 08:29:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:52:06 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:52:06 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:52:06 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:52:06 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0c44122c7a7248c18d8571e1cc667258,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:0cd329f2-48e0-4c8f-b8b9-fa3ae0ed8406,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:52:11.369: INFO: Logging kubelet events for node master2 Aug 18 11:52:11.371: INFO: Logging pods the kubelet thinks is on node master2 Aug 18 11:52:11.381: INFO: kube-controller-manager-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:11.381: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:52:11.381: INFO: kube-proxy-kh2l9 started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:11.381: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:52:11.381: INFO: kube-flannel-pp56h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:52:11.381: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:52:11.381: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:52:11.381: INFO: node-feature-discovery-controller-5bf5c49849-mq57c started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:11.381: INFO: Container nfd-controller ready: true, restart count 0 Aug 18 11:52:11.381: INFO: node-exporter-48nfx started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:52:11.381: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:52:11.381: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:52:11.381: INFO: kube-apiserver-master2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:11.381: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:52:11.381: INFO: kube-scheduler-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:11.381: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:52:11.381: INFO: kube-multus-ds-amd64-mld8g started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:11.381: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:52:11.381: INFO: dns-autoscaler-5b7b5c9b6f-hh47r started at 2021-08-18 08:23:57 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:11.381: INFO: Container autoscaler ready: true, restart count 2 W0818 11:52:11.395597 36 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:52:11.421: INFO: Latency metrics for node master2 Aug 18 11:52:11.421: INFO: Logging node info for node master3 Aug 18 11:52:11.424: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 44feac2b-9447-4be2-9fcd-62f836d67c72 73109 0 2021-08-18 08:21:41 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"86:e4:31:99:58:40"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {kubelet Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:52:02 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:52:02 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:52:02 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:52:02 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1fae19ae59884c44899bcd08aa243244,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:5db926c5-6530-4635-a0d5-806974a3b732,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:52:11.425: INFO: Logging kubelet events for node master3 Aug 18 11:52:11.427: INFO: Logging pods the kubelet thinks is on node master3 Aug 18 11:52:11.436: INFO: kube-flannel-x6tlr started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:52:11.436: INFO: Init container install-cni ready: true, restart count 1 Aug 18 11:52:11.436: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:52:11.436: INFO: kube-multus-ds-amd64-bkw6c started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:11.436: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:52:11.436: INFO: coredns-7677f9bb54-5hxfh started at 2021-08-18 08:23:54 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:11.436: INFO: Container coredns ready: true, restart count 1 Aug 18 11:52:11.436: INFO: node-exporter-vq7d8 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:52:11.436: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:52:11.436: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:52:11.436: INFO: kube-controller-manager-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:11.436: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:52:11.436: INFO: kube-scheduler-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:11.436: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:52:11.436: INFO: kube-apiserver-master3 started at 2021-08-18 08:29:12 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:11.436: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:52:11.436: INFO: kube-proxy-sd5lc started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:11.436: INFO: Container kube-proxy ready: true, restart count 2 W0818 11:52:11.450243 36 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:52:11.472: INFO: Latency metrics for node master3 Aug 18 11:52:11.472: INFO: Logging node info for node node1 Aug 18 11:52:11.475: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 84defabd-6ebf-43ec-a629-44c6713da9c9 73132 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"9a:87:55:36:7b:df"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:13 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:35 +0000 UTC,LastTransitionTime:2021-08-18 08:26:35 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:52:04 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:52:04 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:52:04 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:52:04 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:69946ff2b7bc462fa25eb7adb4703c23,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:736dc52f-f5e3-494e-86ca-01eedbea015c,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:a7cea43d9d2f67c38fbf0407786edbe660ee9072945f7bb272b55fd255e8eaca opnfv/barometer-collectd:stable],SizeBytes:1075746799,},ContainerImage{Names:[@ :],SizeBytes:1003788820,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[aquasec/kube-hunter@sha256:2be6820bc1d7e0f57193a9a27d5a3e16b2fd93c53747b03ce8ca48c6fc323781 aquasec/kube-hunter:0.3.1],SizeBytes:347611549,},ContainerImage{Names:[golang@sha256:db2475a1dbb2149508e5db31d7d77a75e6600d54be645f37681f03f2762169ba golang:alpine3.12],SizeBytes:301186719,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:de25c7fc6c4f3a27c7f0c2dff454e4671823a34d88abd533f210848d527e0fbb alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:52:11.476: INFO: Logging kubelet events for node node1 Aug 18 11:52:11.478: INFO: Logging pods the kubelet thinks is on node node1 Aug 18 11:52:11.492: INFO: prometheus-k8s-0 started at 2021-08-18 08:34:03 +0000 UTC (0+5 container statuses recorded) Aug 18 11:52:11.493: INFO: Container custom-metrics-apiserver ready: true, restart count 0 Aug 18 11:52:11.493: INFO: Container grafana ready: true, restart count 0 Aug 18 11:52:11.493: INFO: Container prometheus ready: true, restart count 1 Aug 18 11:52:11.493: INFO: Container prometheus-config-reloader ready: true, restart count 0 Aug 18 11:52:11.493: INFO: Container rules-configmap-reloader ready: true, restart count 0 Aug 18 11:52:11.493: INFO: kube-flannel-q78nd started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:52:11.493: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:52:11.493: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:52:11.493: INFO: node-feature-discovery-worker-pflgw started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:11.493: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:52:11.493: INFO: node-exporter-kcwvn started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:52:11.493: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:52:11.493: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:52:11.493: INFO: pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a started at 2021-08-18 11:52:01 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:11.493: INFO: Container env-test ready: false, restart count 0 Aug 18 11:52:11.493: INFO: ss-0 started at 2021-08-18 11:47:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:11.493: INFO: Container webserver ready: false, restart count 0 Aug 18 11:52:11.493: INFO: kube-multus-ds-amd64-rrvmb started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:11.493: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:52:11.493: INFO: kubernetes-metrics-scraper-678c97765c-9nsv5 started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:11.493: INFO: Container kubernetes-metrics-scraper ready: true, restart count 2 Aug 18 11:52:11.493: INFO: cmk-init-discover-node1-bxznx started at 2021-08-18 08:32:10 +0000 UTC (0+3 container statuses recorded) Aug 18 11:52:11.493: INFO: Container discover ready: false, restart count 0 Aug 18 11:52:11.493: INFO: Container init ready: false, restart count 0 Aug 18 11:52:11.493: INFO: Container install ready: false, restart count 0 Aug 18 11:52:11.493: INFO: cmk-d8r27 started at 2021-08-18 08:32:52 +0000 UTC (0+2 container statuses recorded) Aug 18 11:52:11.493: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:52:11.493: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:52:11.493: INFO: collectd-xdprr started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:52:11.493: INFO: Container collectd ready: true, restart count 0 Aug 18 11:52:11.493: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:52:11.493: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:52:11.493: INFO: kube-proxy-p6jvp started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:11.493: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:52:11.493: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-vsxvg started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:11.493: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:52:11.493: INFO: pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975 started at 2021-08-18 11:47:15 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:11.493: INFO: Container secret-env-test ready: false, restart count 0 Aug 18 11:52:11.493: INFO: var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209 started at 2021-08-18 11:47:57 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:11.493: INFO: Container dapi-container ready: false, restart count 0 Aug 18 11:52:11.493: INFO: affinity-nodeport-f9b5h started at 2021-08-18 11:49:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:11.493: INFO: Container affinity-nodeport ready: true, restart count 0 Aug 18 11:52:11.493: INFO: nginx-proxy-node1 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:11.493: INFO: Container nginx-proxy ready: true, restart count 2 W0818 11:52:11.505722 36 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:52:11.568: INFO: Latency metrics for node node1 Aug 18 11:52:11.568: INFO: Logging node info for node node2 Aug 18 11:52:11.572: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 1d01177e-3dbb-48a1-a0bc-d18af27ab7f8 73176 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:d1:47:f8:1d:22"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:36 +0000 UTC,LastTransitionTime:2021-08-18 08:26:36 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:52:09 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:52:09 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:52:09 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:52:09 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:dc1f286135c145349b8a016880b65a2f,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:037e7e2d-94e9-42f4-a719-896e5005ac70,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:52:11.573: INFO: Logging kubelet events for node node2 Aug 18 11:52:11.576: INFO: Logging pods the kubelet thinks is on node node2 Aug 18 11:52:11.591: INFO: affinity-nodeport-cc62g started at 2021-08-18 11:49:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:11.591: INFO: Container affinity-nodeport ready: true, restart count 0 Aug 18 11:52:11.591: INFO: nginx-proxy-node2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:11.591: INFO: Container nginx-proxy ready: true, restart count 1 Aug 18 11:52:11.591: INFO: cmk-init-discover-node2-6b2kz started at 2021-08-18 08:32:30 +0000 UTC (0+3 container statuses recorded) Aug 18 11:52:11.591: INFO: Container discover ready: false, restart count 0 Aug 18 11:52:11.591: INFO: Container init ready: false, restart count 0 Aug 18 11:52:11.591: INFO: Container install ready: false, restart count 0 Aug 18 11:52:11.591: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-7rn45 started at 2021-08-18 08:36:42 +0000 UTC (0+2 container statuses recorded) Aug 18 11:52:11.591: INFO: Container tas-controller ready: true, restart count 0 Aug 18 11:52:11.591: INFO: Container tas-extender ready: true, restart count 0 Aug 18 11:52:11.591: INFO: kubernetes-dashboard-86c6f9df5b-qrtdk started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:11.591: INFO: Container kubernetes-dashboard ready: true, restart count 2 Aug 18 11:52:11.591: INFO: cmk-748rz started at 2021-08-18 08:32:53 +0000 UTC (0+2 container statuses recorded) Aug 18 11:52:11.591: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:52:11.591: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:52:11.591: INFO: prometheus-operator-5bb8cb9d8f-k97ws started at 2021-08-18 08:33:38 +0000 UTC (0+2 container statuses recorded) Aug 18 11:52:11.591: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:52:11.591: INFO: Container prometheus-operator ready: true, restart count 0 Aug 18 11:52:11.591: INFO: kube-proxy-qkj9c started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:11.591: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:52:11.591: INFO: node-feature-discovery-worker-hzpf5 started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:11.591: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:52:11.591: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-c82pt started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:11.591: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:52:11.591: INFO: termination-message-container84499a62-bd35-4cdc-809d-811cd552608a started at 2021-08-18 11:51:42 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:11.591: INFO: Container termination-message-container ready: false, restart count 0 Aug 18 11:52:11.591: INFO: bin-falsea5f6898f-c6c3-4680-9cbd-f4985908f73e started at 2021-08-18 11:49:10 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:11.591: INFO: Container bin-falsea5f6898f-c6c3-4680-9cbd-f4985908f73e ready: false, restart count 0 Aug 18 11:52:11.591: INFO: kube-multus-ds-amd64-rvzsg started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:11.591: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:52:11.591: INFO: collectd-67ntq started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:52:11.591: INFO: Container collectd ready: true, restart count 0 Aug 18 11:52:11.591: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:52:11.591: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:52:11.591: INFO: ss-0 started at 2021-08-18 11:46:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:11.591: INFO: Container webserver ready: false, restart count 0 Aug 18 11:52:11.591: INFO: cmk-webhook-6c9d5f8578-7cxjr started at 2021-08-18 08:32:53 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:11.591: INFO: Container cmk-webhook ready: true, restart count 0 Aug 18 11:52:11.591: INFO: terminate-cmd-rpad23b99c9-2d62-4758-a55c-1712aba45053 started at 2021-08-18 11:50:30 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:11.591: INFO: Container terminate-cmd-rpa ready: false, restart count 0 Aug 18 11:52:11.591: INFO: execpod-affinityk47wl started at 2021-08-18 11:50:05 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:11.592: INFO: Container agnhost-container ready: true, restart count 0 Aug 18 11:52:11.592: INFO: kube-flannel-h7t5h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:52:11.592: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:52:11.592: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:52:11.592: INFO: node-exporter-lrrf2 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:52:11.592: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:52:11.592: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:52:11.592: INFO: affinity-nodeport-qvd62 started at 2021-08-18 11:49:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:11.592: INFO: Container affinity-nodeport ready: true, restart count 0 W0818 11:52:11.603615 36 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:52:11.635: INFO: Latency metrics for node node2 Aug 18 11:52:11.635: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "services-7760" for this suite. [AfterEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:786 • Failure [162.978 seconds] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/framework.go:23 should have session affinity timeout work for NodePort service [LinuxOnly] [Conformance] [It] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:51:55.406: Unexpected error: <*errors.errorString | 0xc003a98880>: { s: "service is not reachable within 2m0s timeout on endpoint 10.10.190.207:30790 over TCP protocol", } service is not reachable within 2m0s timeout on endpoint 10.10.190.207:30790 over TCP protocol occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:3444 ------------------------------ {"msg":"FAILED [sig-network] Services should have session affinity timeout work for NodePort service [LinuxOnly] [Conformance]","total":-1,"completed":33,"skipped":814,"failed":5,"failures":["[sig-network] Services should be able to create a functioning NodePort service [Conformance]","[k8s.io] Pods should support retrieving logs from the container over websockets [NodeConformance] [Conformance]","[k8s.io] InitContainer [NodeConformance] should not start app containers if init containers fail on a RestartAlways pod [Conformance]","[k8s.io] Container Runtime blackbox test on terminated container should report termination message [LinuxOnly] if TerminationMessagePath is set as non-root user and at a non-default path [NodeConformance] [Conformance]","[sig-network] Services should have session affinity timeout work for NodePort service [LinuxOnly] [Conformance]"]} SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-storage] EmptyDir volumes /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:52:11.737: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename emptydir STEP: Waiting for a default service account to be provisioned in namespace [It] should support (root,0666,default) [LinuxOnly] [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating a pod to test emptydir 0666 on node default medium Aug 18 11:52:11.774: INFO: Waiting up to 5m0s for pod "pod-f5f977e6-8cd1-47d8-8789-d290623a70f1" in namespace "emptydir-5132" to be "Succeeded or Failed" Aug 18 11:52:11.776: INFO: Pod "pod-f5f977e6-8cd1-47d8-8789-d290623a70f1": Phase="Pending", Reason="", readiness=false. Elapsed: 1.970883ms Aug 18 11:52:13.779: INFO: Pod "pod-f5f977e6-8cd1-47d8-8789-d290623a70f1": Phase="Pending", Reason="", readiness=false. Elapsed: 2.004503736s Aug 18 11:52:15.782: INFO: Pod "pod-f5f977e6-8cd1-47d8-8789-d290623a70f1": Phase="Pending", Reason="", readiness=false. Elapsed: 4.007955104s Aug 18 11:52:17.786: INFO: Pod "pod-f5f977e6-8cd1-47d8-8789-d290623a70f1": Phase="Succeeded", Reason="", readiness=false. Elapsed: 6.011771134s STEP: Saw pod success Aug 18 11:52:17.786: INFO: Pod "pod-f5f977e6-8cd1-47d8-8789-d290623a70f1" satisfied condition "Succeeded or Failed" Aug 18 11:52:17.788: INFO: Trying to get logs from node node2 pod pod-f5f977e6-8cd1-47d8-8789-d290623a70f1 container test-container: STEP: delete the pod Aug 18 11:52:17.804: INFO: Waiting for pod pod-f5f977e6-8cd1-47d8-8789-d290623a70f1 to disappear Aug 18 11:52:17.805: INFO: Pod pod-f5f977e6-8cd1-47d8-8789-d290623a70f1 no longer exists [AfterEach] [sig-storage] EmptyDir volumes /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:52:17.806: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "emptydir-5132" for this suite. • [SLOW TEST:6.077 seconds] [sig-storage] EmptyDir volumes /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/empty_dir.go:42 should support (root,0666,default) [LinuxOnly] [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-storage] EmptyDir volumes should support (root,0666,default) [LinuxOnly] [NodeConformance] [Conformance]","total":-1,"completed":34,"skipped":862,"failed":5,"failures":["[sig-network] Services should be able to create a functioning NodePort service [Conformance]","[k8s.io] Pods should support retrieving logs from the container over websockets [NodeConformance] [Conformance]","[k8s.io] InitContainer [NodeConformance] should not start app containers if init containers fail on a RestartAlways pod [Conformance]","[k8s.io] Container Runtime blackbox test on terminated container should report termination message [LinuxOnly] if TerminationMessagePath is set as non-root user and at a non-default path [NodeConformance] [Conformance]","[sig-network] Services should have session affinity timeout work for NodePort service [LinuxOnly] [Conformance]"]} SSS ------------------------------ {"msg":"PASSED [sig-storage] EmptyDir volumes should support (root,0666,tmpfs) [LinuxOnly] [NodeConformance] [Conformance]","total":-1,"completed":9,"skipped":174,"failed":2,"failures":["[k8s.io] Variable Expansion should allow substituting values in a volume subpath [sig-storage] [Conformance]","[sig-apps] StatefulSet [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] should perform canary updates and phased rolling updates of template modifications [Conformance]"]} [BeforeEach] [sig-api-machinery] Secrets /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:47:15.241: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename secrets STEP: Waiting for a default service account to be provisioned in namespace [It] should be consumable from pods in env vars [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating secret with name secret-test-cc404000-0328-442e-b166-ea594d8acc79 STEP: Creating a pod to test consume secrets Aug 18 11:47:15.283: INFO: Waiting up to 5m0s for pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975" in namespace "secrets-3112" to be "Succeeded or Failed" Aug 18 11:47:15.287: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 3.825185ms Aug 18 11:47:17.290: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 2.006934489s Aug 18 11:47:19.293: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 4.010013034s Aug 18 11:47:21.296: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 6.013639813s Aug 18 11:47:23.299: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 8.016559827s Aug 18 11:47:25.304: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 10.021028305s Aug 18 11:47:27.307: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 12.024522323s Aug 18 11:47:29.310: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 14.027327004s Aug 18 11:47:31.314: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 16.031006592s Aug 18 11:47:33.317: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 18.034269874s Aug 18 11:47:35.321: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 20.037830433s Aug 18 11:47:37.325: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 22.042445038s Aug 18 11:47:39.328: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 24.044991858s Aug 18 11:47:41.331: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 26.048603346s Aug 18 11:47:43.335: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 28.052112547s Aug 18 11:47:45.338: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 30.055085247s Aug 18 11:47:47.341: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 32.057935606s Aug 18 11:47:49.343: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 34.060584057s Aug 18 11:47:51.346: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 36.063614369s Aug 18 11:47:53.349: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 38.066610046s Aug 18 11:47:55.353: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 40.069869947s Aug 18 11:47:57.355: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 42.072630346s Aug 18 11:47:59.358: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 44.075350704s Aug 18 11:48:01.362: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 46.078805102s Aug 18 11:48:03.365: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 48.082622719s Aug 18 11:48:05.369: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 50.086146808s Aug 18 11:48:07.372: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 52.088799534s Aug 18 11:48:09.375: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 54.091784472s Aug 18 11:48:11.378: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 56.094686013s Aug 18 11:48:13.381: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 58.097930838s Aug 18 11:48:15.385: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.102507699s Aug 18 11:48:17.388: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.10562473s Aug 18 11:48:19.392: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.109484594s Aug 18 11:48:21.396: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.112686832s Aug 18 11:48:23.398: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.115504165s Aug 18 11:48:25.401: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.118512067s Aug 18 11:48:27.404: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.120907915s Aug 18 11:48:29.407: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.124320118s Aug 18 11:48:31.410: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.127302177s Aug 18 11:48:33.414: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.131280954s Aug 18 11:48:35.419: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.135822794s Aug 18 11:48:37.424: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.141086864s Aug 18 11:48:39.427: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.144297453s Aug 18 11:48:41.430: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.147497078s Aug 18 11:48:43.433: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.150597878s Aug 18 11:48:45.437: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.15450447s Aug 18 11:48:47.441: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.157717301s Aug 18 11:48:49.443: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.160183171s Aug 18 11:48:51.446: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.163050078s Aug 18 11:48:53.449: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.166576976s Aug 18 11:48:55.452: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.169625106s Aug 18 11:48:57.455: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.172414661s Aug 18 11:48:59.458: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.174868061s Aug 18 11:49:01.460: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.177596518s Aug 18 11:49:03.463: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.180647382s Aug 18 11:49:05.467: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.183970439s Aug 18 11:49:07.469: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.186671834s Aug 18 11:49:09.472: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.189502903s Aug 18 11:49:11.476: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.19317854s Aug 18 11:49:13.479: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.196441635s Aug 18 11:49:15.482: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.199156616s Aug 18 11:49:17.485: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.201893475s Aug 18 11:49:19.488: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.205346055s Aug 18 11:49:21.490: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.20761993s Aug 18 11:49:23.493: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.210346682s Aug 18 11:49:25.496: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.212765172s Aug 18 11:49:27.498: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.21548969s Aug 18 11:49:29.501: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.218478983s Aug 18 11:49:31.505: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.221796753s Aug 18 11:49:33.507: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.22435364s Aug 18 11:49:35.511: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.228444952s Aug 18 11:49:37.515: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.232100043s Aug 18 11:49:39.518: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.235157754s Aug 18 11:49:41.521: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.238479481s Aug 18 11:49:43.524: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.241487261s Aug 18 11:49:45.528: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.244976371s Aug 18 11:49:47.531: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.247816531s Aug 18 11:49:49.534: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.251531127s Aug 18 11:49:51.539: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.255978211s Aug 18 11:49:53.543: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.260013118s Aug 18 11:49:55.548: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.264983521s Aug 18 11:49:57.551: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.268267104s Aug 18 11:49:59.553: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.270642849s Aug 18 11:50:01.558: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.274755976s Aug 18 11:50:03.560: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.277183936s Aug 18 11:50:05.564: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.28133939s Aug 18 11:50:07.567: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.283714182s Aug 18 11:50:09.569: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.286394593s Aug 18 11:50:11.572: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.289131033s Aug 18 11:50:13.575: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.29202649s Aug 18 11:50:15.578: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.295159085s Aug 18 11:50:17.582: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.299395134s Aug 18 11:50:19.585: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.302075998s Aug 18 11:50:21.587: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.304658237s Aug 18 11:50:23.590: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.307458811s Aug 18 11:50:25.594: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.311264407s Aug 18 11:50:27.597: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.314058879s Aug 18 11:50:29.600: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.317012078s Aug 18 11:50:31.603: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.320548469s Aug 18 11:50:33.606: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.323392132s Aug 18 11:50:35.609: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.32596178s Aug 18 11:50:37.612: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.329447101s Aug 18 11:50:39.615: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.332478672s Aug 18 11:50:41.618: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.335465878s Aug 18 11:50:43.621: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.338421338s Aug 18 11:50:45.626: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.342982142s Aug 18 11:50:47.629: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.346024203s Aug 18 11:50:49.632: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.34959484s Aug 18 11:50:51.636: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.353307483s Aug 18 11:50:53.640: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.357491322s Aug 18 11:50:55.643: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.360614407s Aug 18 11:50:57.647: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.363881302s Aug 18 11:50:59.649: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.366619288s Aug 18 11:51:01.652: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.369344026s Aug 18 11:51:03.655: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.372643875s Aug 18 11:51:05.659: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.376393044s Aug 18 11:51:07.662: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.379061111s Aug 18 11:51:09.665: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.381907815s Aug 18 11:51:11.668: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.384809357s Aug 18 11:51:13.670: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.387628785s Aug 18 11:51:15.673: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.39008542s Aug 18 11:51:17.676: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.393495939s Aug 18 11:51:19.679: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.395818557s Aug 18 11:51:21.683: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.400610418s Aug 18 11:51:23.687: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.404150093s Aug 18 11:51:25.690: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.406900487s Aug 18 11:51:27.693: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.410622318s Aug 18 11:51:29.696: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.413615711s Aug 18 11:51:31.699: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.416328975s Aug 18 11:51:33.702: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.419429682s Aug 18 11:51:35.706: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.42316521s Aug 18 11:51:37.709: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.425746941s Aug 18 11:51:39.712: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.428840006s Aug 18 11:51:41.714: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.431196663s Aug 18 11:51:43.717: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.434443685s Aug 18 11:51:45.721: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.438268556s Aug 18 11:51:47.724: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.441195419s Aug 18 11:51:49.727: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.444192208s Aug 18 11:51:51.730: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.447241432s Aug 18 11:51:53.733: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.450129033s Aug 18 11:51:55.736: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.45287851s Aug 18 11:51:57.738: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.455567866s Aug 18 11:51:59.742: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.458906122s Aug 18 11:52:01.744: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.461531352s Aug 18 11:52:03.748: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.464756808s Aug 18 11:52:05.752: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.468921524s Aug 18 11:52:07.755: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.471716383s Aug 18 11:52:09.758: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.475322026s Aug 18 11:52:11.761: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.478246333s Aug 18 11:52:13.764: INFO: Pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.481576697s Aug 18 11:52:15.971: INFO: Failed to get logs from node "node1" pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975" container "secret-env-test": the server rejected our request for an unknown reason (get pods pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975) STEP: delete the pod Aug 18 11:52:15.976: INFO: Waiting for pod pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975 to disappear Aug 18 11:52:15.978: INFO: Pod pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975 still exists Aug 18 11:52:17.979: INFO: Waiting for pod pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975 to disappear Aug 18 11:52:17.981: INFO: Pod pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975 still exists Aug 18 11:52:19.979: INFO: Waiting for pod pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975 to disappear Aug 18 11:52:19.982: INFO: Pod pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975 no longer exists Aug 18 11:52:19.983: FAIL: Unexpected error: <*errors.errorString | 0xc00201c490>: { s: "expected pod \"pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975\" success: Gave up after waiting 5m0s for pod \"pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975\" to be \"Succeeded or Failed\"", } expected pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975" success: Gave up after waiting 5m0s for pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975" to be "Succeeded or Failed" occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).testContainerOutputMatcher(0xc00004f760, 0x4c10f08, 0xf, 0xc00136f400, 0x0, 0xc000cd5168, 0x1, 0x1, 0x4deefa8) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 +0x1ee k8s.io/kubernetes/test/e2e/framework.(*Framework).TestContainerOutput(...) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:525 k8s.io/kubernetes/test/e2e/common.glob..func27.1() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/secrets.go:83 +0x91a k8s.io/kubernetes/test/e2e.RunE2ETests(0xc003198780) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc003198780) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc003198780, 0x4deb2c0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [sig-api-machinery] Secrets /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "secrets-3112". STEP: Found 7 events. Aug 18 11:52:19.987: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975: { } Scheduled: Successfully assigned secrets-3112/pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975 to node1 Aug 18 11:52:19.987: INFO: At 2021-08-18 11:47:17 +0000 UTC - event for pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975: {multus } AddedInterface: Add eth0 [10.244.4.77/24] Aug 18 11:52:19.987: INFO: At 2021-08-18 11:47:17 +0000 UTC - event for pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975: {kubelet node1} Pulling: Pulling image "docker.io/library/busybox:1.29" Aug 18 11:52:19.987: INFO: At 2021-08-18 11:47:18 +0000 UTC - event for pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975: {kubelet node1} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit Aug 18 11:52:19.987: INFO: At 2021-08-18 11:47:18 +0000 UTC - event for pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975: {kubelet node1} Failed: Error: ErrImagePull Aug 18 11:52:19.987: INFO: At 2021-08-18 11:47:18 +0000 UTC - event for pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975: {kubelet node1} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" Aug 18 11:52:19.987: INFO: At 2021-08-18 11:47:18 +0000 UTC - event for pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975: {kubelet node1} Failed: Error: ImagePullBackOff Aug 18 11:52:19.989: INFO: POD NODE PHASE GRACE CONDITIONS Aug 18 11:52:19.989: INFO: Aug 18 11:52:19.993: INFO: Logging node info for node master1 Aug 18 11:52:19.996: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 ebb211fa-503f-4cfe-b1ed-c95d27a70e6e 73310 0 2021-08-18 08:20:52 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"3a:82:be:72:b5:15"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:20:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:20:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:25:59 +0000 UTC,LastTransitionTime:2021-08-18 08:25:59 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:52:18 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:52:18 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:52:18 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:52:18 +0000 UTC,LastTransitionTime:2021-08-18 08:25:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:58c3e57359b641ad92fa1959f2fecf5d,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:012cd796-2076-45d6-8b14-d3e0451b1e64,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[@ :],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:52:19.997: INFO: Logging kubelet events for node master1 Aug 18 11:52:19.999: INFO: Logging pods the kubelet thinks is on node master1 Aug 18 11:52:20.007: INFO: kube-apiserver-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:20.007: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:52:20.007: INFO: kube-proxy-vqk4v started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:20.007: INFO: Container kube-proxy ready: true, restart count 1 Aug 18 11:52:20.007: INFO: kube-flannel-q64cq started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:52:20.007: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:52:20.007: INFO: Container kube-flannel ready: true, restart count 3 Aug 18 11:52:20.007: INFO: coredns-7677f9bb54-kn2qg started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:20.007: INFO: Container coredns ready: true, restart count 2 Aug 18 11:52:20.007: INFO: kube-scheduler-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:20.007: INFO: Container kube-scheduler ready: true, restart count 0 Aug 18 11:52:20.007: INFO: kube-controller-manager-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:20.007: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:52:20.007: INFO: kube-multus-ds-amd64-kbcp6 started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:20.007: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:52:20.007: INFO: docker-registry-docker-registry-56cbc7bc58-49kl2 started at 2021-08-18 08:26:23 +0000 UTC (0+2 container statuses recorded) Aug 18 11:52:20.007: INFO: Container docker-registry ready: true, restart count 0 Aug 18 11:52:20.007: INFO: Container nginx ready: true, restart count 0 Aug 18 11:52:20.007: INFO: node-exporter-5hwz9 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:52:20.007: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:52:20.007: INFO: Container node-exporter ready: true, restart count 0 W0818 11:52:20.020433 28 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:52:20.044: INFO: Latency metrics for node master1 Aug 18 11:52:20.044: INFO: Logging node info for node master2 Aug 18 11:52:20.047: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 78946293-3abe-4442-84d4-8ed6b1d15ce0 73284 0 2021-08-18 08:21:31 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"7e:f5:c2:cc:3a:b4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:21:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:21:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-08-18 08:29:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:52:16 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:52:16 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:52:16 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:52:16 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0c44122c7a7248c18d8571e1cc667258,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:0cd329f2-48e0-4c8f-b8b9-fa3ae0ed8406,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:52:20.047: INFO: Logging kubelet events for node master2 Aug 18 11:52:20.049: INFO: Logging pods the kubelet thinks is on node master2 Aug 18 11:52:20.059: INFO: kube-controller-manager-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:20.059: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:52:20.059: INFO: kube-proxy-kh2l9 started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:20.059: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:52:20.059: INFO: kube-flannel-pp56h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:52:20.060: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:52:20.060: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:52:20.060: INFO: node-exporter-48nfx started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:52:20.060: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:52:20.060: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:52:20.060: INFO: kube-apiserver-master2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:20.060: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:52:20.060: INFO: kube-scheduler-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:20.060: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:52:20.060: INFO: kube-multus-ds-amd64-mld8g started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:20.060: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:52:20.060: INFO: dns-autoscaler-5b7b5c9b6f-hh47r started at 2021-08-18 08:23:57 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:20.060: INFO: Container autoscaler ready: true, restart count 2 Aug 18 11:52:20.060: INFO: node-feature-discovery-controller-5bf5c49849-mq57c started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:20.060: INFO: Container nfd-controller ready: true, restart count 0 W0818 11:52:20.071339 28 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:52:20.097: INFO: Latency metrics for node master2 Aug 18 11:52:20.097: INFO: Logging node info for node master3 Aug 18 11:52:20.099: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 44feac2b-9447-4be2-9fcd-62f836d67c72 73218 0 2021-08-18 08:21:41 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"86:e4:31:99:58:40"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {kubelet Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:52:12 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:52:12 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:52:12 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:52:12 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1fae19ae59884c44899bcd08aa243244,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:5db926c5-6530-4635-a0d5-806974a3b732,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:52:20.100: INFO: Logging kubelet events for node master3 Aug 18 11:52:20.102: INFO: Logging pods the kubelet thinks is on node master3 Aug 18 11:52:20.112: INFO: kube-proxy-sd5lc started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:20.112: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:52:20.112: INFO: kube-flannel-x6tlr started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:52:20.112: INFO: Init container install-cni ready: true, restart count 1 Aug 18 11:52:20.112: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:52:20.112: INFO: kube-multus-ds-amd64-bkw6c started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:20.112: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:52:20.112: INFO: coredns-7677f9bb54-5hxfh started at 2021-08-18 08:23:54 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:20.112: INFO: Container coredns ready: true, restart count 1 Aug 18 11:52:20.112: INFO: node-exporter-vq7d8 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:52:20.112: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:52:20.112: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:52:20.112: INFO: kube-controller-manager-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:20.112: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:52:20.112: INFO: kube-scheduler-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:20.112: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:52:20.112: INFO: kube-apiserver-master3 started at 2021-08-18 08:29:12 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:20.112: INFO: Container kube-apiserver ready: true, restart count 0 W0818 11:52:20.124582 28 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:52:20.147: INFO: Latency metrics for node master3 Aug 18 11:52:20.147: INFO: Logging node info for node node1 Aug 18 11:52:20.151: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 84defabd-6ebf-43ec-a629-44c6713da9c9 73236 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"9a:87:55:36:7b:df"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:13 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:35 +0000 UTC,LastTransitionTime:2021-08-18 08:26:35 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:52:15 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:52:15 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:52:15 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:52:15 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:69946ff2b7bc462fa25eb7adb4703c23,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:736dc52f-f5e3-494e-86ca-01eedbea015c,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:a7cea43d9d2f67c38fbf0407786edbe660ee9072945f7bb272b55fd255e8eaca opnfv/barometer-collectd:stable],SizeBytes:1075746799,},ContainerImage{Names:[@ :],SizeBytes:1003788820,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[aquasec/kube-hunter@sha256:2be6820bc1d7e0f57193a9a27d5a3e16b2fd93c53747b03ce8ca48c6fc323781 aquasec/kube-hunter:0.3.1],SizeBytes:347611549,},ContainerImage{Names:[golang@sha256:db2475a1dbb2149508e5db31d7d77a75e6600d54be645f37681f03f2762169ba golang:alpine3.12],SizeBytes:301186719,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:de25c7fc6c4f3a27c7f0c2dff454e4671823a34d88abd533f210848d527e0fbb alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:52:20.151: INFO: Logging kubelet events for node node1 Aug 18 11:52:20.154: INFO: Logging pods the kubelet thinks is on node node1 Aug 18 11:52:20.168: INFO: kube-proxy-p6jvp started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:20.168: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:52:20.168: INFO: kubernetes-metrics-scraper-678c97765c-9nsv5 started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:20.168: INFO: Container kubernetes-metrics-scraper ready: true, restart count 2 Aug 18 11:52:20.168: INFO: cmk-init-discover-node1-bxznx started at 2021-08-18 08:32:10 +0000 UTC (0+3 container statuses recorded) Aug 18 11:52:20.168: INFO: Container discover ready: false, restart count 0 Aug 18 11:52:20.168: INFO: Container init ready: false, restart count 0 Aug 18 11:52:20.168: INFO: Container install ready: false, restart count 0 Aug 18 11:52:20.168: INFO: cmk-d8r27 started at 2021-08-18 08:32:52 +0000 UTC (0+2 container statuses recorded) Aug 18 11:52:20.168: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:52:20.168: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:52:20.168: INFO: collectd-xdprr started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:52:20.168: INFO: Container collectd ready: true, restart count 0 Aug 18 11:52:20.168: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:52:20.168: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:52:20.168: INFO: affinity-nodeport-f9b5h started at 2021-08-18 11:49:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:20.168: INFO: Container affinity-nodeport ready: false, restart count 0 Aug 18 11:52:20.168: INFO: nginx-proxy-node1 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:20.168: INFO: Container nginx-proxy ready: true, restart count 2 Aug 18 11:52:20.168: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-vsxvg started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:20.168: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:52:20.168: INFO: var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209 started at 2021-08-18 11:47:57 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:20.168: INFO: Container dapi-container ready: false, restart count 0 Aug 18 11:52:20.168: INFO: kube-flannel-q78nd started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:52:20.168: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:52:20.168: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:52:20.168: INFO: prometheus-k8s-0 started at 2021-08-18 08:34:03 +0000 UTC (0+5 container statuses recorded) Aug 18 11:52:20.168: INFO: Container custom-metrics-apiserver ready: true, restart count 0 Aug 18 11:52:20.168: INFO: Container grafana ready: true, restart count 0 Aug 18 11:52:20.168: INFO: Container prometheus ready: true, restart count 1 Aug 18 11:52:20.168: INFO: Container prometheus-config-reloader ready: true, restart count 0 Aug 18 11:52:20.168: INFO: Container rules-configmap-reloader ready: true, restart count 0 Aug 18 11:52:20.168: INFO: kube-multus-ds-amd64-rrvmb started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:20.169: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:52:20.169: INFO: node-feature-discovery-worker-pflgw started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:20.169: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:52:20.169: INFO: node-exporter-kcwvn started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:52:20.169: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:52:20.169: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:52:20.169: INFO: pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a started at 2021-08-18 11:52:01 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:20.169: INFO: Container env-test ready: false, restart count 0 Aug 18 11:52:20.169: INFO: ss-0 started at 2021-08-18 11:47:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:20.169: INFO: Container webserver ready: false, restart count 0 W0818 11:52:20.180063 28 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:52:20.222: INFO: Latency metrics for node node1 Aug 18 11:52:20.222: INFO: Logging node info for node node2 Aug 18 11:52:20.225: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 1d01177e-3dbb-48a1-a0bc-d18af27ab7f8 73320 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:d1:47:f8:1d:22"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:36 +0000 UTC,LastTransitionTime:2021-08-18 08:26:36 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:52:19 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:52:19 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:52:19 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:52:19 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:dc1f286135c145349b8a016880b65a2f,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:037e7e2d-94e9-42f4-a719-896e5005ac70,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:52:20.226: INFO: Logging kubelet events for node node2 Aug 18 11:52:20.228: INFO: Logging pods the kubelet thinks is on node node2 Aug 18 11:52:20.241: INFO: cmk-748rz started at 2021-08-18 08:32:53 +0000 UTC (0+2 container statuses recorded) Aug 18 11:52:20.241: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:52:20.241: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:52:20.241: INFO: kube-proxy-qkj9c started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:20.241: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:52:20.241: INFO: node-feature-discovery-worker-hzpf5 started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:20.241: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:52:20.241: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-c82pt started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:20.241: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:52:20.241: INFO: prometheus-operator-5bb8cb9d8f-k97ws started at 2021-08-18 08:33:38 +0000 UTC (0+2 container statuses recorded) Aug 18 11:52:20.241: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:52:20.241: INFO: Container prometheus-operator ready: true, restart count 0 Aug 18 11:52:20.241: INFO: kube-multus-ds-amd64-rvzsg started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:20.241: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:52:20.241: INFO: collectd-67ntq started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:52:20.241: INFO: Container collectd ready: true, restart count 0 Aug 18 11:52:20.241: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:52:20.241: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:52:20.241: INFO: ss-0 started at 2021-08-18 11:46:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:20.241: INFO: Container webserver ready: false, restart count 0 Aug 18 11:52:20.241: INFO: termination-message-container84499a62-bd35-4cdc-809d-811cd552608a started at 2021-08-18 11:51:42 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:20.241: INFO: Container termination-message-container ready: false, restart count 0 Aug 18 11:52:20.241: INFO: bin-falsea5f6898f-c6c3-4680-9cbd-f4985908f73e started at 2021-08-18 11:49:10 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:20.241: INFO: Container bin-falsea5f6898f-c6c3-4680-9cbd-f4985908f73e ready: false, restart count 0 Aug 18 11:52:20.241: INFO: cmk-webhook-6c9d5f8578-7cxjr started at 2021-08-18 08:32:53 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:20.241: INFO: Container cmk-webhook ready: true, restart count 0 Aug 18 11:52:20.241: INFO: terminate-cmd-rpad23b99c9-2d62-4758-a55c-1712aba45053 started at 2021-08-18 11:50:30 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:20.241: INFO: Container terminate-cmd-rpa ready: false, restart count 0 Aug 18 11:52:20.241: INFO: kube-flannel-h7t5h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:52:20.241: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:52:20.241: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:52:20.241: INFO: node-exporter-lrrf2 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:52:20.241: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:52:20.241: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:52:20.241: INFO: nginx-proxy-node2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:20.241: INFO: Container nginx-proxy ready: true, restart count 1 Aug 18 11:52:20.241: INFO: cmk-init-discover-node2-6b2kz started at 2021-08-18 08:32:30 +0000 UTC (0+3 container statuses recorded) Aug 18 11:52:20.241: INFO: Container discover ready: false, restart count 0 Aug 18 11:52:20.241: INFO: Container init ready: false, restart count 0 Aug 18 11:52:20.241: INFO: Container install ready: false, restart count 0 Aug 18 11:52:20.241: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-7rn45 started at 2021-08-18 08:36:42 +0000 UTC (0+2 container statuses recorded) Aug 18 11:52:20.241: INFO: Container tas-controller ready: true, restart count 0 Aug 18 11:52:20.241: INFO: Container tas-extender ready: true, restart count 0 Aug 18 11:52:20.241: INFO: kubernetes-dashboard-86c6f9df5b-qrtdk started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:20.241: INFO: Container kubernetes-dashboard ready: true, restart count 2 W0818 11:52:20.254485 28 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:52:20.295: INFO: Latency metrics for node node2 Aug 18 11:52:20.295: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "secrets-3112" for this suite. • Failure [305.063 seconds] [sig-api-machinery] Secrets /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/secrets.go:36 should be consumable from pods in env vars [NodeConformance] [Conformance] [It] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:52:19.983: Unexpected error: <*errors.errorString | 0xc00201c490>: { s: "expected pod \"pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975\" success: Gave up after waiting 5m0s for pod \"pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975\" to be \"Succeeded or Failed\"", } expected pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975" success: Gave up after waiting 5m0s for pod "pod-secrets-f29e4447-a1aa-4dcc-9563-cab942542975" to be "Succeeded or Failed" occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 ------------------------------ {"msg":"FAILED [sig-api-machinery] Secrets should be consumable from pods in env vars [NodeConformance] [Conformance]","total":-1,"completed":9,"skipped":174,"failed":3,"failures":["[k8s.io] Variable Expansion should allow substituting values in a volume subpath [sig-storage] [Conformance]","[sig-apps] StatefulSet [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] should perform canary updates and phased rolling updates of template modifications [Conformance]","[sig-api-machinery] Secrets should be consumable from pods in env vars [NodeConformance] [Conformance]"]} SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:49:59.554: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename services STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:782 [It] should have session affinity work for NodePort service [LinuxOnly] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: creating service in namespace services-141 STEP: creating service affinity-nodeport in namespace services-141 STEP: creating replication controller affinity-nodeport in namespace services-141 I0818 11:49:59.586332 38 runners.go:190] Created replication controller with name: affinity-nodeport, namespace: services-141, replica count: 3 I0818 11:50:02.636926 38 runners.go:190] affinity-nodeport Pods: 3 out of 3 created, 1 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0818 11:50:05.637339 38 runners.go:190] affinity-nodeport Pods: 3 out of 3 created, 3 running, 0 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady Aug 18 11:50:05.646: INFO: Creating new exec pod Aug 18 11:50:10.669: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 affinity-nodeport 80' Aug 18 11:50:10.928: INFO: stderr: "+ nc -zv -t -w 2 affinity-nodeport 80\nConnection to affinity-nodeport 80 port [tcp/http] succeeded!\n" Aug 18 11:50:10.928: INFO: stdout: "" Aug 18 11:50:10.929: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.233.48.91 80' Aug 18 11:50:11.193: INFO: stderr: "+ nc -zv -t -w 2 10.233.48.91 80\nConnection to 10.233.48.91 80 port [tcp/http] succeeded!\n" Aug 18 11:50:11.193: INFO: stdout: "" Aug 18 11:50:11.193: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:50:11.457: INFO: rc: 1 Aug 18 11:50:11.457: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:12.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:50:12.723: INFO: rc: 1 Aug 18 11:50:12.723: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:13.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:50:14.323: INFO: rc: 1 Aug 18 11:50:14.323: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:14.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:50:14.721: INFO: rc: 1 Aug 18 11:50:14.721: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:15.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:50:15.784: INFO: rc: 1 Aug 18 11:50:15.784: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:16.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:50:16.730: INFO: rc: 1 Aug 18 11:50:16.730: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:17.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:50:17.729: INFO: rc: 1 Aug 18 11:50:17.729: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:18.459: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:50:18.717: INFO: rc: 1 Aug 18 11:50:18.717: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:19.459: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:50:19.779: INFO: rc: 1 Aug 18 11:50:19.780: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:20.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:50:20.704: INFO: rc: 1 Aug 18 11:50:20.704: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:21.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:50:21.710: INFO: rc: 1 Aug 18 11:50:21.710: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:22.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:50:22.722: INFO: rc: 1 Aug 18 11:50:22.722: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:23.459: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:50:23.743: INFO: rc: 1 Aug 18 11:50:23.743: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:24.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:50:24.749: INFO: rc: 1 Aug 18 11:50:24.749: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:25.459: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:50:25.748: INFO: rc: 1 Aug 18 11:50:25.748: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:26.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:50:26.712: INFO: rc: 1 Aug 18 11:50:26.712: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:27.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:50:27.709: INFO: rc: 1 Aug 18 11:50:27.709: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:28.459: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:50:28.722: INFO: rc: 1 Aug 18 11:50:28.722: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:29.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:50:29.771: INFO: rc: 1 Aug 18 11:50:29.771: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:30.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:50:30.717: INFO: rc: 1 Aug 18 11:50:30.717: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:31.459: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:50:31.972: INFO: rc: 1 Aug 18 11:50:31.972: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:32.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:50:32.698: INFO: rc: 1 Aug 18 11:50:32.698: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:33.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:50:33.732: INFO: rc: 1 Aug 18 11:50:33.732: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:34.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:50:34.720: INFO: rc: 1 Aug 18 11:50:34.720: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:35.459: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:50:35.721: INFO: rc: 1 Aug 18 11:50:35.721: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:36.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:50:36.729: INFO: rc: 1 Aug 18 11:50:36.729: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:37.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:50:37.728: INFO: rc: 1 Aug 18 11:50:37.728: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:38.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:50:38.730: INFO: rc: 1 Aug 18 11:50:38.730: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:39.459: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:50:39.728: INFO: rc: 1 Aug 18 11:50:39.728: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:40.459: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:50:40.713: INFO: rc: 1 Aug 18 11:50:40.713: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:41.460: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:50:41.727: INFO: rc: 1 Aug 18 11:50:41.727: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:42.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:50:42.718: INFO: rc: 1 Aug 18 11:50:42.718: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:43.459: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:50:44.577: INFO: rc: 1 Aug 18 11:50:44.577: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:45.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:50:45.723: INFO: rc: 1 Aug 18 11:50:45.723: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:46.459: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:50:46.724: INFO: rc: 1 Aug 18 11:50:46.724: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:47.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:50:47.766: INFO: rc: 1 Aug 18 11:50:47.766: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:48.459: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:50:48.703: INFO: rc: 1 Aug 18 11:50:48.703: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:49.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:50:49.734: INFO: rc: 1 Aug 18 11:50:49.734: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:50.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:50:50.711: INFO: rc: 1 Aug 18 11:50:50.711: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:51.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:50:51.744: INFO: rc: 1 Aug 18 11:50:51.744: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:52.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:50:52.754: INFO: rc: 1 Aug 18 11:50:52.754: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:53.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:50:53.733: INFO: rc: 1 Aug 18 11:50:53.733: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:54.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:50:54.772: INFO: rc: 1 Aug 18 11:50:54.772: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:55.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:50:55.736: INFO: rc: 1 Aug 18 11:50:55.736: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:56.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:50:56.704: INFO: rc: 1 Aug 18 11:50:56.704: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:57.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:50:57.716: INFO: rc: 1 Aug 18 11:50:57.716: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:58.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:50:58.715: INFO: rc: 1 Aug 18 11:50:58.715: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:50:59.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:50:59.755: INFO: rc: 1 Aug 18 11:50:59.755: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:00.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:51:00.733: INFO: rc: 1 Aug 18 11:51:00.733: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:01.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:51:01.732: INFO: rc: 1 Aug 18 11:51:01.732: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:02.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:51:02.725: INFO: rc: 1 Aug 18 11:51:02.725: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:03.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:51:03.763: INFO: rc: 1 Aug 18 11:51:03.763: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:04.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:51:04.722: INFO: rc: 1 Aug 18 11:51:04.722: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:05.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:51:05.709: INFO: rc: 1 Aug 18 11:51:05.709: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:06.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:51:06.718: INFO: rc: 1 Aug 18 11:51:06.718: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:07.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:51:07.713: INFO: rc: 1 Aug 18 11:51:07.713: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:08.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:51:08.721: INFO: rc: 1 Aug 18 11:51:08.722: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:09.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:51:09.711: INFO: rc: 1 Aug 18 11:51:09.711: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:10.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:51:10.728: INFO: rc: 1 Aug 18 11:51:10.728: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:11.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:51:11.741: INFO: rc: 1 Aug 18 11:51:11.741: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:12.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:51:12.809: INFO: rc: 1 Aug 18 11:51:12.810: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:13.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:51:13.746: INFO: rc: 1 Aug 18 11:51:13.746: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:14.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:51:14.997: INFO: rc: 1 Aug 18 11:51:14.997: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:15.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:51:15.739: INFO: rc: 1 Aug 18 11:51:15.739: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:16.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:51:16.727: INFO: rc: 1 Aug 18 11:51:16.727: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:17.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:51:17.697: INFO: rc: 1 Aug 18 11:51:17.698: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:18.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:51:18.724: INFO: rc: 1 Aug 18 11:51:18.725: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:19.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:51:19.732: INFO: rc: 1 Aug 18 11:51:19.732: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:20.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:51:20.890: INFO: rc: 1 Aug 18 11:51:20.891: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:21.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:51:21.709: INFO: rc: 1 Aug 18 11:51:21.710: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:22.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:51:22.727: INFO: rc: 1 Aug 18 11:51:22.727: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:23.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:51:23.731: INFO: rc: 1 Aug 18 11:51:23.731: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:24.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:51:24.740: INFO: rc: 1 Aug 18 11:51:24.740: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:25.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:51:25.719: INFO: rc: 1 Aug 18 11:51:25.719: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:26.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:51:26.717: INFO: rc: 1 Aug 18 11:51:26.717: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:27.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:51:27.715: INFO: rc: 1 Aug 18 11:51:27.715: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:28.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:51:28.720: INFO: rc: 1 Aug 18 11:51:28.720: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:29.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:51:29.757: INFO: rc: 1 Aug 18 11:51:29.757: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:30.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:51:30.716: INFO: rc: 1 Aug 18 11:51:30.716: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:31.460: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:51:31.719: INFO: rc: 1 Aug 18 11:51:31.719: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:32.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:51:32.731: INFO: rc: 1 Aug 18 11:51:32.732: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:33.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:51:33.724: INFO: rc: 1 Aug 18 11:51:33.724: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:34.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:51:34.716: INFO: rc: 1 Aug 18 11:51:34.716: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:35.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:51:35.734: INFO: rc: 1 Aug 18 11:51:35.735: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:36.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:51:36.728: INFO: rc: 1 Aug 18 11:51:36.728: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:37.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:51:37.732: INFO: rc: 1 Aug 18 11:51:37.732: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:38.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:51:38.782: INFO: rc: 1 Aug 18 11:51:38.782: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:39.457: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:51:39.797: INFO: rc: 1 Aug 18 11:51:39.797: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:40.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:51:40.749: INFO: rc: 1 Aug 18 11:51:40.749: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:41.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:51:41.732: INFO: rc: 1 Aug 18 11:51:41.732: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:42.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:51:42.727: INFO: rc: 1 Aug 18 11:51:42.727: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:43.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:51:43.900: INFO: rc: 1 Aug 18 11:51:43.900: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:44.457: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:51:44.837: INFO: rc: 1 Aug 18 11:51:44.837: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:45.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:51:45.721: INFO: rc: 1 Aug 18 11:51:45.722: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:46.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:51:46.824: INFO: rc: 1 Aug 18 11:51:46.824: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:47.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:51:47.722: INFO: rc: 1 Aug 18 11:51:47.722: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:48.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:51:48.726: INFO: rc: 1 Aug 18 11:51:48.726: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:49.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:51:49.705: INFO: rc: 1 Aug 18 11:51:49.705: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:50.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:51:50.711: INFO: rc: 1 Aug 18 11:51:50.711: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:51.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:51:51.726: INFO: rc: 1 Aug 18 11:51:51.726: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:52.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:51:52.729: INFO: rc: 1 Aug 18 11:51:52.729: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:53.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:51:53.857: INFO: rc: 1 Aug 18 11:51:53.857: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:54.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:51:54.701: INFO: rc: 1 Aug 18 11:51:54.701: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:55.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:51:55.715: INFO: rc: 1 Aug 18 11:51:55.715: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:56.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:51:56.711: INFO: rc: 1 Aug 18 11:51:56.711: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:57.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:51:57.732: INFO: rc: 1 Aug 18 11:51:57.732: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:58.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:51:58.711: INFO: rc: 1 Aug 18 11:51:58.711: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:51:59.459: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:51:59.777: INFO: rc: 1 Aug 18 11:51:59.778: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:52:00.459: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:52:00.696: INFO: rc: 1 Aug 18 11:52:00.696: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:52:01.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:52:01.742: INFO: rc: 1 Aug 18 11:52:01.743: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:52:02.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:52:02.737: INFO: rc: 1 Aug 18 11:52:02.737: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:52:03.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:52:03.720: INFO: rc: 1 Aug 18 11:52:03.720: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:52:04.459: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:52:04.717: INFO: rc: 1 Aug 18 11:52:04.717: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:52:05.459: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:52:05.706: INFO: rc: 1 Aug 18 11:52:05.706: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:52:06.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:52:06.729: INFO: rc: 1 Aug 18 11:52:06.729: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:52:07.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:52:07.708: INFO: rc: 1 Aug 18 11:52:07.708: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:52:08.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:52:08.730: INFO: rc: 1 Aug 18 11:52:08.730: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:52:09.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:52:09.743: INFO: rc: 1 Aug 18 11:52:09.743: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:52:10.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:52:10.716: INFO: rc: 1 Aug 18 11:52:10.716: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:52:11.458: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:52:11.710: INFO: rc: 1 Aug 18 11:52:11.710: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:52:11.710: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814' Aug 18 11:52:11.960: INFO: rc: 1 Aug 18 11:52:11.960: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-141 exec execpod-affinityk47wl -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31814: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31814 nc: connect to 10.10.190.207 port 31814 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:52:11.961: FAIL: Unexpected error: <*errors.errorString | 0xc00248a550>: { s: "service is not reachable within 2m0s timeout on endpoint 10.10.190.207:31814 over TCP protocol", } service is not reachable within 2m0s timeout on endpoint 10.10.190.207:31814 over TCP protocol occurred Full Stack Trace k8s.io/kubernetes/test/e2e/network.execAffinityTestForNonLBServiceWithOptionalTransition(0xc0001bcf20, 0x5410260, 0xc0045a54a0, 0xc007f4db00, 0x0) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:3511 +0x62e k8s.io/kubernetes/test/e2e/network.execAffinityTestForNonLBService(...) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:3470 k8s.io/kubernetes/test/e2e/network.glob..func24.28() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:2508 +0xa5 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc0027eb380) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc0027eb380) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc0027eb380, 0x4deb2c0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 Aug 18 11:52:11.962: INFO: Cleaning up the exec pod STEP: deleting ReplicationController affinity-nodeport in namespace services-141, will wait for the garbage collector to delete the pods Aug 18 11:52:12.039: INFO: Deleting ReplicationController affinity-nodeport took: 6.223773ms Aug 18 11:52:12.139: INFO: Terminating ReplicationController affinity-nodeport pods took: 100.495896ms [AfterEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "services-141". STEP: Found 31 events. Aug 18 11:52:21.258: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for affinity-nodeport-cc62g: { } Scheduled: Successfully assigned services-141/affinity-nodeport-cc62g to node2 Aug 18 11:52:21.258: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for affinity-nodeport-f9b5h: { } Scheduled: Successfully assigned services-141/affinity-nodeport-f9b5h to node1 Aug 18 11:52:21.258: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for affinity-nodeport-qvd62: { } Scheduled: Successfully assigned services-141/affinity-nodeport-qvd62 to node2 Aug 18 11:52:21.259: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for execpod-affinityk47wl: { } Scheduled: Successfully assigned services-141/execpod-affinityk47wl to node2 Aug 18 11:52:21.259: INFO: At 2021-08-18 11:49:59 +0000 UTC - event for affinity-nodeport: {replication-controller } SuccessfulCreate: Created pod: affinity-nodeport-f9b5h Aug 18 11:52:21.259: INFO: At 2021-08-18 11:49:59 +0000 UTC - event for affinity-nodeport: {replication-controller } SuccessfulCreate: Created pod: affinity-nodeport-cc62g Aug 18 11:52:21.259: INFO: At 2021-08-18 11:49:59 +0000 UTC - event for affinity-nodeport: {replication-controller } SuccessfulCreate: Created pod: affinity-nodeport-qvd62 Aug 18 11:52:21.259: INFO: At 2021-08-18 11:50:01 +0000 UTC - event for affinity-nodeport-cc62g: {multus } AddedInterface: Add eth0 [10.244.3.85/24] Aug 18 11:52:21.259: INFO: At 2021-08-18 11:50:01 +0000 UTC - event for affinity-nodeport-cc62g: {kubelet node2} Pulling: Pulling image "k8s.gcr.io/e2e-test-images/agnhost:2.20" Aug 18 11:52:21.259: INFO: At 2021-08-18 11:50:01 +0000 UTC - event for affinity-nodeport-cc62g: {kubelet node2} Pulled: Successfully pulled image "k8s.gcr.io/e2e-test-images/agnhost:2.20" in 551.667486ms Aug 18 11:52:21.259: INFO: At 2021-08-18 11:50:01 +0000 UTC - event for affinity-nodeport-cc62g: {kubelet node2} Created: Created container affinity-nodeport Aug 18 11:52:21.259: INFO: At 2021-08-18 11:50:01 +0000 UTC - event for affinity-nodeport-f9b5h: {multus } AddedInterface: Add eth0 [10.244.4.94/24] Aug 18 11:52:21.259: INFO: At 2021-08-18 11:50:01 +0000 UTC - event for affinity-nodeport-f9b5h: {kubelet node1} Started: Started container affinity-nodeport Aug 18 11:52:21.259: INFO: At 2021-08-18 11:50:01 +0000 UTC - event for affinity-nodeport-f9b5h: {kubelet node1} Created: Created container affinity-nodeport Aug 18 11:52:21.259: INFO: At 2021-08-18 11:50:01 +0000 UTC - event for affinity-nodeport-f9b5h: {kubelet node1} Pulled: Successfully pulled image "k8s.gcr.io/e2e-test-images/agnhost:2.20" in 476.215469ms Aug 18 11:52:21.259: INFO: At 2021-08-18 11:50:01 +0000 UTC - event for affinity-nodeport-f9b5h: {kubelet node1} Pulling: Pulling image "k8s.gcr.io/e2e-test-images/agnhost:2.20" Aug 18 11:52:21.259: INFO: At 2021-08-18 11:50:01 +0000 UTC - event for affinity-nodeport-qvd62: {kubelet node2} Pulling: Pulling image "k8s.gcr.io/e2e-test-images/agnhost:2.20" Aug 18 11:52:21.259: INFO: At 2021-08-18 11:50:01 +0000 UTC - event for affinity-nodeport-qvd62: {multus } AddedInterface: Add eth0 [10.244.3.86/24] Aug 18 11:52:21.259: INFO: At 2021-08-18 11:50:02 +0000 UTC - event for affinity-nodeport-cc62g: {kubelet node2} Started: Started container affinity-nodeport Aug 18 11:52:21.259: INFO: At 2021-08-18 11:50:02 +0000 UTC - event for affinity-nodeport-qvd62: {kubelet node2} Pulled: Successfully pulled image "k8s.gcr.io/e2e-test-images/agnhost:2.20" in 500.76695ms Aug 18 11:52:21.259: INFO: At 2021-08-18 11:50:02 +0000 UTC - event for affinity-nodeport-qvd62: {kubelet node2} Started: Started container affinity-nodeport Aug 18 11:52:21.259: INFO: At 2021-08-18 11:50:02 +0000 UTC - event for affinity-nodeport-qvd62: {kubelet node2} Created: Created container affinity-nodeport Aug 18 11:52:21.259: INFO: At 2021-08-18 11:50:07 +0000 UTC - event for execpod-affinityk47wl: {kubelet node2} Created: Created container agnhost-container Aug 18 11:52:21.259: INFO: At 2021-08-18 11:50:07 +0000 UTC - event for execpod-affinityk47wl: {kubelet node2} Started: Started container agnhost-container Aug 18 11:52:21.259: INFO: At 2021-08-18 11:50:07 +0000 UTC - event for execpod-affinityk47wl: {multus } AddedInterface: Add eth0 [10.244.3.87/24] Aug 18 11:52:21.259: INFO: At 2021-08-18 11:50:07 +0000 UTC - event for execpod-affinityk47wl: {kubelet node2} Pulling: Pulling image "k8s.gcr.io/e2e-test-images/agnhost:2.20" Aug 18 11:52:21.259: INFO: At 2021-08-18 11:50:07 +0000 UTC - event for execpod-affinityk47wl: {kubelet node2} Pulled: Successfully pulled image "k8s.gcr.io/e2e-test-images/agnhost:2.20" in 473.818568ms Aug 18 11:52:21.259: INFO: At 2021-08-18 11:52:11 +0000 UTC - event for execpod-affinityk47wl: {kubelet node2} Killing: Stopping container agnhost-container Aug 18 11:52:21.259: INFO: At 2021-08-18 11:52:12 +0000 UTC - event for affinity-nodeport-cc62g: {kubelet node2} Killing: Stopping container affinity-nodeport Aug 18 11:52:21.259: INFO: At 2021-08-18 11:52:12 +0000 UTC - event for affinity-nodeport-f9b5h: {kubelet node1} Killing: Stopping container affinity-nodeport Aug 18 11:52:21.259: INFO: At 2021-08-18 11:52:12 +0000 UTC - event for affinity-nodeport-qvd62: {kubelet node2} Killing: Stopping container affinity-nodeport Aug 18 11:52:21.261: INFO: POD NODE PHASE GRACE CONDITIONS Aug 18 11:52:21.261: INFO: Aug 18 11:52:21.266: INFO: Logging node info for node master1 Aug 18 11:52:21.268: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 ebb211fa-503f-4cfe-b1ed-c95d27a70e6e 73310 0 2021-08-18 08:20:52 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"3a:82:be:72:b5:15"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:20:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:20:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:25:59 +0000 UTC,LastTransitionTime:2021-08-18 08:25:59 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:52:18 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:52:18 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:52:18 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:52:18 +0000 UTC,LastTransitionTime:2021-08-18 08:25:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:58c3e57359b641ad92fa1959f2fecf5d,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:012cd796-2076-45d6-8b14-d3e0451b1e64,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[@ :],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:52:21.268: INFO: Logging kubelet events for node master1 Aug 18 11:52:21.270: INFO: Logging pods the kubelet thinks is on node master1 Aug 18 11:52:21.279: INFO: kube-controller-manager-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:21.279: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:52:21.279: INFO: kube-multus-ds-amd64-kbcp6 started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:21.279: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:52:21.279: INFO: docker-registry-docker-registry-56cbc7bc58-49kl2 started at 2021-08-18 08:26:23 +0000 UTC (0+2 container statuses recorded) Aug 18 11:52:21.279: INFO: Container docker-registry ready: true, restart count 0 Aug 18 11:52:21.279: INFO: Container nginx ready: true, restart count 0 Aug 18 11:52:21.279: INFO: node-exporter-5hwz9 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:52:21.279: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:52:21.279: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:52:21.279: INFO: kube-apiserver-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:21.279: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:52:21.279: INFO: kube-proxy-vqk4v started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:21.279: INFO: Container kube-proxy ready: true, restart count 1 Aug 18 11:52:21.279: INFO: kube-flannel-q64cq started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:52:21.279: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:52:21.279: INFO: Container kube-flannel ready: true, restart count 3 Aug 18 11:52:21.279: INFO: coredns-7677f9bb54-kn2qg started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:21.279: INFO: Container coredns ready: true, restart count 2 Aug 18 11:52:21.279: INFO: kube-scheduler-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:21.279: INFO: Container kube-scheduler ready: true, restart count 0 W0818 11:52:21.292475 38 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:52:21.317: INFO: Latency metrics for node master1 Aug 18 11:52:21.317: INFO: Logging node info for node master2 Aug 18 11:52:21.321: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 78946293-3abe-4442-84d4-8ed6b1d15ce0 73284 0 2021-08-18 08:21:31 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"7e:f5:c2:cc:3a:b4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:21:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:21:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-08-18 08:29:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:52:16 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:52:16 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:52:16 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:52:16 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0c44122c7a7248c18d8571e1cc667258,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:0cd329f2-48e0-4c8f-b8b9-fa3ae0ed8406,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:52:21.321: INFO: Logging kubelet events for node master2 Aug 18 11:52:21.324: INFO: Logging pods the kubelet thinks is on node master2 Aug 18 11:52:21.333: INFO: kube-controller-manager-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:21.333: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:52:21.333: INFO: kube-proxy-kh2l9 started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:21.333: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:52:21.333: INFO: kube-flannel-pp56h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:52:21.333: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:52:21.333: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:52:21.333: INFO: dns-autoscaler-5b7b5c9b6f-hh47r started at 2021-08-18 08:23:57 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:21.333: INFO: Container autoscaler ready: true, restart count 2 Aug 18 11:52:21.333: INFO: node-feature-discovery-controller-5bf5c49849-mq57c started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:21.333: INFO: Container nfd-controller ready: true, restart count 0 Aug 18 11:52:21.333: INFO: node-exporter-48nfx started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:52:21.333: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:52:21.333: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:52:21.333: INFO: kube-apiserver-master2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:21.333: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:52:21.333: INFO: kube-scheduler-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:21.333: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:52:21.333: INFO: kube-multus-ds-amd64-mld8g started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:21.333: INFO: Container kube-multus ready: true, restart count 1 W0818 11:52:21.344716 38 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:52:21.369: INFO: Latency metrics for node master2 Aug 18 11:52:21.369: INFO: Logging node info for node master3 Aug 18 11:52:21.371: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 44feac2b-9447-4be2-9fcd-62f836d67c72 73218 0 2021-08-18 08:21:41 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"86:e4:31:99:58:40"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {kubelet Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:52:12 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:52:12 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:52:12 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:52:12 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1fae19ae59884c44899bcd08aa243244,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:5db926c5-6530-4635-a0d5-806974a3b732,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:52:21.371: INFO: Logging kubelet events for node master3 Aug 18 11:52:21.373: INFO: Logging pods the kubelet thinks is on node master3 Aug 18 11:52:21.381: INFO: kube-apiserver-master3 started at 2021-08-18 08:29:12 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:21.381: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:52:21.381: INFO: kube-proxy-sd5lc started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:21.381: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:52:21.381: INFO: kube-flannel-x6tlr started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:52:21.381: INFO: Init container install-cni ready: true, restart count 1 Aug 18 11:52:21.381: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:52:21.381: INFO: kube-multus-ds-amd64-bkw6c started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:21.381: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:52:21.381: INFO: coredns-7677f9bb54-5hxfh started at 2021-08-18 08:23:54 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:21.381: INFO: Container coredns ready: true, restart count 1 Aug 18 11:52:21.381: INFO: node-exporter-vq7d8 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:52:21.381: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:52:21.381: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:52:21.381: INFO: kube-controller-manager-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:21.381: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:52:21.381: INFO: kube-scheduler-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:21.381: INFO: Container kube-scheduler ready: true, restart count 2 W0818 11:52:21.395112 38 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:52:21.418: INFO: Latency metrics for node master3 Aug 18 11:52:21.418: INFO: Logging node info for node node1 Aug 18 11:52:21.421: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 84defabd-6ebf-43ec-a629-44c6713da9c9 73236 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"9a:87:55:36:7b:df"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:13 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:35 +0000 UTC,LastTransitionTime:2021-08-18 08:26:35 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:52:15 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:52:15 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:52:15 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:52:15 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:69946ff2b7bc462fa25eb7adb4703c23,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:736dc52f-f5e3-494e-86ca-01eedbea015c,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:a7cea43d9d2f67c38fbf0407786edbe660ee9072945f7bb272b55fd255e8eaca opnfv/barometer-collectd:stable],SizeBytes:1075746799,},ContainerImage{Names:[@ :],SizeBytes:1003788820,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[aquasec/kube-hunter@sha256:2be6820bc1d7e0f57193a9a27d5a3e16b2fd93c53747b03ce8ca48c6fc323781 aquasec/kube-hunter:0.3.1],SizeBytes:347611549,},ContainerImage{Names:[golang@sha256:db2475a1dbb2149508e5db31d7d77a75e6600d54be645f37681f03f2762169ba golang:alpine3.12],SizeBytes:301186719,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:de25c7fc6c4f3a27c7f0c2dff454e4671823a34d88abd533f210848d527e0fbb alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:52:21.422: INFO: Logging kubelet events for node node1 Aug 18 11:52:21.424: INFO: Logging pods the kubelet thinks is on node node1 Aug 18 11:52:21.437: INFO: node-feature-discovery-worker-pflgw started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:21.437: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:52:21.437: INFO: node-exporter-kcwvn started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:52:21.437: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:52:21.437: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:52:21.437: INFO: pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a started at 2021-08-18 11:52:01 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:21.437: INFO: Container env-test ready: false, restart count 0 Aug 18 11:52:21.437: INFO: ss-0 started at 2021-08-18 11:47:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:21.437: INFO: Container webserver ready: false, restart count 0 Aug 18 11:52:21.437: INFO: kube-multus-ds-amd64-rrvmb started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:21.437: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:52:21.437: INFO: kubernetes-metrics-scraper-678c97765c-9nsv5 started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:21.437: INFO: Container kubernetes-metrics-scraper ready: true, restart count 2 Aug 18 11:52:21.437: INFO: cmk-init-discover-node1-bxznx started at 2021-08-18 08:32:10 +0000 UTC (0+3 container statuses recorded) Aug 18 11:52:21.437: INFO: Container discover ready: false, restart count 0 Aug 18 11:52:21.437: INFO: Container init ready: false, restart count 0 Aug 18 11:52:21.437: INFO: Container install ready: false, restart count 0 Aug 18 11:52:21.437: INFO: cmk-d8r27 started at 2021-08-18 08:32:52 +0000 UTC (0+2 container statuses recorded) Aug 18 11:52:21.437: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:52:21.437: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:52:21.437: INFO: collectd-xdprr started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:52:21.437: INFO: Container collectd ready: true, restart count 0 Aug 18 11:52:21.437: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:52:21.437: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:52:21.437: INFO: kube-proxy-p6jvp started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:21.437: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:52:21.437: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-vsxvg started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:21.437: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:52:21.437: INFO: var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209 started at 2021-08-18 11:47:57 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:21.437: INFO: Container dapi-container ready: false, restart count 0 Aug 18 11:52:21.437: INFO: nginx-proxy-node1 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:21.437: INFO: Container nginx-proxy ready: true, restart count 2 Aug 18 11:52:21.437: INFO: prometheus-k8s-0 started at 2021-08-18 08:34:03 +0000 UTC (0+5 container statuses recorded) Aug 18 11:52:21.437: INFO: Container custom-metrics-apiserver ready: true, restart count 0 Aug 18 11:52:21.437: INFO: Container grafana ready: true, restart count 0 Aug 18 11:52:21.437: INFO: Container prometheus ready: true, restart count 1 Aug 18 11:52:21.437: INFO: Container prometheus-config-reloader ready: true, restart count 0 Aug 18 11:52:21.437: INFO: Container rules-configmap-reloader ready: true, restart count 0 Aug 18 11:52:21.437: INFO: kube-flannel-q78nd started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:52:21.437: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:52:21.437: INFO: Container kube-flannel ready: true, restart count 1 W0818 11:52:21.449969 38 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:52:21.479: INFO: Latency metrics for node node1 Aug 18 11:52:21.479: INFO: Logging node info for node node2 Aug 18 11:52:21.482: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 1d01177e-3dbb-48a1-a0bc-d18af27ab7f8 73320 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:d1:47:f8:1d:22"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:36 +0000 UTC,LastTransitionTime:2021-08-18 08:26:36 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:52:19 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:52:19 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:52:19 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:52:19 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:dc1f286135c145349b8a016880b65a2f,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:037e7e2d-94e9-42f4-a719-896e5005ac70,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:52:21.482: INFO: Logging kubelet events for node node2 Aug 18 11:52:21.485: INFO: Logging pods the kubelet thinks is on node node2 Aug 18 11:52:21.498: INFO: kubernetes-dashboard-86c6f9df5b-qrtdk started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:21.498: INFO: Container kubernetes-dashboard ready: true, restart count 2 Aug 18 11:52:21.498: INFO: cmk-748rz started at 2021-08-18 08:32:53 +0000 UTC (0+2 container statuses recorded) Aug 18 11:52:21.498: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:52:21.498: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:52:21.498: INFO: kube-proxy-qkj9c started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:21.498: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:52:21.498: INFO: node-feature-discovery-worker-hzpf5 started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:21.498: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:52:21.498: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-c82pt started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:21.498: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:52:21.498: INFO: prometheus-operator-5bb8cb9d8f-k97ws started at 2021-08-18 08:33:38 +0000 UTC (0+2 container statuses recorded) Aug 18 11:52:21.498: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:52:21.498: INFO: Container prometheus-operator ready: true, restart count 0 Aug 18 11:52:21.498: INFO: sample-webhook-deployment-cbccbf6bb-8hmmw started at 2021-08-18 11:52:20 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:21.498: INFO: Container sample-webhook ready: false, restart count 0 Aug 18 11:52:21.498: INFO: kube-multus-ds-amd64-rvzsg started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:21.498: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:52:21.498: INFO: collectd-67ntq started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:52:21.498: INFO: Container collectd ready: true, restart count 0 Aug 18 11:52:21.498: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:52:21.498: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:52:21.498: INFO: ss-0 started at 2021-08-18 11:46:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:21.498: INFO: Container webserver ready: false, restart count 0 Aug 18 11:52:21.498: INFO: termination-message-container84499a62-bd35-4cdc-809d-811cd552608a started at 2021-08-18 11:51:42 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:21.498: INFO: Container termination-message-container ready: false, restart count 0 Aug 18 11:52:21.498: INFO: bin-falsea5f6898f-c6c3-4680-9cbd-f4985908f73e started at 2021-08-18 11:49:10 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:21.498: INFO: Container bin-falsea5f6898f-c6c3-4680-9cbd-f4985908f73e ready: false, restart count 0 Aug 18 11:52:21.498: INFO: cmk-webhook-6c9d5f8578-7cxjr started at 2021-08-18 08:32:53 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:21.498: INFO: Container cmk-webhook ready: true, restart count 0 Aug 18 11:52:21.498: INFO: terminate-cmd-rpad23b99c9-2d62-4758-a55c-1712aba45053 started at 2021-08-18 11:50:30 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:21.498: INFO: Container terminate-cmd-rpa ready: false, restart count 0 Aug 18 11:52:21.498: INFO: kube-flannel-h7t5h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:52:21.498: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:52:21.498: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:52:21.498: INFO: node-exporter-lrrf2 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:52:21.498: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:52:21.498: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:52:21.498: INFO: nginx-proxy-node2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:52:21.498: INFO: Container nginx-proxy ready: true, restart count 1 Aug 18 11:52:21.498: INFO: cmk-init-discover-node2-6b2kz started at 2021-08-18 08:32:30 +0000 UTC (0+3 container statuses recorded) Aug 18 11:52:21.498: INFO: Container discover ready: false, restart count 0 Aug 18 11:52:21.498: INFO: Container init ready: false, restart count 0 Aug 18 11:52:21.498: INFO: Container install ready: false, restart count 0 Aug 18 11:52:21.498: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-7rn45 started at 2021-08-18 08:36:42 +0000 UTC (0+2 container statuses recorded) Aug 18 11:52:21.498: INFO: Container tas-controller ready: true, restart count 0 Aug 18 11:52:21.498: INFO: Container tas-extender ready: true, restart count 0 W0818 11:52:21.511886 38 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:52:21.705: INFO: Latency metrics for node node2 Aug 18 11:52:21.705: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "services-141" for this suite. [AfterEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:786 • Failure [142.159 seconds] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/framework.go:23 should have session affinity work for NodePort service [LinuxOnly] [Conformance] [It] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:52:11.961: Unexpected error: <*errors.errorString | 0xc00248a550>: { s: "service is not reachable within 2m0s timeout on endpoint 10.10.190.207:31814 over TCP protocol", } service is not reachable within 2m0s timeout on endpoint 10.10.190.207:31814 over TCP protocol occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:3511 ------------------------------ {"msg":"FAILED [sig-network] Services should have session affinity work for NodePort service [LinuxOnly] [Conformance]","total":-1,"completed":29,"skipped":702,"failed":3,"failures":["[k8s.io] Pods should be submitted and removed [NodeConformance] [Conformance]","[sig-apps] Job should run a job to completion when tasks sometimes fail and are locally restarted [Conformance]","[sig-network] Services should have session affinity work for NodePort service [LinuxOnly] [Conformance]"]} SSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-storage] Projected downwardAPI /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:52:21.765: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename projected STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-storage] Projected downwardAPI /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/projected_downwardapi.go:42 [It] should set mode on item file [LinuxOnly] [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating a pod to test downward API volume plugin Aug 18 11:52:21.805: INFO: Waiting up to 5m0s for pod "downwardapi-volume-422be754-a016-4b6b-ad9e-e9efed00b6a8" in namespace "projected-1017" to be "Succeeded or Failed" Aug 18 11:52:21.810: INFO: Pod "downwardapi-volume-422be754-a016-4b6b-ad9e-e9efed00b6a8": Phase="Pending", Reason="", readiness=false. Elapsed: 5.329563ms Aug 18 11:52:23.814: INFO: Pod "downwardapi-volume-422be754-a016-4b6b-ad9e-e9efed00b6a8": Phase="Pending", Reason="", readiness=false. Elapsed: 2.009057885s Aug 18 11:52:25.818: INFO: Pod "downwardapi-volume-422be754-a016-4b6b-ad9e-e9efed00b6a8": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.012817173s STEP: Saw pod success Aug 18 11:52:25.818: INFO: Pod "downwardapi-volume-422be754-a016-4b6b-ad9e-e9efed00b6a8" satisfied condition "Succeeded or Failed" Aug 18 11:52:25.820: INFO: Trying to get logs from node node1 pod downwardapi-volume-422be754-a016-4b6b-ad9e-e9efed00b6a8 container client-container: STEP: delete the pod Aug 18 11:52:25.832: INFO: Waiting for pod downwardapi-volume-422be754-a016-4b6b-ad9e-e9efed00b6a8 to disappear Aug 18 11:52:25.834: INFO: Pod downwardapi-volume-422be754-a016-4b6b-ad9e-e9efed00b6a8 no longer exists [AfterEach] [sig-storage] Projected downwardAPI /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:52:25.834: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "projected-1017" for this suite. • ------------------------------ {"msg":"PASSED [sig-storage] Projected downwardAPI should set mode on item file [LinuxOnly] [NodeConformance] [Conformance]","total":-1,"completed":30,"skipped":719,"failed":3,"failures":["[k8s.io] Pods should be submitted and removed [NodeConformance] [Conformance]","[sig-apps] Job should run a job to completion when tasks sometimes fail and are locally restarted [Conformance]","[sig-network] Services should have session affinity work for NodePort service [LinuxOnly] [Conformance]"]} SSSSSSSSSS ------------------------------ [BeforeEach] [sig-api-machinery] ResourceQuota /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:52:17.822: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename resourcequota STEP: Waiting for a default service account to be provisioned in namespace [It] should create a ResourceQuota and capture the life of a replica set. [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Counting existing ResourceQuota STEP: Creating a ResourceQuota STEP: Ensuring resource quota status is calculated STEP: Creating a ReplicaSet STEP: Ensuring resource quota status captures replicaset creation STEP: Deleting a ReplicaSet STEP: Ensuring resource quota status released usage [AfterEach] [sig-api-machinery] ResourceQuota /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:52:28.870: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "resourcequota-9118" for this suite. • [SLOW TEST:11.058 seconds] [sig-api-machinery] ResourceQuota /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23 should create a ResourceQuota and capture the life of a replica set. [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-api-machinery] ResourceQuota should create a ResourceQuota and capture the life of a replica set. [Conformance]","total":-1,"completed":35,"skipped":865,"failed":5,"failures":["[sig-network] Services should be able to create a functioning NodePort service [Conformance]","[k8s.io] Pods should support retrieving logs from the container over websockets [NodeConformance] [Conformance]","[k8s.io] InitContainer [NodeConformance] should not start app containers if init containers fail on a RestartAlways pod [Conformance]","[k8s.io] Container Runtime blackbox test on terminated container should report termination message [LinuxOnly] if TerminationMessagePath is set as non-root user and at a non-default path [NodeConformance] [Conformance]","[sig-network] Services should have session affinity timeout work for NodePort service [LinuxOnly] [Conformance]"]} SSSSSSSS ------------------------------ [BeforeEach] [sig-storage] Projected downwardAPI /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:52:25.864: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename projected STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-storage] Projected downwardAPI /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/projected_downwardapi.go:42 [It] should provide node allocatable (memory) as default memory limit if the limit is not set [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating a pod to test downward API volume plugin Aug 18 11:52:25.894: INFO: Waiting up to 5m0s for pod "downwardapi-volume-c42d2f33-8764-4334-b553-74997221deaa" in namespace "projected-2056" to be "Succeeded or Failed" Aug 18 11:52:25.896: INFO: Pod "downwardapi-volume-c42d2f33-8764-4334-b553-74997221deaa": Phase="Pending", Reason="", readiness=false. Elapsed: 2.079379ms Aug 18 11:52:27.900: INFO: Pod "downwardapi-volume-c42d2f33-8764-4334-b553-74997221deaa": Phase="Pending", Reason="", readiness=false. Elapsed: 2.005902365s Aug 18 11:52:29.904: INFO: Pod "downwardapi-volume-c42d2f33-8764-4334-b553-74997221deaa": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.009980022s STEP: Saw pod success Aug 18 11:52:29.904: INFO: Pod "downwardapi-volume-c42d2f33-8764-4334-b553-74997221deaa" satisfied condition "Succeeded or Failed" Aug 18 11:52:29.906: INFO: Trying to get logs from node node1 pod downwardapi-volume-c42d2f33-8764-4334-b553-74997221deaa container client-container: STEP: delete the pod Aug 18 11:52:30.100: INFO: Waiting for pod downwardapi-volume-c42d2f33-8764-4334-b553-74997221deaa to disappear Aug 18 11:52:30.102: INFO: Pod downwardapi-volume-c42d2f33-8764-4334-b553-74997221deaa no longer exists [AfterEach] [sig-storage] Projected downwardAPI /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:52:30.102: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "projected-2056" for this suite. • ------------------------------ {"msg":"PASSED [sig-storage] Projected downwardAPI should provide node allocatable (memory) as default memory limit if the limit is not set [NodeConformance] [Conformance]","total":-1,"completed":31,"skipped":729,"failed":3,"failures":["[k8s.io] Pods should be submitted and removed [NodeConformance] [Conformance]","[sig-apps] Job should run a job to completion when tasks sometimes fail and are locally restarted [Conformance]","[sig-network] Services should have session affinity work for NodePort service [LinuxOnly] [Conformance]"]} SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:52:20.400: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename webhook STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:87 STEP: Setting up server cert STEP: Create role binding to let webhook read extension-apiserver-authentication STEP: Deploying the webhook pod STEP: Wait for the deployment to be ready Aug 18 11:52:20.842: INFO: deployment "sample-webhook-deployment" doesn't have the required revision set Aug 18 11:52:22.851: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764884340, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764884340, loc:(*time.Location)(0x77169a0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764884340, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764884340, loc:(*time.Location)(0x77169a0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-cbccbf6bb\" is progressing."}}, CollisionCount:(*int32)(nil)} STEP: Deploying the webhook service STEP: Verifying the service has paired with the endpoint Aug 18 11:52:25.860: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1 [It] should mutate custom resource [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:52:25.862: INFO: >>> kubeConfig: /root/.kube/config STEP: Registering the mutating webhook for custom resource e2e-test-webhook-1885-crds.webhook.example.com via the AdmissionRegistration API STEP: Creating a custom resource that should be mutated by the webhook [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:52:31.431: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "webhook-4806" for this suite. STEP: Destroying namespace "webhook-4806-markers" for this suite. [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:102 • [SLOW TEST:11.069 seconds] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23 should mutate custom resource [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should mutate custom resource [Conformance]","total":-1,"completed":10,"skipped":224,"failed":3,"failures":["[k8s.io] Variable Expansion should allow substituting values in a volume subpath [sig-storage] [Conformance]","[sig-apps] StatefulSet [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] should perform canary updates and phased rolling updates of template modifications [Conformance]","[sig-api-machinery] Secrets should be consumable from pods in env vars [NodeConformance] [Conformance]"]} SSS ------------------------------ [BeforeEach] [sig-storage] EmptyDir volumes /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:52:30.247: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename emptydir STEP: Waiting for a default service account to be provisioned in namespace [It] should support (non-root,0666,default) [LinuxOnly] [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating a pod to test emptydir 0666 on node default medium Aug 18 11:52:30.280: INFO: Waiting up to 5m0s for pod "pod-1770b39b-3d9c-48b7-9fb7-603d1b036297" in namespace "emptydir-3085" to be "Succeeded or Failed" Aug 18 11:52:30.282: INFO: Pod "pod-1770b39b-3d9c-48b7-9fb7-603d1b036297": Phase="Pending", Reason="", readiness=false. Elapsed: 1.814092ms Aug 18 11:52:32.285: INFO: Pod "pod-1770b39b-3d9c-48b7-9fb7-603d1b036297": Phase="Pending", Reason="", readiness=false. Elapsed: 2.00493313s Aug 18 11:52:34.288: INFO: Pod "pod-1770b39b-3d9c-48b7-9fb7-603d1b036297": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.007734732s STEP: Saw pod success Aug 18 11:52:34.288: INFO: Pod "pod-1770b39b-3d9c-48b7-9fb7-603d1b036297" satisfied condition "Succeeded or Failed" Aug 18 11:52:34.291: INFO: Trying to get logs from node node1 pod pod-1770b39b-3d9c-48b7-9fb7-603d1b036297 container test-container: STEP: delete the pod Aug 18 11:52:34.303: INFO: Waiting for pod pod-1770b39b-3d9c-48b7-9fb7-603d1b036297 to disappear Aug 18 11:52:34.304: INFO: Pod pod-1770b39b-3d9c-48b7-9fb7-603d1b036297 no longer exists [AfterEach] [sig-storage] EmptyDir volumes /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:52:34.305: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "emptydir-3085" for this suite. • ------------------------------ {"msg":"PASSED [sig-storage] EmptyDir volumes should support (non-root,0666,default) [LinuxOnly] [NodeConformance] [Conformance]","total":-1,"completed":32,"skipped":811,"failed":3,"failures":["[k8s.io] Pods should be submitted and removed [NodeConformance] [Conformance]","[sig-apps] Job should run a job to completion when tasks sometimes fail and are locally restarted [Conformance]","[sig-network] Services should have session affinity work for NodePort service [LinuxOnly] [Conformance]"]} SSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-storage] Projected secret /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:52:31.477: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename projected STEP: Waiting for a default service account to be provisioned in namespace [It] should be consumable from pods in volume [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating projection with secret that has name projected-secret-test-5846eb02-9a6a-4d79-8d8f-ffd28d468969 STEP: Creating a pod to test consume secrets Aug 18 11:52:31.516: INFO: Waiting up to 5m0s for pod "pod-projected-secrets-52f029b7-8433-431a-82f8-d6e46b721704" in namespace "projected-8533" to be "Succeeded or Failed" Aug 18 11:52:31.518: INFO: Pod "pod-projected-secrets-52f029b7-8433-431a-82f8-d6e46b721704": Phase="Pending", Reason="", readiness=false. Elapsed: 2.098846ms Aug 18 11:52:33.522: INFO: Pod "pod-projected-secrets-52f029b7-8433-431a-82f8-d6e46b721704": Phase="Pending", Reason="", readiness=false. Elapsed: 2.005437514s Aug 18 11:52:35.526: INFO: Pod "pod-projected-secrets-52f029b7-8433-431a-82f8-d6e46b721704": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.009621754s STEP: Saw pod success Aug 18 11:52:35.526: INFO: Pod "pod-projected-secrets-52f029b7-8433-431a-82f8-d6e46b721704" satisfied condition "Succeeded or Failed" Aug 18 11:52:35.528: INFO: Trying to get logs from node node2 pod pod-projected-secrets-52f029b7-8433-431a-82f8-d6e46b721704 container projected-secret-volume-test: STEP: delete the pod Aug 18 11:52:35.541: INFO: Waiting for pod pod-projected-secrets-52f029b7-8433-431a-82f8-d6e46b721704 to disappear Aug 18 11:52:35.542: INFO: Pod pod-projected-secrets-52f029b7-8433-431a-82f8-d6e46b721704 no longer exists [AfterEach] [sig-storage] Projected secret /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:52:35.542: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "projected-8533" for this suite. • ------------------------------ {"msg":"PASSED [sig-storage] Projected secret should be consumable from pods in volume [NodeConformance] [Conformance]","total":-1,"completed":11,"skipped":227,"failed":3,"failures":["[k8s.io] Variable Expansion should allow substituting values in a volume subpath [sig-storage] [Conformance]","[sig-apps] StatefulSet [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] should perform canary updates and phased rolling updates of template modifications [Conformance]","[sig-api-machinery] Secrets should be consumable from pods in env vars [NodeConformance] [Conformance]"]} SSSSSSS ------------------------------ [BeforeEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:52:35.564: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename services STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:782 [It] should provide secure master service [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 [AfterEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:52:35.584: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "services-3932" for this suite. [AfterEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:786 • ------------------------------ {"msg":"PASSED [sig-network] Services should provide secure master service [Conformance]","total":-1,"completed":12,"skipped":234,"failed":3,"failures":["[k8s.io] Variable Expansion should allow substituting values in a volume subpath [sig-storage] [Conformance]","[sig-apps] StatefulSet [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] should perform canary updates and phased rolling updates of template modifications [Conformance]","[sig-api-machinery] Secrets should be consumable from pods in env vars [NodeConformance] [Conformance]"]} SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-network] IngressClass API /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:52:35.667: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename ingressclass STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-network] IngressClass API /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/ingressclass.go:148 [It] should support creating IngressClass API operations [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: getting /apis STEP: getting /apis/networking.k8s.io STEP: getting /apis/networking.k8s.iov1 STEP: creating STEP: getting STEP: listing STEP: watching Aug 18 11:52:35.702: INFO: starting watch STEP: patching STEP: updating Aug 18 11:52:35.709: INFO: waiting for watch events with expected annotations Aug 18 11:52:35.710: INFO: saw patched and updated annotations STEP: deleting STEP: deleting a collection [AfterEach] [sig-network] IngressClass API /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:52:35.730: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "ingressclass-6880" for this suite. • ------------------------------ {"msg":"PASSED [sig-network] IngressClass API should support creating IngressClass API operations [Conformance]","total":-1,"completed":13,"skipped":279,"failed":3,"failures":["[k8s.io] Variable Expansion should allow substituting values in a volume subpath [sig-storage] [Conformance]","[sig-apps] StatefulSet [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] should perform canary updates and phased rolling updates of template modifications [Conformance]","[sig-api-machinery] Secrets should be consumable from pods in env vars [NodeConformance] [Conformance]"]} SSSSS ------------------------------ [BeforeEach] [sig-storage] Downward API volume /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:52:34.359: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename downward-api STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-storage] Downward API volume /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/downwardapi_volume.go:42 [It] should set DefaultMode on files [LinuxOnly] [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating a pod to test downward API volume plugin Aug 18 11:52:34.399: INFO: Waiting up to 5m0s for pod "downwardapi-volume-c313a180-a51b-480d-8d22-0d4c316077fb" in namespace "downward-api-9094" to be "Succeeded or Failed" Aug 18 11:52:34.401: INFO: Pod "downwardapi-volume-c313a180-a51b-480d-8d22-0d4c316077fb": Phase="Pending", Reason="", readiness=false. Elapsed: 1.89645ms Aug 18 11:52:36.404: INFO: Pod "downwardapi-volume-c313a180-a51b-480d-8d22-0d4c316077fb": Phase="Pending", Reason="", readiness=false. Elapsed: 2.005069186s Aug 18 11:52:38.407: INFO: Pod "downwardapi-volume-c313a180-a51b-480d-8d22-0d4c316077fb": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.008620072s STEP: Saw pod success Aug 18 11:52:38.407: INFO: Pod "downwardapi-volume-c313a180-a51b-480d-8d22-0d4c316077fb" satisfied condition "Succeeded or Failed" Aug 18 11:52:38.410: INFO: Trying to get logs from node node2 pod downwardapi-volume-c313a180-a51b-480d-8d22-0d4c316077fb container client-container: STEP: delete the pod Aug 18 11:52:38.426: INFO: Waiting for pod downwardapi-volume-c313a180-a51b-480d-8d22-0d4c316077fb to disappear Aug 18 11:52:38.428: INFO: Pod downwardapi-volume-c313a180-a51b-480d-8d22-0d4c316077fb no longer exists [AfterEach] [sig-storage] Downward API volume /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:52:38.428: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "downward-api-9094" for this suite. • ------------------------------ {"msg":"PASSED [sig-storage] Downward API volume should set DefaultMode on files [LinuxOnly] [NodeConformance] [Conformance]","total":-1,"completed":33,"skipped":835,"failed":3,"failures":["[k8s.io] Pods should be submitted and removed [NodeConformance] [Conformance]","[sig-apps] Job should run a job to completion when tasks sometimes fail and are locally restarted [Conformance]","[sig-network] Services should have session affinity work for NodePort service [LinuxOnly] [Conformance]"]} SSSSSS ------------------------------ [BeforeEach] [sig-storage] Secrets /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:52:35.750: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename secrets STEP: Waiting for a default service account to be provisioned in namespace [It] should be consumable from pods in volume [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating secret with name secret-test-300ce1eb-6775-42d7-be6a-72d6009a0510 STEP: Creating a pod to test consume secrets Aug 18 11:52:35.788: INFO: Waiting up to 5m0s for pod "pod-secrets-e126d0db-b9fd-4af6-87ef-bc6c7dd81217" in namespace "secrets-9273" to be "Succeeded or Failed" Aug 18 11:52:35.790: INFO: Pod "pod-secrets-e126d0db-b9fd-4af6-87ef-bc6c7dd81217": Phase="Pending", Reason="", readiness=false. Elapsed: 2.212665ms Aug 18 11:52:37.793: INFO: Pod "pod-secrets-e126d0db-b9fd-4af6-87ef-bc6c7dd81217": Phase="Pending", Reason="", readiness=false. Elapsed: 2.005160353s Aug 18 11:52:39.796: INFO: Pod "pod-secrets-e126d0db-b9fd-4af6-87ef-bc6c7dd81217": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.007962794s STEP: Saw pod success Aug 18 11:52:39.796: INFO: Pod "pod-secrets-e126d0db-b9fd-4af6-87ef-bc6c7dd81217" satisfied condition "Succeeded or Failed" Aug 18 11:52:39.798: INFO: Trying to get logs from node node2 pod pod-secrets-e126d0db-b9fd-4af6-87ef-bc6c7dd81217 container secret-volume-test: STEP: delete the pod Aug 18 11:52:39.873: INFO: Waiting for pod pod-secrets-e126d0db-b9fd-4af6-87ef-bc6c7dd81217 to disappear Aug 18 11:52:39.875: INFO: Pod pod-secrets-e126d0db-b9fd-4af6-87ef-bc6c7dd81217 no longer exists [AfterEach] [sig-storage] Secrets /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:52:39.875: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "secrets-9273" for this suite. • ------------------------------ {"msg":"PASSED [sig-storage] Secrets should be consumable from pods in volume [NodeConformance] [Conformance]","total":-1,"completed":14,"skipped":284,"failed":3,"failures":["[k8s.io] Variable Expansion should allow substituting values in a volume subpath [sig-storage] [Conformance]","[sig-apps] StatefulSet [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] should perform canary updates and phased rolling updates of template modifications [Conformance]","[sig-api-machinery] Secrets should be consumable from pods in env vars [NodeConformance] [Conformance]"]} SSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-cli] Kubectl client /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:52:39.933: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename kubectl STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-cli] Kubectl client /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/kubectl.go:247 [It] should create and stop a working application [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: creating all guestbook components Aug 18 11:52:39.952: INFO: apiVersion: v1 kind: Service metadata: name: agnhost-replica labels: app: agnhost role: replica tier: backend spec: ports: - port: 6379 selector: app: agnhost role: replica tier: backend Aug 18 11:52:39.952: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-3620 create -f -' Aug 18 11:52:40.286: INFO: stderr: "" Aug 18 11:52:40.286: INFO: stdout: "service/agnhost-replica created\n" Aug 18 11:52:40.286: INFO: apiVersion: v1 kind: Service metadata: name: agnhost-primary labels: app: agnhost role: primary tier: backend spec: ports: - port: 6379 targetPort: 6379 selector: app: agnhost role: primary tier: backend Aug 18 11:52:40.286: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-3620 create -f -' Aug 18 11:52:40.535: INFO: stderr: "" Aug 18 11:52:40.535: INFO: stdout: "service/agnhost-primary created\n" Aug 18 11:52:40.536: INFO: apiVersion: v1 kind: Service metadata: name: frontend labels: app: guestbook tier: frontend spec: # if your cluster supports it, uncomment the following to automatically create # an external load-balanced IP for the frontend service. # type: LoadBalancer ports: - port: 80 selector: app: guestbook tier: frontend Aug 18 11:52:40.536: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-3620 create -f -' Aug 18 11:52:40.794: INFO: stderr: "" Aug 18 11:52:40.794: INFO: stdout: "service/frontend created\n" Aug 18 11:52:40.794: INFO: apiVersion: apps/v1 kind: Deployment metadata: name: frontend spec: replicas: 3 selector: matchLabels: app: guestbook tier: frontend template: metadata: labels: app: guestbook tier: frontend spec: containers: - name: guestbook-frontend image: k8s.gcr.io/e2e-test-images/agnhost:2.20 args: [ "guestbook", "--backend-port", "6379" ] resources: requests: cpu: 100m memory: 100Mi ports: - containerPort: 80 Aug 18 11:52:40.794: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-3620 create -f -' Aug 18 11:52:41.062: INFO: stderr: "" Aug 18 11:52:41.062: INFO: stdout: "deployment.apps/frontend created\n" Aug 18 11:52:41.063: INFO: apiVersion: apps/v1 kind: Deployment metadata: name: agnhost-primary spec: replicas: 1 selector: matchLabels: app: agnhost role: primary tier: backend template: metadata: labels: app: agnhost role: primary tier: backend spec: containers: - name: primary image: k8s.gcr.io/e2e-test-images/agnhost:2.20 args: [ "guestbook", "--http-port", "6379" ] resources: requests: cpu: 100m memory: 100Mi ports: - containerPort: 6379 Aug 18 11:52:41.063: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-3620 create -f -' Aug 18 11:52:41.326: INFO: stderr: "" Aug 18 11:52:41.326: INFO: stdout: "deployment.apps/agnhost-primary created\n" Aug 18 11:52:41.326: INFO: apiVersion: apps/v1 kind: Deployment metadata: name: agnhost-replica spec: replicas: 2 selector: matchLabels: app: agnhost role: replica tier: backend template: metadata: labels: app: agnhost role: replica tier: backend spec: containers: - name: replica image: k8s.gcr.io/e2e-test-images/agnhost:2.20 args: [ "guestbook", "--replicaof", "agnhost-primary", "--http-port", "6379" ] resources: requests: cpu: 100m memory: 100Mi ports: - containerPort: 6379 Aug 18 11:52:41.326: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-3620 create -f -' Aug 18 11:52:41.568: INFO: stderr: "" Aug 18 11:52:41.568: INFO: stdout: "deployment.apps/agnhost-replica created\n" STEP: validating guestbook app Aug 18 11:52:41.568: INFO: Waiting for all frontend pods to be Running. Aug 18 11:52:56.620: INFO: Waiting for frontend to serve content. Aug 18 11:52:56.629: INFO: Trying to add a new entry to the guestbook. Aug 18 11:52:57.639: INFO: Verifying that added entry can be retrieved. STEP: using delete to clean up resources Aug 18 11:52:57.648: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-3620 delete --grace-period=0 --force -f -' Aug 18 11:52:57.808: INFO: stderr: "warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely.\n" Aug 18 11:52:57.808: INFO: stdout: "service \"agnhost-replica\" force deleted\n" STEP: using delete to clean up resources Aug 18 11:52:57.808: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-3620 delete --grace-period=0 --force -f -' Aug 18 11:52:57.942: INFO: stderr: "warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely.\n" Aug 18 11:52:57.942: INFO: stdout: "service \"agnhost-primary\" force deleted\n" STEP: using delete to clean up resources Aug 18 11:52:57.942: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-3620 delete --grace-period=0 --force -f -' Aug 18 11:52:58.093: INFO: stderr: "warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely.\n" Aug 18 11:52:58.093: INFO: stdout: "service \"frontend\" force deleted\n" STEP: using delete to clean up resources Aug 18 11:52:58.094: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-3620 delete --grace-period=0 --force -f -' Aug 18 11:52:58.234: INFO: stderr: "warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely.\n" Aug 18 11:52:58.234: INFO: stdout: "deployment.apps \"frontend\" force deleted\n" STEP: using delete to clean up resources Aug 18 11:52:58.234: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-3620 delete --grace-period=0 --force -f -' Aug 18 11:52:58.376: INFO: stderr: "warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely.\n" Aug 18 11:52:58.376: INFO: stdout: "deployment.apps \"agnhost-primary\" force deleted\n" STEP: using delete to clean up resources Aug 18 11:52:58.376: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-3620 delete --grace-period=0 --force -f -' Aug 18 11:52:58.515: INFO: stderr: "warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely.\n" Aug 18 11:52:58.515: INFO: stdout: "deployment.apps \"agnhost-replica\" force deleted\n" [AfterEach] [sig-cli] Kubectl client /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:52:58.515: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "kubectl-3620" for this suite. • [SLOW TEST:18.590 seconds] [sig-cli] Kubectl client /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/framework.go:23 Guestbook application /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/kubectl.go:342 should create and stop a working application [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-cli] Kubectl client Guestbook application should create and stop a working application [Conformance]","total":-1,"completed":15,"skipped":312,"failed":3,"failures":["[k8s.io] Variable Expansion should allow substituting values in a volume subpath [sig-storage] [Conformance]","[sig-apps] StatefulSet [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] should perform canary updates and phased rolling updates of template modifications [Conformance]","[sig-api-machinery] Secrets should be consumable from pods in env vars [NodeConformance] [Conformance]"]} SSSSSSSSS ------------------------------ [BeforeEach] [k8s.io] Variable Expansion /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:47:57.569: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename var-expansion STEP: Waiting for a default service account to be provisioned in namespace [It] should allow substituting values in a container's command [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating a pod to test substitution in container's command Aug 18 11:47:57.603: INFO: Waiting up to 5m0s for pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209" in namespace "var-expansion-6220" to be "Succeeded or Failed" Aug 18 11:47:57.606: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 2.228699ms Aug 18 11:47:59.608: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 2.005026456s Aug 18 11:48:01.612: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 4.008915517s Aug 18 11:48:03.616: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 6.012218161s Aug 18 11:48:05.620: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 8.016919791s Aug 18 11:48:07.624: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 10.020802747s Aug 18 11:48:09.627: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 12.023770108s Aug 18 11:48:11.631: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 14.027845674s Aug 18 11:48:13.635: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 16.031257653s Aug 18 11:48:15.639: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 18.035224437s Aug 18 11:48:17.643: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 20.039157695s Aug 18 11:48:19.646: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 22.042104449s Aug 18 11:48:21.649: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 24.045470236s Aug 18 11:48:23.652: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 26.049030524s Aug 18 11:48:25.656: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 28.052929253s Aug 18 11:48:27.659: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 30.05575485s Aug 18 11:48:29.662: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 32.058783153s Aug 18 11:48:31.665: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 34.061388099s Aug 18 11:48:33.669: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 36.065183308s Aug 18 11:48:35.672: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 38.068207456s Aug 18 11:48:37.675: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 40.071648142s Aug 18 11:48:39.678: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 42.074160527s Aug 18 11:48:41.681: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 44.077440223s Aug 18 11:48:43.684: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 46.080299517s Aug 18 11:48:45.687: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 48.083920195s Aug 18 11:48:47.690: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 50.086600874s Aug 18 11:48:49.693: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 52.089434745s Aug 18 11:48:51.696: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 54.092965705s Aug 18 11:48:53.700: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 56.096113681s Aug 18 11:48:55.703: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 58.099653948s Aug 18 11:48:57.706: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.102297619s Aug 18 11:48:59.709: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.105473246s Aug 18 11:49:01.713: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.109598743s Aug 18 11:49:03.717: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.113942171s Aug 18 11:49:05.720: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.117045821s Aug 18 11:49:07.723: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.119942617s Aug 18 11:49:09.726: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.122967138s Aug 18 11:49:11.730: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.1261885s Aug 18 11:49:13.733: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.129807625s Aug 18 11:49:15.737: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.133727181s Aug 18 11:49:17.740: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.136769095s Aug 18 11:49:19.743: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.13943405s Aug 18 11:49:21.746: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.142431522s Aug 18 11:49:23.749: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.145275528s Aug 18 11:49:25.753: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.149187695s Aug 18 11:49:27.756: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.152511456s Aug 18 11:49:29.758: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.15496507s Aug 18 11:49:31.762: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.158407916s Aug 18 11:49:33.765: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.161512823s Aug 18 11:49:35.769: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.166068138s Aug 18 11:49:37.772: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.168701504s Aug 18 11:49:39.776: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.172833502s Aug 18 11:49:41.780: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.177020478s Aug 18 11:49:43.783: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.180070905s Aug 18 11:49:45.788: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.185075577s Aug 18 11:49:47.792: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.188694169s Aug 18 11:49:49.796: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.192743704s Aug 18 11:49:51.799: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.195277913s Aug 18 11:49:53.802: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.198090951s Aug 18 11:49:55.805: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.201775723s Aug 18 11:49:57.808: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.204721585s Aug 18 11:49:59.812: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.20880285s Aug 18 11:50:01.815: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.211575098s Aug 18 11:50:03.819: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.215262644s Aug 18 11:50:05.826: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.222819456s Aug 18 11:50:07.830: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.226352487s Aug 18 11:50:09.833: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.229312181s Aug 18 11:50:11.836: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.232098653s Aug 18 11:50:13.840: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.236126875s Aug 18 11:50:15.845: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.241986402s Aug 18 11:50:17.849: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.245738093s Aug 18 11:50:19.854: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.250501429s Aug 18 11:50:21.857: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.253471864s Aug 18 11:50:23.860: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.256647846s Aug 18 11:50:25.868: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.264974154s Aug 18 11:50:27.872: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.268832397s Aug 18 11:50:29.874: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.270998364s Aug 18 11:50:31.879: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.275578409s Aug 18 11:50:33.883: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.279868031s Aug 18 11:50:35.887: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.283642673s Aug 18 11:50:37.890: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.286564825s Aug 18 11:50:39.893: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.289782215s Aug 18 11:50:41.898: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.294484963s Aug 18 11:50:43.902: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.298275154s Aug 18 11:50:45.906: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.30246697s Aug 18 11:50:47.909: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.306049253s Aug 18 11:50:49.913: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.310062681s Aug 18 11:50:51.918: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.314371215s Aug 18 11:50:53.921: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.317820761s Aug 18 11:50:55.926: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.322119921s Aug 18 11:50:57.930: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.326107319s Aug 18 11:50:59.934: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.330394729s Aug 18 11:51:01.939: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.335164586s Aug 18 11:51:03.942: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.338854741s Aug 18 11:51:05.945: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.341736328s Aug 18 11:51:07.949: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.34529404s Aug 18 11:51:09.952: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.348726777s Aug 18 11:51:11.956: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.352781723s Aug 18 11:51:13.960: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.35699803s Aug 18 11:51:15.964: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.360797574s Aug 18 11:51:17.968: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.364507945s Aug 18 11:51:19.971: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.367960787s Aug 18 11:51:21.975: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.371943102s Aug 18 11:51:23.980: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.376220276s Aug 18 11:51:25.983: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.379100193s Aug 18 11:51:27.986: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.382443621s Aug 18 11:51:29.989: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.385454626s Aug 18 11:51:31.991: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.387992806s Aug 18 11:51:33.996: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.392301331s Aug 18 11:51:35.999: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.396019056s Aug 18 11:51:38.003: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.399803691s Aug 18 11:51:40.006: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.402435021s Aug 18 11:51:42.010: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.406113606s Aug 18 11:51:44.013: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.409852551s Aug 18 11:51:46.016: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.413078972s Aug 18 11:51:48.020: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.416162709s Aug 18 11:51:50.024: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.420592688s Aug 18 11:51:52.027: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.423106157s Aug 18 11:51:54.029: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.425294689s Aug 18 11:51:56.035: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.431266978s Aug 18 11:51:58.039: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.435828572s Aug 18 11:52:00.044: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.440424976s Aug 18 11:52:02.048: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.444512892s Aug 18 11:52:04.051: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.447500771s Aug 18 11:52:06.058: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.454320679s Aug 18 11:52:08.061: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.457824962s Aug 18 11:52:10.065: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.462060256s Aug 18 11:52:12.068: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.465060745s Aug 18 11:52:14.071: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.467961577s Aug 18 11:52:16.077: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.473319117s Aug 18 11:52:18.080: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.476124283s Aug 18 11:52:20.085: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.481375862s Aug 18 11:52:22.088: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.484241414s Aug 18 11:52:24.091: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.487281526s Aug 18 11:52:26.094: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.490511192s Aug 18 11:52:28.097: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.493310204s Aug 18 11:52:30.099: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.495932011s Aug 18 11:52:32.102: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.498665131s Aug 18 11:52:34.105: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.501712182s Aug 18 11:52:36.109: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.505234214s Aug 18 11:52:38.113: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.509224362s Aug 18 11:52:40.116: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.512627315s Aug 18 11:52:42.121: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.517109041s Aug 18 11:52:44.124: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.520416314s Aug 18 11:52:46.127: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.523379643s Aug 18 11:52:48.130: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.526216439s Aug 18 11:52:50.133: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.529198117s Aug 18 11:52:52.135: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.531824729s Aug 18 11:52:54.139: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.536058692s Aug 18 11:52:56.142: INFO: Pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.538728406s Aug 18 11:52:58.150: INFO: Failed to get logs from node "node1" pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209" container "dapi-container": the server rejected our request for an unknown reason (get pods var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209) STEP: delete the pod Aug 18 11:52:58.155: INFO: Waiting for pod var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209 to disappear Aug 18 11:52:58.158: INFO: Pod var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209 still exists Aug 18 11:53:00.158: INFO: Waiting for pod var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209 to disappear Aug 18 11:53:00.161: INFO: Pod var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209 still exists Aug 18 11:53:02.158: INFO: Waiting for pod var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209 to disappear Aug 18 11:53:02.161: INFO: Pod var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209 no longer exists Aug 18 11:53:02.161: FAIL: Unexpected error: <*errors.errorString | 0xc004c46cf0>: { s: "expected pod \"var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209\" success: Gave up after waiting 5m0s for pod \"var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209\" to be \"Succeeded or Failed\"", } expected pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209" success: Gave up after waiting 5m0s for pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209" to be "Succeeded or Failed" occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).testContainerOutputMatcher(0xc0004ae9a0, 0x4c8d401, 0x23, 0xc005044400, 0x0, 0xc0011c51c8, 0x1, 0x1, 0x4deefa8) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 +0x1ee k8s.io/kubernetes/test/e2e/framework.(*Framework).TestContainerOutput(...) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:525 k8s.io/kubernetes/test/e2e/common.glob..func9.2() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/expansion.go:79 +0x198 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc001283680) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc001283680) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc001283680, 0x4deb2c0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] Variable Expansion /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "var-expansion-6220". STEP: Found 7 events. Aug 18 11:53:02.165: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209: { } Scheduled: Successfully assigned var-expansion-6220/var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209 to node1 Aug 18 11:53:02.165: INFO: At 2021-08-18 11:47:59 +0000 UTC - event for var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209: {multus } AddedInterface: Add eth0 [10.244.4.81/24] Aug 18 11:53:02.165: INFO: At 2021-08-18 11:47:59 +0000 UTC - event for var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209: {kubelet node1} Pulling: Pulling image "docker.io/library/busybox:1.29" Aug 18 11:53:02.165: INFO: At 2021-08-18 11:47:59 +0000 UTC - event for var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209: {kubelet node1} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit Aug 18 11:53:02.165: INFO: At 2021-08-18 11:47:59 +0000 UTC - event for var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209: {kubelet node1} Failed: Error: ErrImagePull Aug 18 11:53:02.165: INFO: At 2021-08-18 11:48:00 +0000 UTC - event for var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209: {kubelet node1} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" Aug 18 11:53:02.165: INFO: At 2021-08-18 11:48:00 +0000 UTC - event for var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209: {kubelet node1} Failed: Error: ImagePullBackOff Aug 18 11:53:02.167: INFO: POD NODE PHASE GRACE CONDITIONS Aug 18 11:53:02.168: INFO: Aug 18 11:53:02.172: INFO: Logging node info for node master1 Aug 18 11:53:02.175: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 ebb211fa-503f-4cfe-b1ed-c95d27a70e6e 74061 0 2021-08-18 08:20:52 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"3a:82:be:72:b5:15"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:20:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:20:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:25:59 +0000 UTC,LastTransitionTime:2021-08-18 08:25:59 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:52:58 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:52:58 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:52:58 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:52:58 +0000 UTC,LastTransitionTime:2021-08-18 08:25:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:58c3e57359b641ad92fa1959f2fecf5d,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:012cd796-2076-45d6-8b14-d3e0451b1e64,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[@ :],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:53:02.175: INFO: Logging kubelet events for node master1 Aug 18 11:53:02.177: INFO: Logging pods the kubelet thinks is on node master1 Aug 18 11:53:02.186: INFO: node-exporter-5hwz9 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:53:02.186: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:53:02.186: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:53:02.186: INFO: kube-controller-manager-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:53:02.186: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:53:02.186: INFO: kube-multus-ds-amd64-kbcp6 started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:53:02.186: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:53:02.186: INFO: docker-registry-docker-registry-56cbc7bc58-49kl2 started at 2021-08-18 08:26:23 +0000 UTC (0+2 container statuses recorded) Aug 18 11:53:02.186: INFO: Container docker-registry ready: true, restart count 0 Aug 18 11:53:02.186: INFO: Container nginx ready: true, restart count 0 Aug 18 11:53:02.186: INFO: kube-scheduler-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:53:02.186: INFO: Container kube-scheduler ready: true, restart count 0 Aug 18 11:53:02.186: INFO: kube-apiserver-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:53:02.186: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:53:02.186: INFO: kube-proxy-vqk4v started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:53:02.186: INFO: Container kube-proxy ready: true, restart count 1 Aug 18 11:53:02.186: INFO: kube-flannel-q64cq started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:53:02.186: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:53:02.186: INFO: Container kube-flannel ready: true, restart count 3 Aug 18 11:53:02.186: INFO: coredns-7677f9bb54-kn2qg started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:53:02.186: INFO: Container coredns ready: true, restart count 2 W0818 11:53:02.198001 27 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:53:02.227: INFO: Latency metrics for node master1 Aug 18 11:53:02.227: INFO: Logging node info for node master2 Aug 18 11:53:02.229: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 78946293-3abe-4442-84d4-8ed6b1d15ce0 74036 0 2021-08-18 08:21:31 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"7e:f5:c2:cc:3a:b4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:21:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:21:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-08-18 08:29:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:52:56 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:52:56 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:52:56 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:52:56 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0c44122c7a7248c18d8571e1cc667258,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:0cd329f2-48e0-4c8f-b8b9-fa3ae0ed8406,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:53:02.230: INFO: Logging kubelet events for node master2 Aug 18 11:53:02.232: INFO: Logging pods the kubelet thinks is on node master2 Aug 18 11:53:02.240: INFO: node-feature-discovery-controller-5bf5c49849-mq57c started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:53:02.240: INFO: Container nfd-controller ready: true, restart count 0 Aug 18 11:53:02.240: INFO: node-exporter-48nfx started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:53:02.240: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:53:02.240: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:53:02.240: INFO: kube-apiserver-master2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:53:02.240: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:53:02.240: INFO: kube-scheduler-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:53:02.240: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:53:02.240: INFO: kube-multus-ds-amd64-mld8g started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:53:02.240: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:53:02.240: INFO: dns-autoscaler-5b7b5c9b6f-hh47r started at 2021-08-18 08:23:57 +0000 UTC (0+1 container statuses recorded) Aug 18 11:53:02.240: INFO: Container autoscaler ready: true, restart count 2 Aug 18 11:53:02.240: INFO: kube-controller-manager-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:53:02.240: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:53:02.240: INFO: kube-proxy-kh2l9 started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:53:02.240: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:53:02.240: INFO: kube-flannel-pp56h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:53:02.240: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:53:02.240: INFO: Container kube-flannel ready: true, restart count 1 W0818 11:53:02.253573 27 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:53:02.276: INFO: Latency metrics for node master2 Aug 18 11:53:02.276: INFO: Logging node info for node master3 Aug 18 11:53:02.278: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 44feac2b-9447-4be2-9fcd-62f836d67c72 74130 0 2021-08-18 08:21:41 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"86:e4:31:99:58:40"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {kubelet Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:53:02 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:53:02 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:53:02 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:53:02 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1fae19ae59884c44899bcd08aa243244,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:5db926c5-6530-4635-a0d5-806974a3b732,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:53:02.279: INFO: Logging kubelet events for node master3 Aug 18 11:53:02.280: INFO: Logging pods the kubelet thinks is on node master3 Aug 18 11:53:02.289: INFO: kube-multus-ds-amd64-bkw6c started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:53:02.289: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:53:02.289: INFO: coredns-7677f9bb54-5hxfh started at 2021-08-18 08:23:54 +0000 UTC (0+1 container statuses recorded) Aug 18 11:53:02.289: INFO: Container coredns ready: true, restart count 1 Aug 18 11:53:02.289: INFO: node-exporter-vq7d8 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:53:02.289: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:53:02.289: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:53:02.289: INFO: kube-controller-manager-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:53:02.289: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:53:02.289: INFO: kube-scheduler-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:53:02.289: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:53:02.289: INFO: kube-apiserver-master3 started at 2021-08-18 08:29:12 +0000 UTC (0+1 container statuses recorded) Aug 18 11:53:02.289: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:53:02.289: INFO: kube-proxy-sd5lc started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:53:02.289: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:53:02.289: INFO: kube-flannel-x6tlr started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:53:02.289: INFO: Init container install-cni ready: true, restart count 1 Aug 18 11:53:02.289: INFO: Container kube-flannel ready: true, restart count 1 W0818 11:53:02.304844 27 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:53:02.335: INFO: Latency metrics for node master3 Aug 18 11:53:02.336: INFO: Logging node info for node node1 Aug 18 11:53:02.338: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 84defabd-6ebf-43ec-a629-44c6713da9c9 74029 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"9a:87:55:36:7b:df"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:13 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:35 +0000 UTC,LastTransitionTime:2021-08-18 08:26:35 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:52:56 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:52:56 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:52:56 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:52:56 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:69946ff2b7bc462fa25eb7adb4703c23,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:736dc52f-f5e3-494e-86ca-01eedbea015c,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:a7cea43d9d2f67c38fbf0407786edbe660ee9072945f7bb272b55fd255e8eaca opnfv/barometer-collectd:stable],SizeBytes:1075746799,},ContainerImage{Names:[@ :],SizeBytes:1003788820,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[aquasec/kube-hunter@sha256:2be6820bc1d7e0f57193a9a27d5a3e16b2fd93c53747b03ce8ca48c6fc323781 aquasec/kube-hunter:0.3.1],SizeBytes:347611549,},ContainerImage{Names:[golang@sha256:db2475a1dbb2149508e5db31d7d77a75e6600d54be645f37681f03f2762169ba golang:alpine3.12],SizeBytes:301186719,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:de25c7fc6c4f3a27c7f0c2dff454e4671823a34d88abd533f210848d527e0fbb alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:53:02.339: INFO: Logging kubelet events for node node1 Aug 18 11:53:02.342: INFO: Logging pods the kubelet thinks is on node node1 Aug 18 11:53:02.356: INFO: cmk-d8r27 started at 2021-08-18 08:32:52 +0000 UTC (0+2 container statuses recorded) Aug 18 11:53:02.356: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:53:02.356: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:53:02.356: INFO: collectd-xdprr started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:53:02.356: INFO: Container collectd ready: true, restart count 0 Aug 18 11:53:02.356: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:53:02.356: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:53:02.356: INFO: kube-proxy-p6jvp started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:53:02.356: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:53:02.356: INFO: kubernetes-metrics-scraper-678c97765c-9nsv5 started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:53:02.356: INFO: Container kubernetes-metrics-scraper ready: true, restart count 2 Aug 18 11:53:02.356: INFO: cmk-init-discover-node1-bxznx started at 2021-08-18 08:32:10 +0000 UTC (0+3 container statuses recorded) Aug 18 11:53:02.356: INFO: Container discover ready: false, restart count 0 Aug 18 11:53:02.356: INFO: Container init ready: false, restart count 0 Aug 18 11:53:02.356: INFO: Container install ready: false, restart count 0 Aug 18 11:53:02.356: INFO: agnhost-replica-7d6489798-9xwwl started at 2021-08-18 11:52:41 +0000 UTC (0+1 container statuses recorded) Aug 18 11:53:02.356: INFO: Container replica ready: false, restart count 0 Aug 18 11:53:02.356: INFO: nginx-proxy-node1 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:53:02.356: INFO: Container nginx-proxy ready: true, restart count 2 Aug 18 11:53:02.357: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-vsxvg started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:53:02.357: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:53:02.357: INFO: client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419 started at 2021-08-18 11:52:32 +0000 UTC (0+1 container statuses recorded) Aug 18 11:53:02.357: INFO: Container env3cont ready: false, restart count 0 Aug 18 11:53:02.357: INFO: pod-with-poststart-exec-hook started at 2021-08-18 11:52:42 +0000 UTC (0+1 container statuses recorded) Aug 18 11:53:02.357: INFO: Container pod-with-poststart-exec-hook ready: false, restart count 0 Aug 18 11:53:02.357: INFO: kube-flannel-q78nd started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:53:02.357: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:53:02.357: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:53:02.357: INFO: prometheus-k8s-0 started at 2021-08-18 08:34:03 +0000 UTC (0+5 container statuses recorded) Aug 18 11:53:02.357: INFO: Container custom-metrics-apiserver ready: true, restart count 0 Aug 18 11:53:02.357: INFO: Container grafana ready: true, restart count 0 Aug 18 11:53:02.357: INFO: Container prometheus ready: true, restart count 1 Aug 18 11:53:02.357: INFO: Container prometheus-config-reloader ready: true, restart count 0 Aug 18 11:53:02.357: INFO: Container rules-configmap-reloader ready: true, restart count 0 Aug 18 11:53:02.357: INFO: agnhost-primary-76f75c9b74-vrj97 started at 2021-08-18 11:52:41 +0000 UTC (0+1 container statuses recorded) Aug 18 11:53:02.357: INFO: Container primary ready: false, restart count 0 Aug 18 11:53:02.357: INFO: pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a started at 2021-08-18 11:52:01 +0000 UTC (0+1 container statuses recorded) Aug 18 11:53:02.357: INFO: Container env-test ready: false, restart count 0 Aug 18 11:53:02.357: INFO: ss-0 started at 2021-08-18 11:47:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:53:02.357: INFO: Container webserver ready: false, restart count 0 Aug 18 11:53:02.357: INFO: server-envvars-dcc91a28-e119-476f-ad7b-86dc853ddeb4 started at 2021-08-18 11:52:28 +0000 UTC (0+1 container statuses recorded) Aug 18 11:53:02.357: INFO: Container srv ready: true, restart count 0 Aug 18 11:53:02.357: INFO: kube-multus-ds-amd64-rrvmb started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:53:02.357: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:53:02.357: INFO: node-feature-discovery-worker-pflgw started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:53:02.357: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:53:02.357: INFO: node-exporter-kcwvn started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:53:02.357: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:53:02.357: INFO: Container node-exporter ready: true, restart count 0 W0818 11:53:02.368267 27 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:53:02.407: INFO: Latency metrics for node node1 Aug 18 11:53:02.407: INFO: Logging node info for node node2 Aug 18 11:53:02.411: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 1d01177e-3dbb-48a1-a0bc-d18af27ab7f8 74105 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:d1:47:f8:1d:22"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:36 +0000 UTC,LastTransitionTime:2021-08-18 08:26:36 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:53:00 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:53:00 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:53:00 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:53:00 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:dc1f286135c145349b8a016880b65a2f,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:037e7e2d-94e9-42f4-a719-896e5005ac70,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:53:02.411: INFO: Logging kubelet events for node node2 Aug 18 11:53:02.414: INFO: Logging pods the kubelet thinks is on node node2 Aug 18 11:53:02.427: INFO: kube-proxy-qkj9c started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:53:02.427: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:53:02.427: INFO: node-feature-discovery-worker-hzpf5 started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:53:02.427: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:53:02.427: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-c82pt started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:53:02.427: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:53:02.427: INFO: prometheus-operator-5bb8cb9d8f-k97ws started at 2021-08-18 08:33:38 +0000 UTC (0+2 container statuses recorded) Aug 18 11:53:02.427: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:53:02.427: INFO: Container prometheus-operator ready: true, restart count 0 Aug 18 11:53:02.427: INFO: kube-multus-ds-amd64-rvzsg started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:53:02.427: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:53:02.427: INFO: collectd-67ntq started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:53:02.427: INFO: Container collectd ready: true, restart count 0 Aug 18 11:53:02.427: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:53:02.427: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:53:02.427: INFO: ss-0 started at 2021-08-18 11:46:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:53:02.427: INFO: Container webserver ready: false, restart count 0 Aug 18 11:53:02.427: INFO: termination-message-container84499a62-bd35-4cdc-809d-811cd552608a started at 2021-08-18 11:51:42 +0000 UTC (0+1 container statuses recorded) Aug 18 11:53:02.427: INFO: Container termination-message-container ready: false, restart count 0 Aug 18 11:53:02.427: INFO: bin-falsea5f6898f-c6c3-4680-9cbd-f4985908f73e started at 2021-08-18 11:49:10 +0000 UTC (0+1 container statuses recorded) Aug 18 11:53:02.427: INFO: Container bin-falsea5f6898f-c6c3-4680-9cbd-f4985908f73e ready: false, restart count 0 Aug 18 11:53:02.427: INFO: cmk-webhook-6c9d5f8578-7cxjr started at 2021-08-18 08:32:53 +0000 UTC (0+1 container statuses recorded) Aug 18 11:53:02.427: INFO: Container cmk-webhook ready: true, restart count 0 Aug 18 11:53:02.427: INFO: terminate-cmd-rpad23b99c9-2d62-4758-a55c-1712aba45053 started at 2021-08-18 11:50:30 +0000 UTC (0+1 container statuses recorded) Aug 18 11:53:02.427: INFO: Container terminate-cmd-rpa ready: false, restart count 0 Aug 18 11:53:02.427: INFO: kube-flannel-h7t5h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:53:02.427: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:53:02.427: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:53:02.427: INFO: node-exporter-lrrf2 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:53:02.427: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:53:02.427: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:53:02.427: INFO: frontend-58d458fdbd-mflxm started at 2021-08-18 11:52:41 +0000 UTC (0+1 container statuses recorded) Aug 18 11:53:02.427: INFO: Container guestbook-frontend ready: false, restart count 0 Aug 18 11:53:02.427: INFO: agnhost-replica-7d6489798-mj9l8 started at 2021-08-18 11:52:41 +0000 UTC (0+1 container statuses recorded) Aug 18 11:53:02.427: INFO: Container replica ready: false, restart count 0 Aug 18 11:53:02.427: INFO: nginx-proxy-node2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:53:02.427: INFO: Container nginx-proxy ready: true, restart count 1 Aug 18 11:53:02.427: INFO: cmk-init-discover-node2-6b2kz started at 2021-08-18 08:32:30 +0000 UTC (0+3 container statuses recorded) Aug 18 11:53:02.427: INFO: Container discover ready: false, restart count 0 Aug 18 11:53:02.427: INFO: Container init ready: false, restart count 0 Aug 18 11:53:02.427: INFO: Container install ready: false, restart count 0 Aug 18 11:53:02.427: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-7rn45 started at 2021-08-18 08:36:42 +0000 UTC (0+2 container statuses recorded) Aug 18 11:53:02.427: INFO: Container tas-controller ready: true, restart count 0 Aug 18 11:53:02.427: INFO: Container tas-extender ready: true, restart count 0 Aug 18 11:53:02.427: INFO: kubernetes-dashboard-86c6f9df5b-qrtdk started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:53:02.427: INFO: Container kubernetes-dashboard ready: true, restart count 2 Aug 18 11:53:02.427: INFO: pod-handle-http-request started at 2021-08-18 11:52:38 +0000 UTC (0+1 container statuses recorded) Aug 18 11:53:02.427: INFO: Container pod-handle-http-request ready: true, restart count 0 Aug 18 11:53:02.427: INFO: busybox-3dfd903c-68f3-48ac-a884-dd6ba807fca5 started at 2021-08-18 11:52:58 +0000 UTC (0+1 container statuses recorded) Aug 18 11:53:02.427: INFO: Container busybox ready: false, restart count 0 Aug 18 11:53:02.427: INFO: cmk-748rz started at 2021-08-18 08:32:53 +0000 UTC (0+2 container statuses recorded) Aug 18 11:53:02.427: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:53:02.427: INFO: Container reconcile ready: true, restart count 0 W0818 11:53:02.440738 27 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:53:02.470: INFO: Latency metrics for node node2 Aug 18 11:53:02.470: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "var-expansion-6220" for this suite. • Failure [304.910 seconds] [k8s.io] Variable Expansion /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 should allow substituting values in a container's command [NodeConformance] [Conformance] [It] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:53:02.161: Unexpected error: <*errors.errorString | 0xc004c46cf0>: { s: "expected pod \"var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209\" success: Gave up after waiting 5m0s for pod \"var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209\" to be \"Succeeded or Failed\"", } expected pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209" success: Gave up after waiting 5m0s for pod "var-expansion-0dfed60c-1d02-4049-9573-bfefd7c43209" to be "Succeeded or Failed" occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 ------------------------------ {"msg":"FAILED [k8s.io] Variable Expansion should allow substituting values in a container's command [NodeConformance] [Conformance]","total":-1,"completed":22,"skipped":400,"failed":4,"failures":["[sig-node] Downward API should provide host IP as an env var [NodeConformance] [Conformance]","[k8s.io] Kubelet when scheduling a busybox Pod with hostAliases should write entries to /etc/hosts [LinuxOnly] [NodeConformance] [Conformance]","[sig-api-machinery] Secrets should be consumable via the environment [NodeConformance] [Conformance]","[k8s.io] Variable Expansion should allow substituting values in a container's command [NodeConformance] [Conformance]"]} SSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-apps] ReplicationController /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:53:02.538: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename replication-controller STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-apps] ReplicationController /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/rc.go:54 [It] should release no longer matching pods [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Given a ReplicationController is created STEP: When the matched label of one of its pods change Aug 18 11:53:02.564: INFO: Pod name pod-release: Found 0 pods out of 1 Aug 18 11:53:07.566: INFO: Pod name pod-release: Found 1 pods out of 1 STEP: Then the pod is released [AfterEach] [sig-apps] ReplicationController /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:53:08.579: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "replication-controller-2588" for this suite. • [SLOW TEST:6.051 seconds] [sig-apps] ReplicationController /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/framework.go:23 should release no longer matching pods [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-apps] ReplicationController should release no longer matching pods [Conformance]","total":-1,"completed":23,"skipped":425,"failed":4,"failures":["[sig-node] Downward API should provide host IP as an env var [NodeConformance] [Conformance]","[k8s.io] Kubelet when scheduling a busybox Pod with hostAliases should write entries to /etc/hosts [LinuxOnly] [NodeConformance] [Conformance]","[sig-api-machinery] Secrets should be consumable via the environment [NodeConformance] [Conformance]","[k8s.io] Variable Expansion should allow substituting values in a container's command [NodeConformance] [Conformance]"]} SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [k8s.io] Container Lifecycle Hook /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:52:38.451: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename container-lifecycle-hook STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] when create a pod with lifecycle hook /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/lifecycle_hook.go:64 STEP: create the container to handle the HTTPGet hook request. [It] should execute poststart exec hook properly [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: create the pod with lifecycle hook STEP: check poststart hook STEP: delete the pod with lifecycle hook Aug 18 11:52:58.535: INFO: Waiting for pod pod-with-poststart-exec-hook to disappear Aug 18 11:52:58.537: INFO: Pod pod-with-poststart-exec-hook still exists Aug 18 11:53:00.537: INFO: Waiting for pod pod-with-poststart-exec-hook to disappear Aug 18 11:53:00.540: INFO: Pod pod-with-poststart-exec-hook still exists Aug 18 11:53:02.537: INFO: Waiting for pod pod-with-poststart-exec-hook to disappear Aug 18 11:53:02.540: INFO: Pod pod-with-poststart-exec-hook still exists Aug 18 11:53:04.537: INFO: Waiting for pod pod-with-poststart-exec-hook to disappear Aug 18 11:53:04.540: INFO: Pod pod-with-poststart-exec-hook still exists Aug 18 11:53:06.537: INFO: Waiting for pod pod-with-poststart-exec-hook to disappear Aug 18 11:53:06.541: INFO: Pod pod-with-poststart-exec-hook still exists Aug 18 11:53:08.540: INFO: Waiting for pod pod-with-poststart-exec-hook to disappear Aug 18 11:53:08.543: INFO: Pod pod-with-poststart-exec-hook still exists Aug 18 11:53:10.537: INFO: Waiting for pod pod-with-poststart-exec-hook to disappear Aug 18 11:53:10.541: INFO: Pod pod-with-poststart-exec-hook still exists Aug 18 11:53:12.537: INFO: Waiting for pod pod-with-poststart-exec-hook to disappear Aug 18 11:53:12.540: INFO: Pod pod-with-poststart-exec-hook no longer exists [AfterEach] [k8s.io] Container Lifecycle Hook /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:53:12.540: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "container-lifecycle-hook-4231" for this suite. • [SLOW TEST:34.096 seconds] [k8s.io] Container Lifecycle Hook /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 when create a pod with lifecycle hook /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/lifecycle_hook.go:42 should execute poststart exec hook properly [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ [BeforeEach] [k8s.io] Kubelet /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:49:10.949: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename kubelet-test STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [k8s.io] Kubelet /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/kubelet.go:38 [BeforeEach] when scheduling a busybox command that always fails in a pod /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/kubelet.go:82 [It] should have an terminated reason [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:54:10.986: FAIL: Timed out after 300.000s. Expected <*errors.errorString | 0xc004b208c0>: { s: "expected state to be terminated. Got pod status: {Phase:Pending Conditions:[{Type:Initialized Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2021-08-18 11:49:10 +0000 UTC Reason: Message:} {Type:Ready Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2021-08-18 11:49:10 +0000 UTC Reason:ContainersNotReady Message:containers with unready status: [bin-falsea5f6898f-c6c3-4680-9cbd-f4985908f73e]} {Type:ContainersReady Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2021-08-18 11:49:10 +0000 UTC Reason:ContainersNotReady Message:containers with unready status: [bin-falsea5f6898f-c6c3-4680-9cbd-f4985908f73e]} {Type:PodScheduled Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2021-08-18 11:49:10 +0000 UTC Reason: Message:}] Message: Reason: NominatedNodeName: HostIP:10.10.190.208 PodIP:10.244.3.78 PodIPs:[{IP:10.244.3.78}] StartTime:2021-08-18 11:49:10 +0000 UTC InitContainerStatuses:[] ContainerStatuses:[{Name:bin-falsea5f6898f-c6c3-4680-9cbd-f4985908f73e State:{Waiting:&ContainerStateWaiting{Reason:ImagePullBackOff,Message:Back-off pulling image \"docker.io/library/busybox:1.29\",} Running:nil Terminated:nil} LastTerminationState:{Waiting:nil Running:nil Terminated:nil} Ready:false RestartCount:0 Image:docker.io/library/busybox:1.29 ImageID: ContainerID: Started:0xc004ae6a3b}] QOSClass:BestEffort EphemeralContainerStatuses:[]}", } to be nil Full Stack Trace k8s.io/kubernetes/test/e2e/common.glob..func12.3.2() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/kubelet.go:124 +0x125 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc001b28d80) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc001b28d80) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc001b28d80, 0x4deb2c0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] Kubelet /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "kubelet-test-6059". STEP: Found 10 events. Aug 18 11:54:10.991: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for bin-falsea5f6898f-c6c3-4680-9cbd-f4985908f73e: { } Scheduled: Successfully assigned kubelet-test-6059/bin-falsea5f6898f-c6c3-4680-9cbd-f4985908f73e to node2 Aug 18 11:54:10.992: INFO: At 2021-08-18 11:49:12 +0000 UTC - event for bin-falsea5f6898f-c6c3-4680-9cbd-f4985908f73e: {multus } AddedInterface: Add eth0 [10.244.3.77/24] Aug 18 11:54:10.992: INFO: At 2021-08-18 11:49:12 +0000 UTC - event for bin-falsea5f6898f-c6c3-4680-9cbd-f4985908f73e: {kubelet node2} Pulling: Pulling image "docker.io/library/busybox:1.29" Aug 18 11:54:10.992: INFO: At 2021-08-18 11:49:13 +0000 UTC - event for bin-falsea5f6898f-c6c3-4680-9cbd-f4985908f73e: {kubelet node2} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit Aug 18 11:54:10.992: INFO: At 2021-08-18 11:49:13 +0000 UTC - event for bin-falsea5f6898f-c6c3-4680-9cbd-f4985908f73e: {kubelet node2} Failed: Error: ErrImagePull Aug 18 11:54:10.992: INFO: At 2021-08-18 11:49:13 +0000 UTC - event for bin-falsea5f6898f-c6c3-4680-9cbd-f4985908f73e: {kubelet node2} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Aug 18 11:54:10.992: INFO: At 2021-08-18 11:49:16 +0000 UTC - event for bin-falsea5f6898f-c6c3-4680-9cbd-f4985908f73e: {multus } AddedInterface: Add eth0 [10.244.3.78/24] Aug 18 11:54:10.992: INFO: At 2021-08-18 11:49:16 +0000 UTC - event for bin-falsea5f6898f-c6c3-4680-9cbd-f4985908f73e: {kubelet node2} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" Aug 18 11:54:10.992: INFO: At 2021-08-18 11:49:16 +0000 UTC - event for bin-falsea5f6898f-c6c3-4680-9cbd-f4985908f73e: {kubelet node2} Failed: Error: ImagePullBackOff Aug 18 11:54:10.992: INFO: At 2021-08-18 11:49:59 +0000 UTC - event for bin-falsea5f6898f-c6c3-4680-9cbd-f4985908f73e: {kubelet node2} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit Aug 18 11:54:10.995: INFO: POD NODE PHASE GRACE CONDITIONS Aug 18 11:54:10.995: INFO: bin-falsea5f6898f-c6c3-4680-9cbd-f4985908f73e node2 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:49:10 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:49:10 +0000 UTC ContainersNotReady containers with unready status: [bin-falsea5f6898f-c6c3-4680-9cbd-f4985908f73e]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:49:10 +0000 UTC ContainersNotReady containers with unready status: [bin-falsea5f6898f-c6c3-4680-9cbd-f4985908f73e]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:49:10 +0000 UTC }] Aug 18 11:54:10.995: INFO: Aug 18 11:54:11.000: INFO: Logging node info for node master1 Aug 18 11:54:11.002: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 ebb211fa-503f-4cfe-b1ed-c95d27a70e6e 74680 0 2021-08-18 08:20:52 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"3a:82:be:72:b5:15"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:20:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:20:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:25:59 +0000 UTC,LastTransitionTime:2021-08-18 08:25:59 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:54:08 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:54:08 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:54:08 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:54:08 +0000 UTC,LastTransitionTime:2021-08-18 08:25:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:58c3e57359b641ad92fa1959f2fecf5d,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:012cd796-2076-45d6-8b14-d3e0451b1e64,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[@ :],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:54:11.003: INFO: Logging kubelet events for node master1 Aug 18 11:54:11.005: INFO: Logging pods the kubelet thinks is on node master1 Aug 18 11:54:11.015: INFO: kube-proxy-vqk4v started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:54:11.015: INFO: Container kube-proxy ready: true, restart count 1 Aug 18 11:54:11.015: INFO: kube-flannel-q64cq started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:54:11.015: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:54:11.015: INFO: Container kube-flannel ready: true, restart count 3 Aug 18 11:54:11.015: INFO: coredns-7677f9bb54-kn2qg started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:54:11.015: INFO: Container coredns ready: true, restart count 2 Aug 18 11:54:11.015: INFO: kube-scheduler-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:54:11.015: INFO: Container kube-scheduler ready: true, restart count 0 Aug 18 11:54:11.015: INFO: kube-apiserver-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:54:11.015: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:54:11.015: INFO: kube-multus-ds-amd64-kbcp6 started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:54:11.015: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:54:11.015: INFO: docker-registry-docker-registry-56cbc7bc58-49kl2 started at 2021-08-18 08:26:23 +0000 UTC (0+2 container statuses recorded) Aug 18 11:54:11.015: INFO: Container docker-registry ready: true, restart count 0 Aug 18 11:54:11.015: INFO: Container nginx ready: true, restart count 0 Aug 18 11:54:11.015: INFO: node-exporter-5hwz9 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:54:11.015: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:54:11.015: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:54:11.015: INFO: kube-controller-manager-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:54:11.015: INFO: Container kube-controller-manager ready: true, restart count 2 W0818 11:54:11.028780 31 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:54:11.051: INFO: Latency metrics for node master1 Aug 18 11:54:11.051: INFO: Logging node info for node master2 Aug 18 11:54:11.053: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 78946293-3abe-4442-84d4-8ed6b1d15ce0 74677 0 2021-08-18 08:21:31 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"7e:f5:c2:cc:3a:b4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:21:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:21:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-08-18 08:29:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:54:07 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:54:07 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:54:07 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:54:07 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0c44122c7a7248c18d8571e1cc667258,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:0cd329f2-48e0-4c8f-b8b9-fa3ae0ed8406,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:54:11.054: INFO: Logging kubelet events for node master2 Aug 18 11:54:11.056: INFO: Logging pods the kubelet thinks is on node master2 Aug 18 11:54:11.062: INFO: kube-controller-manager-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:54:11.062: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:54:11.062: INFO: kube-proxy-kh2l9 started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:54:11.062: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:54:11.062: INFO: kube-flannel-pp56h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:54:11.062: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:54:11.062: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:54:11.062: INFO: kube-apiserver-master2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:54:11.062: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:54:11.062: INFO: kube-scheduler-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:54:11.062: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:54:11.062: INFO: kube-multus-ds-amd64-mld8g started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:54:11.062: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:54:11.062: INFO: dns-autoscaler-5b7b5c9b6f-hh47r started at 2021-08-18 08:23:57 +0000 UTC (0+1 container statuses recorded) Aug 18 11:54:11.062: INFO: Container autoscaler ready: true, restart count 2 Aug 18 11:54:11.062: INFO: node-feature-discovery-controller-5bf5c49849-mq57c started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:54:11.062: INFO: Container nfd-controller ready: true, restart count 0 Aug 18 11:54:11.062: INFO: node-exporter-48nfx started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:54:11.062: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:54:11.062: INFO: Container node-exporter ready: true, restart count 0 W0818 11:54:11.073692 31 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:54:11.098: INFO: Latency metrics for node master2 Aug 18 11:54:11.098: INFO: Logging node info for node master3 Aug 18 11:54:11.100: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 44feac2b-9447-4be2-9fcd-62f836d67c72 74647 0 2021-08-18 08:21:41 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"86:e4:31:99:58:40"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {kubelet Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:54:02 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:54:02 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:54:02 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:54:02 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1fae19ae59884c44899bcd08aa243244,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:5db926c5-6530-4635-a0d5-806974a3b732,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:54:11.100: INFO: Logging kubelet events for node master3 Aug 18 11:54:11.102: INFO: Logging pods the kubelet thinks is on node master3 Aug 18 11:54:11.111: INFO: kube-flannel-x6tlr started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:54:11.111: INFO: Init container install-cni ready: true, restart count 1 Aug 18 11:54:11.111: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:54:11.111: INFO: kube-multus-ds-amd64-bkw6c started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:54:11.111: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:54:11.111: INFO: coredns-7677f9bb54-5hxfh started at 2021-08-18 08:23:54 +0000 UTC (0+1 container statuses recorded) Aug 18 11:54:11.111: INFO: Container coredns ready: true, restart count 1 Aug 18 11:54:11.111: INFO: node-exporter-vq7d8 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:54:11.111: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:54:11.111: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:54:11.111: INFO: kube-controller-manager-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:54:11.111: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:54:11.111: INFO: kube-scheduler-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:54:11.111: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:54:11.111: INFO: kube-apiserver-master3 started at 2021-08-18 08:29:12 +0000 UTC (0+1 container statuses recorded) Aug 18 11:54:11.111: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:54:11.111: INFO: kube-proxy-sd5lc started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:54:11.111: INFO: Container kube-proxy ready: true, restart count 2 W0818 11:54:11.124478 31 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:54:11.147: INFO: Latency metrics for node master3 Aug 18 11:54:11.147: INFO: Logging node info for node node1 Aug 18 11:54:11.150: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 84defabd-6ebf-43ec-a629-44c6713da9c9 74668 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"9a:87:55:36:7b:df"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:13 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:35 +0000 UTC,LastTransitionTime:2021-08-18 08:26:35 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:54:06 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:54:06 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:54:06 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:54:06 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:69946ff2b7bc462fa25eb7adb4703c23,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:736dc52f-f5e3-494e-86ca-01eedbea015c,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:a7cea43d9d2f67c38fbf0407786edbe660ee9072945f7bb272b55fd255e8eaca opnfv/barometer-collectd:stable],SizeBytes:1075746799,},ContainerImage{Names:[@ :],SizeBytes:1003788820,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[aquasec/kube-hunter@sha256:2be6820bc1d7e0f57193a9a27d5a3e16b2fd93c53747b03ce8ca48c6fc323781 aquasec/kube-hunter:0.3.1],SizeBytes:347611549,},ContainerImage{Names:[golang@sha256:db2475a1dbb2149508e5db31d7d77a75e6600d54be645f37681f03f2762169ba golang:alpine3.12],SizeBytes:301186719,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:de25c7fc6c4f3a27c7f0c2dff454e4671823a34d88abd533f210848d527e0fbb alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:54:11.151: INFO: Logging kubelet events for node node1 Aug 18 11:54:11.153: INFO: Logging pods the kubelet thinks is on node node1 Aug 18 11:54:11.169: INFO: client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419 started at 2021-08-18 11:52:32 +0000 UTC (0+1 container statuses recorded) Aug 18 11:54:11.169: INFO: Container env3cont ready: false, restart count 0 Aug 18 11:54:11.169: INFO: kube-flannel-q78nd started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:54:11.169: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:54:11.169: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:54:11.169: INFO: prometheus-k8s-0 started at 2021-08-18 08:34:03 +0000 UTC (0+5 container statuses recorded) Aug 18 11:54:11.169: INFO: Container custom-metrics-apiserver ready: true, restart count 0 Aug 18 11:54:11.169: INFO: Container grafana ready: true, restart count 0 Aug 18 11:54:11.169: INFO: Container prometheus ready: true, restart count 1 Aug 18 11:54:11.169: INFO: Container prometheus-config-reloader ready: true, restart count 0 Aug 18 11:54:11.169: INFO: Container rules-configmap-reloader ready: true, restart count 0 Aug 18 11:54:11.169: INFO: node-exporter-kcwvn started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:54:11.169: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:54:11.169: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:54:11.169: INFO: pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a started at 2021-08-18 11:52:01 +0000 UTC (0+1 container statuses recorded) Aug 18 11:54:11.169: INFO: Container env-test ready: false, restart count 0 Aug 18 11:54:11.169: INFO: ss-0 started at 2021-08-18 11:47:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:54:11.169: INFO: Container webserver ready: false, restart count 0 Aug 18 11:54:11.169: INFO: foo-xpsfd started at 2021-08-18 11:53:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:54:11.169: INFO: Container c ready: false, restart count 0 Aug 18 11:54:11.169: INFO: server-envvars-dcc91a28-e119-476f-ad7b-86dc853ddeb4 started at 2021-08-18 11:52:28 +0000 UTC (0+1 container statuses recorded) Aug 18 11:54:11.169: INFO: Container srv ready: true, restart count 0 Aug 18 11:54:11.169: INFO: kube-multus-ds-amd64-rrvmb started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:54:11.169: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:54:11.169: INFO: node-feature-discovery-worker-pflgw started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:54:11.169: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:54:11.169: INFO: cmk-init-discover-node1-bxznx started at 2021-08-18 08:32:10 +0000 UTC (0+3 container statuses recorded) Aug 18 11:54:11.169: INFO: Container discover ready: false, restart count 0 Aug 18 11:54:11.169: INFO: Container init ready: false, restart count 0 Aug 18 11:54:11.169: INFO: Container install ready: false, restart count 0 Aug 18 11:54:11.169: INFO: cmk-d8r27 started at 2021-08-18 08:32:52 +0000 UTC (0+2 container statuses recorded) Aug 18 11:54:11.169: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:54:11.169: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:54:11.169: INFO: collectd-xdprr started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:54:11.169: INFO: Container collectd ready: true, restart count 0 Aug 18 11:54:11.169: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:54:11.169: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:54:11.169: INFO: kube-proxy-p6jvp started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:54:11.169: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:54:11.169: INFO: kubernetes-metrics-scraper-678c97765c-9nsv5 started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:54:11.169: INFO: Container kubernetes-metrics-scraper ready: true, restart count 2 Aug 18 11:54:11.169: INFO: nginx-proxy-node1 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:54:11.169: INFO: Container nginx-proxy ready: true, restart count 2 Aug 18 11:54:11.170: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-vsxvg started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:54:11.170: INFO: Container kube-sriovdp ready: true, restart count 0 W0818 11:54:11.181691 31 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:54:11.222: INFO: Latency metrics for node node1 Aug 18 11:54:11.222: INFO: Logging node info for node node2 Aug 18 11:54:11.225: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 1d01177e-3dbb-48a1-a0bc-d18af27ab7f8 74686 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:d1:47:f8:1d:22"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:36 +0000 UTC,LastTransitionTime:2021-08-18 08:26:36 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:54:11 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:54:11 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:54:11 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:54:11 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:dc1f286135c145349b8a016880b65a2f,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:037e7e2d-94e9-42f4-a719-896e5005ac70,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:54:11.226: INFO: Logging kubelet events for node node2 Aug 18 11:54:11.228: INFO: Logging pods the kubelet thinks is on node node2 Aug 18 11:54:11.242: INFO: kube-multus-ds-amd64-rvzsg started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:54:11.242: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:54:11.242: INFO: collectd-67ntq started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:54:11.242: INFO: Container collectd ready: true, restart count 0 Aug 18 11:54:11.242: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:54:11.242: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:54:11.242: INFO: ss-0 started at 2021-08-18 11:46:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:54:11.242: INFO: Container webserver ready: false, restart count 0 Aug 18 11:54:11.242: INFO: termination-message-container84499a62-bd35-4cdc-809d-811cd552608a started at 2021-08-18 11:51:42 +0000 UTC (0+1 container statuses recorded) Aug 18 11:54:11.242: INFO: Container termination-message-container ready: false, restart count 0 Aug 18 11:54:11.242: INFO: bin-falsea5f6898f-c6c3-4680-9cbd-f4985908f73e started at 2021-08-18 11:49:10 +0000 UTC (0+1 container statuses recorded) Aug 18 11:54:11.242: INFO: Container bin-falsea5f6898f-c6c3-4680-9cbd-f4985908f73e ready: false, restart count 0 Aug 18 11:54:11.242: INFO: cmk-webhook-6c9d5f8578-7cxjr started at 2021-08-18 08:32:53 +0000 UTC (0+1 container statuses recorded) Aug 18 11:54:11.242: INFO: Container cmk-webhook ready: true, restart count 0 Aug 18 11:54:11.242: INFO: terminate-cmd-rpad23b99c9-2d62-4758-a55c-1712aba45053 started at 2021-08-18 11:50:30 +0000 UTC (0+1 container statuses recorded) Aug 18 11:54:11.242: INFO: Container terminate-cmd-rpa ready: false, restart count 0 Aug 18 11:54:11.242: INFO: kube-flannel-h7t5h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:54:11.242: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:54:11.242: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:54:11.242: INFO: node-exporter-lrrf2 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:54:11.242: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:54:11.242: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:54:11.242: INFO: foo-mcmfh started at 2021-08-18 11:53:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:54:11.242: INFO: Container c ready: false, restart count 0 Aug 18 11:54:11.242: INFO: nginx-proxy-node2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:54:11.242: INFO: Container nginx-proxy ready: true, restart count 1 Aug 18 11:54:11.242: INFO: cmk-init-discover-node2-6b2kz started at 2021-08-18 08:32:30 +0000 UTC (0+3 container statuses recorded) Aug 18 11:54:11.242: INFO: Container discover ready: false, restart count 0 Aug 18 11:54:11.242: INFO: Container init ready: false, restart count 0 Aug 18 11:54:11.242: INFO: Container install ready: false, restart count 0 Aug 18 11:54:11.242: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-7rn45 started at 2021-08-18 08:36:42 +0000 UTC (0+2 container statuses recorded) Aug 18 11:54:11.242: INFO: Container tas-controller ready: true, restart count 0 Aug 18 11:54:11.242: INFO: Container tas-extender ready: true, restart count 0 Aug 18 11:54:11.242: INFO: pod-update-399ed819-acd4-424c-8e46-fca448681026 started at 2021-08-18 11:53:12 +0000 UTC (0+1 container statuses recorded) Aug 18 11:54:11.242: INFO: Container nginx ready: false, restart count 0 Aug 18 11:54:11.242: INFO: kubernetes-dashboard-86c6f9df5b-qrtdk started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:54:11.242: INFO: Container kubernetes-dashboard ready: true, restart count 2 Aug 18 11:54:11.242: INFO: busybox-3dfd903c-68f3-48ac-a884-dd6ba807fca5 started at 2021-08-18 11:52:58 +0000 UTC (0+1 container statuses recorded) Aug 18 11:54:11.242: INFO: Container busybox ready: false, restart count 0 Aug 18 11:54:11.242: INFO: cmk-748rz started at 2021-08-18 08:32:53 +0000 UTC (0+2 container statuses recorded) Aug 18 11:54:11.242: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:54:11.242: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:54:11.242: INFO: kube-proxy-qkj9c started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:54:11.242: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:54:11.242: INFO: node-feature-discovery-worker-hzpf5 started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:54:11.242: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:54:11.242: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-c82pt started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:54:11.242: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:54:11.242: INFO: prometheus-operator-5bb8cb9d8f-k97ws started at 2021-08-18 08:33:38 +0000 UTC (0+2 container statuses recorded) Aug 18 11:54:11.242: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:54:11.242: INFO: Container prometheus-operator ready: true, restart count 0 W0818 11:54:11.255092 31 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:54:11.284: INFO: Latency metrics for node node2 Aug 18 11:54:11.284: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "kubelet-test-6059" for this suite. • Failure [300.343 seconds] [k8s.io] Kubelet /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 when scheduling a busybox command that always fails in a pod /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/kubelet.go:79 should have an terminated reason [NodeConformance] [Conformance] [It] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:54:10.986: Timed out after 300.000s. Expected <*errors.errorString | 0xc004b208c0>: { s: "expected state to be terminated. Got pod status: {Phase:Pending Conditions:[{Type:Initialized Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2021-08-18 11:49:10 +0000 UTC Reason: Message:} {Type:Ready Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2021-08-18 11:49:10 +0000 UTC Reason:ContainersNotReady Message:containers with unready status: [bin-falsea5f6898f-c6c3-4680-9cbd-f4985908f73e]} {Type:ContainersReady Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2021-08-18 11:49:10 +0000 UTC Reason:ContainersNotReady Message:containers with unready status: [bin-falsea5f6898f-c6c3-4680-9cbd-f4985908f73e]} {Type:PodScheduled Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2021-08-18 11:49:10 +0000 UTC Reason: Message:}] Message: Reason: NominatedNodeName: HostIP:10.10.190.208 PodIP:10.244.3.78 PodIPs:[{IP:10.244.3.78}] StartTime:2021-08-18 11:49:10 +0000 UTC InitContainerStatuses:[] ContainerStatuses:[{Name:bin-falsea5f6898f-c6c3-4680-9cbd-f4985908f73e State:{Waiting:&ContainerStateWaiting{Reason:ImagePullBackOff,Message:Back-off pulling image \"docker.io/library/busybox:1.29\",} Running:nil Terminated:nil} LastTerminationState:{Waiting:nil Running:nil Terminated:nil} Ready:false RestartCount:0 Image:docker.io/library/busybox:1.29 ImageID: ContainerID: Started:0xc004ae6a3b}] QOSClass:BestEffort EphemeralContainerStatuses:[]}", } to be nil /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/kubelet.go:124 ------------------------------ {"msg":"FAILED [k8s.io] Kubelet when scheduling a busybox command that always fails in a pod should have an terminated reason [NodeConformance] [Conformance]","total":-1,"completed":6,"skipped":231,"failed":4,"failures":["[sig-apps] StatefulSet [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] should perform rolling updates and roll backs of template modifications [Conformance]","[k8s.io] Probing container should be restarted with a exec \"cat /tmp/health\" liveness probe [NodeConformance] [Conformance]","[k8s.io] Container Runtime blackbox test on terminated container should report termination message [LinuxOnly] from log output if TerminationMessagePolicy FallbackToLogsOnError is set [NodeConformance] [Conformance]","[k8s.io] Kubelet when scheduling a busybox command that always fails in a pod should have an terminated reason [NodeConformance] [Conformance]"]} SSSSS ------------------------------ [BeforeEach] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:54:11.309: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename crd-publish-openapi STEP: Waiting for a default service account to be provisioned in namespace [It] works for multiple CRDs of same group but different versions [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: CRs in the same group but different versions (one multiversion CRD) show up in OpenAPI documentation Aug 18 11:54:11.331: INFO: >>> kubeConfig: /root/.kube/config STEP: CRs in the same group but different versions (two CRDs) show up in OpenAPI documentation Aug 18 11:54:27.859: INFO: >>> kubeConfig: /root/.kube/config Aug 18 11:54:35.794: INFO: >>> kubeConfig: /root/.kube/config [AfterEach] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:54:52.319: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "crd-publish-openapi-3685" for this suite. • [SLOW TEST:41.019 seconds] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23 works for multiple CRDs of same group but different versions [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] works for multiple CRDs of same group but different versions [Conformance]","total":-1,"completed":7,"skipped":236,"failed":4,"failures":["[sig-apps] StatefulSet [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] should perform rolling updates and roll backs of template modifications [Conformance]","[k8s.io] Probing container should be restarted with a exec \"cat /tmp/health\" liveness probe [NodeConformance] [Conformance]","[k8s.io] Container Runtime blackbox test on terminated container should report termination message [LinuxOnly] from log output if TerminationMessagePolicy FallbackToLogsOnError is set [NodeConformance] [Conformance]","[k8s.io] Kubelet when scheduling a busybox command that always fails in a pod should have an terminated reason [NodeConformance] [Conformance]"]} SSS ------------------------------ [BeforeEach] [sig-storage] Projected secret /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:54:52.338: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename projected STEP: Waiting for a default service account to be provisioned in namespace [It] should be consumable from pods in volume with mappings and Item Mode set [LinuxOnly] [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating projection with secret that has name projected-secret-test-map-aba78663-0592-46b9-9e84-05826083e44a STEP: Creating a pod to test consume secrets Aug 18 11:54:52.379: INFO: Waiting up to 5m0s for pod "pod-projected-secrets-369be05c-dd1a-4a41-b35c-16403efd35a8" in namespace "projected-6865" to be "Succeeded or Failed" Aug 18 11:54:52.383: INFO: Pod "pod-projected-secrets-369be05c-dd1a-4a41-b35c-16403efd35a8": Phase="Pending", Reason="", readiness=false. Elapsed: 4.349135ms Aug 18 11:54:54.386: INFO: Pod "pod-projected-secrets-369be05c-dd1a-4a41-b35c-16403efd35a8": Phase="Pending", Reason="", readiness=false. Elapsed: 2.007211603s Aug 18 11:54:56.389: INFO: Pod "pod-projected-secrets-369be05c-dd1a-4a41-b35c-16403efd35a8": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.010465629s STEP: Saw pod success Aug 18 11:54:56.389: INFO: Pod "pod-projected-secrets-369be05c-dd1a-4a41-b35c-16403efd35a8" satisfied condition "Succeeded or Failed" Aug 18 11:54:56.393: INFO: Trying to get logs from node node1 pod pod-projected-secrets-369be05c-dd1a-4a41-b35c-16403efd35a8 container projected-secret-volume-test: STEP: delete the pod Aug 18 11:54:56.407: INFO: Waiting for pod pod-projected-secrets-369be05c-dd1a-4a41-b35c-16403efd35a8 to disappear Aug 18 11:54:56.409: INFO: Pod pod-projected-secrets-369be05c-dd1a-4a41-b35c-16403efd35a8 no longer exists [AfterEach] [sig-storage] Projected secret /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:54:56.409: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "projected-6865" for this suite. • ------------------------------ {"msg":"PASSED [sig-storage] Projected secret should be consumable from pods in volume with mappings and Item Mode set [LinuxOnly] [NodeConformance] [Conformance]","total":-1,"completed":8,"skipped":239,"failed":4,"failures":["[sig-apps] StatefulSet [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] should perform rolling updates and roll backs of template modifications [Conformance]","[k8s.io] Probing container should be restarted with a exec \"cat /tmp/health\" liveness probe [NodeConformance] [Conformance]","[k8s.io] Container Runtime blackbox test on terminated container should report termination message [LinuxOnly] from log output if TerminationMessagePolicy FallbackToLogsOnError is set [NodeConformance] [Conformance]","[k8s.io] Kubelet when scheduling a busybox command that always fails in a pod should have an terminated reason [NodeConformance] [Conformance]"]} SSSSSSSSS ------------------------------ [BeforeEach] [sig-storage] Downward API volume /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:54:56.439: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename downward-api STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-storage] Downward API volume /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/downwardapi_volume.go:42 [It] should provide container's memory request [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating a pod to test downward API volume plugin Aug 18 11:54:56.475: INFO: Waiting up to 5m0s for pod "downwardapi-volume-333d2ad6-5561-4f78-9857-d6b5438423dc" in namespace "downward-api-2514" to be "Succeeded or Failed" Aug 18 11:54:56.477: INFO: Pod "downwardapi-volume-333d2ad6-5561-4f78-9857-d6b5438423dc": Phase="Pending", Reason="", readiness=false. Elapsed: 2.082388ms Aug 18 11:54:58.481: INFO: Pod "downwardapi-volume-333d2ad6-5561-4f78-9857-d6b5438423dc": Phase="Pending", Reason="", readiness=false. Elapsed: 2.00647618s Aug 18 11:55:00.485: INFO: Pod "downwardapi-volume-333d2ad6-5561-4f78-9857-d6b5438423dc": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.010215578s STEP: Saw pod success Aug 18 11:55:00.485: INFO: Pod "downwardapi-volume-333d2ad6-5561-4f78-9857-d6b5438423dc" satisfied condition "Succeeded or Failed" Aug 18 11:55:00.488: INFO: Trying to get logs from node node1 pod downwardapi-volume-333d2ad6-5561-4f78-9857-d6b5438423dc container client-container: STEP: delete the pod Aug 18 11:55:00.504: INFO: Waiting for pod downwardapi-volume-333d2ad6-5561-4f78-9857-d6b5438423dc to disappear Aug 18 11:55:00.506: INFO: Pod downwardapi-volume-333d2ad6-5561-4f78-9857-d6b5438423dc no longer exists [AfterEach] [sig-storage] Downward API volume /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:55:00.506: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "downward-api-2514" for this suite. • ------------------------------ {"msg":"PASSED [sig-storage] Downward API volume should provide container's memory request [NodeConformance] [Conformance]","total":-1,"completed":9,"skipped":248,"failed":4,"failures":["[sig-apps] StatefulSet [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] should perform rolling updates and roll backs of template modifications [Conformance]","[k8s.io] Probing container should be restarted with a exec \"cat /tmp/health\" liveness probe [NodeConformance] [Conformance]","[k8s.io] Container Runtime blackbox test on terminated container should report termination message [LinuxOnly] from log output if TerminationMessagePolicy FallbackToLogsOnError is set [NodeConformance] [Conformance]","[k8s.io] Kubelet when scheduling a busybox command that always fails in a pod should have an terminated reason [NodeConformance] [Conformance]"]} SSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [k8s.io] Pods /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:55:00.565: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename pods STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [k8s.io] Pods /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/pods.go:181 [It] should delete a collection of pods [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Create set of pods Aug 18 11:55:00.599: INFO: created test-pod-1 Aug 18 11:55:00.609: INFO: created test-pod-2 Aug 18 11:55:00.618: INFO: created test-pod-3 STEP: waiting for all 3 pods to be located STEP: waiting for all pods to be deleted [AfterEach] [k8s.io] Pods /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:55:00.641: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "pods-3626" for this suite. • ------------------------------ {"msg":"PASSED [k8s.io] Pods should delete a collection of pods [Conformance]","total":-1,"completed":10,"skipped":274,"failed":4,"failures":["[sig-apps] StatefulSet [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] should perform rolling updates and roll backs of template modifications [Conformance]","[k8s.io] Probing container should be restarted with a exec \"cat /tmp/health\" liveness probe [NodeConformance] [Conformance]","[k8s.io] Container Runtime blackbox test on terminated container should report termination message [LinuxOnly] from log output if TerminationMessagePolicy FallbackToLogsOnError is set [NodeConformance] [Conformance]","[k8s.io] Kubelet when scheduling a busybox command that always fails in a pod should have an terminated reason [NodeConformance] [Conformance]"]} SSS ------------------------------ [BeforeEach] [k8s.io] Container Runtime /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:50:30.431: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename container-runtime STEP: Waiting for a default service account to be provisioned in namespace [It] should run with the expected status [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Container 'terminate-cmd-rpa': should get the expected 'RestartCount' Aug 18 11:55:30.466: FAIL: Timed out after 300.000s. Expected : 0 to equal : 2 Full Stack Trace k8s.io/kubernetes/test/e2e/common.glob..func25.1.1.1() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/runtime.go:111 +0x8ce k8s.io/kubernetes/test/e2e.RunE2ETests(0xc001880c00) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc001880c00) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc001880c00, 0x4deb2c0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] Container Runtime /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "container-runtime-9320". STEP: Found 9 events. Aug 18 11:55:30.480: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for terminate-cmd-rpad23b99c9-2d62-4758-a55c-1712aba45053: { } Scheduled: Successfully assigned container-runtime-9320/terminate-cmd-rpad23b99c9-2d62-4758-a55c-1712aba45053 to node2 Aug 18 11:55:30.480: INFO: At 2021-08-18 11:50:31 +0000 UTC - event for terminate-cmd-rpad23b99c9-2d62-4758-a55c-1712aba45053: {multus } AddedInterface: Add eth0 [10.244.3.88/24] Aug 18 11:55:30.480: INFO: At 2021-08-18 11:50:31 +0000 UTC - event for terminate-cmd-rpad23b99c9-2d62-4758-a55c-1712aba45053: {kubelet node2} Pulling: Pulling image "docker.io/library/busybox:1.29" Aug 18 11:55:30.480: INFO: At 2021-08-18 11:50:32 +0000 UTC - event for terminate-cmd-rpad23b99c9-2d62-4758-a55c-1712aba45053: {kubelet node2} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit Aug 18 11:55:30.480: INFO: At 2021-08-18 11:50:32 +0000 UTC - event for terminate-cmd-rpad23b99c9-2d62-4758-a55c-1712aba45053: {kubelet node2} Failed: Error: ErrImagePull Aug 18 11:55:30.480: INFO: At 2021-08-18 11:50:33 +0000 UTC - event for terminate-cmd-rpad23b99c9-2d62-4758-a55c-1712aba45053: {kubelet node2} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Aug 18 11:55:30.480: INFO: At 2021-08-18 11:50:35 +0000 UTC - event for terminate-cmd-rpad23b99c9-2d62-4758-a55c-1712aba45053: {multus } AddedInterface: Add eth0 [10.244.3.89/24] Aug 18 11:55:30.480: INFO: At 2021-08-18 11:50:35 +0000 UTC - event for terminate-cmd-rpad23b99c9-2d62-4758-a55c-1712aba45053: {kubelet node2} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" Aug 18 11:55:30.480: INFO: At 2021-08-18 11:50:35 +0000 UTC - event for terminate-cmd-rpad23b99c9-2d62-4758-a55c-1712aba45053: {kubelet node2} Failed: Error: ImagePullBackOff Aug 18 11:55:30.482: INFO: POD NODE PHASE GRACE CONDITIONS Aug 18 11:55:30.482: INFO: Aug 18 11:55:30.487: INFO: Logging node info for node master1 Aug 18 11:55:30.490: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 ebb211fa-503f-4cfe-b1ed-c95d27a70e6e 75200 0 2021-08-18 08:20:52 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"3a:82:be:72:b5:15"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:20:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:20:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:25:59 +0000 UTC,LastTransitionTime:2021-08-18 08:25:59 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:55:28 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:55:28 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:55:28 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:55:28 +0000 UTC,LastTransitionTime:2021-08-18 08:25:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:58c3e57359b641ad92fa1959f2fecf5d,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:012cd796-2076-45d6-8b14-d3e0451b1e64,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[@ :],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:55:30.491: INFO: Logging kubelet events for node master1 Aug 18 11:55:30.494: INFO: Logging pods the kubelet thinks is on node master1 Aug 18 11:55:30.504: INFO: docker-registry-docker-registry-56cbc7bc58-49kl2 started at 2021-08-18 08:26:23 +0000 UTC (0+2 container statuses recorded) Aug 18 11:55:30.504: INFO: Container docker-registry ready: true, restart count 0 Aug 18 11:55:30.504: INFO: Container nginx ready: true, restart count 0 Aug 18 11:55:30.504: INFO: node-exporter-5hwz9 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:55:30.504: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:55:30.504: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:55:30.504: INFO: kube-controller-manager-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:55:30.504: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:55:30.504: INFO: kube-multus-ds-amd64-kbcp6 started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:55:30.504: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:55:30.504: INFO: coredns-7677f9bb54-kn2qg started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:55:30.504: INFO: Container coredns ready: true, restart count 2 Aug 18 11:55:30.504: INFO: kube-scheduler-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:55:30.504: INFO: Container kube-scheduler ready: true, restart count 0 Aug 18 11:55:30.504: INFO: kube-apiserver-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:55:30.504: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:55:30.504: INFO: kube-proxy-vqk4v started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:55:30.504: INFO: Container kube-proxy ready: true, restart count 1 Aug 18 11:55:30.504: INFO: kube-flannel-q64cq started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:55:30.504: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:55:30.504: INFO: Container kube-flannel ready: true, restart count 3 W0818 11:55:30.520904 26 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:55:30.546: INFO: Latency metrics for node master1 Aug 18 11:55:30.546: INFO: Logging node info for node master2 Aug 18 11:55:30.549: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 78946293-3abe-4442-84d4-8ed6b1d15ce0 75193 0 2021-08-18 08:21:31 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"7e:f5:c2:cc:3a:b4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:21:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:21:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-08-18 08:29:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:55:27 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:55:27 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:55:27 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:55:27 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0c44122c7a7248c18d8571e1cc667258,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:0cd329f2-48e0-4c8f-b8b9-fa3ae0ed8406,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:55:30.549: INFO: Logging kubelet events for node master2 Aug 18 11:55:30.552: INFO: Logging pods the kubelet thinks is on node master2 Aug 18 11:55:30.561: INFO: kube-flannel-pp56h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:55:30.561: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:55:30.561: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:55:30.561: INFO: kube-controller-manager-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:55:30.561: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:55:30.561: INFO: kube-proxy-kh2l9 started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:55:30.561: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:55:30.561: INFO: kube-multus-ds-amd64-mld8g started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:55:30.561: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:55:30.561: INFO: dns-autoscaler-5b7b5c9b6f-hh47r started at 2021-08-18 08:23:57 +0000 UTC (0+1 container statuses recorded) Aug 18 11:55:30.561: INFO: Container autoscaler ready: true, restart count 2 Aug 18 11:55:30.561: INFO: node-feature-discovery-controller-5bf5c49849-mq57c started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:55:30.561: INFO: Container nfd-controller ready: true, restart count 0 Aug 18 11:55:30.561: INFO: node-exporter-48nfx started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:55:30.561: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:55:30.561: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:55:30.561: INFO: kube-apiserver-master2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:55:30.561: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:55:30.561: INFO: kube-scheduler-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:55:30.561: INFO: Container kube-scheduler ready: true, restart count 2 W0818 11:55:30.575981 26 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:55:30.603: INFO: Latency metrics for node master2 Aug 18 11:55:30.603: INFO: Logging node info for node master3 Aug 18 11:55:30.606: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 44feac2b-9447-4be2-9fcd-62f836d67c72 75177 0 2021-08-18 08:21:41 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"86:e4:31:99:58:40"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {kubelet Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:55:22 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:55:22 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:55:22 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:55:22 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1fae19ae59884c44899bcd08aa243244,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:5db926c5-6530-4635-a0d5-806974a3b732,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:55:30.606: INFO: Logging kubelet events for node master3 Aug 18 11:55:30.609: INFO: Logging pods the kubelet thinks is on node master3 Aug 18 11:55:30.618: INFO: kube-multus-ds-amd64-bkw6c started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:55:30.618: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:55:30.618: INFO: coredns-7677f9bb54-5hxfh started at 2021-08-18 08:23:54 +0000 UTC (0+1 container statuses recorded) Aug 18 11:55:30.618: INFO: Container coredns ready: true, restart count 1 Aug 18 11:55:30.618: INFO: node-exporter-vq7d8 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:55:30.618: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:55:30.618: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:55:30.618: INFO: kube-controller-manager-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:55:30.618: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:55:30.618: INFO: kube-scheduler-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:55:30.618: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:55:30.618: INFO: kube-apiserver-master3 started at 2021-08-18 08:29:12 +0000 UTC (0+1 container statuses recorded) Aug 18 11:55:30.618: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:55:30.618: INFO: kube-proxy-sd5lc started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:55:30.618: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:55:30.618: INFO: kube-flannel-x6tlr started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:55:30.618: INFO: Init container install-cni ready: true, restart count 1 Aug 18 11:55:30.618: INFO: Container kube-flannel ready: true, restart count 1 W0818 11:55:30.634161 26 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:55:30.659: INFO: Latency metrics for node master3 Aug 18 11:55:30.659: INFO: Logging node info for node node1 Aug 18 11:55:30.661: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 84defabd-6ebf-43ec-a629-44c6713da9c9 75198 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"9a:87:55:36:7b:df"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:13 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:35 +0000 UTC,LastTransitionTime:2021-08-18 08:26:35 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:55:27 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:55:27 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:55:27 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:55:27 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:69946ff2b7bc462fa25eb7adb4703c23,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:736dc52f-f5e3-494e-86ca-01eedbea015c,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:a7cea43d9d2f67c38fbf0407786edbe660ee9072945f7bb272b55fd255e8eaca opnfv/barometer-collectd:stable],SizeBytes:1075746799,},ContainerImage{Names:[@ :],SizeBytes:1003788820,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[aquasec/kube-hunter@sha256:2be6820bc1d7e0f57193a9a27d5a3e16b2fd93c53747b03ce8ca48c6fc323781 aquasec/kube-hunter:0.3.1],SizeBytes:347611549,},ContainerImage{Names:[golang@sha256:db2475a1dbb2149508e5db31d7d77a75e6600d54be645f37681f03f2762169ba golang:alpine3.12],SizeBytes:301186719,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:de25c7fc6c4f3a27c7f0c2dff454e4671823a34d88abd533f210848d527e0fbb alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:55:30.663: INFO: Logging kubelet events for node node1 Aug 18 11:55:30.665: INFO: Logging pods the kubelet thinks is on node node1 Aug 18 11:55:30.679: INFO: kube-flannel-q78nd started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:55:30.679: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:55:30.679: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:55:30.679: INFO: prometheus-k8s-0 started at 2021-08-18 08:34:03 +0000 UTC (0+5 container statuses recorded) Aug 18 11:55:30.679: INFO: Container custom-metrics-apiserver ready: true, restart count 0 Aug 18 11:55:30.679: INFO: Container grafana ready: true, restart count 0 Aug 18 11:55:30.679: INFO: Container prometheus ready: true, restart count 1 Aug 18 11:55:30.679: INFO: Container prometheus-config-reloader ready: true, restart count 0 Aug 18 11:55:30.679: INFO: Container rules-configmap-reloader ready: true, restart count 0 Aug 18 11:55:30.679: INFO: client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419 started at 2021-08-18 11:52:32 +0000 UTC (0+1 container statuses recorded) Aug 18 11:55:30.679: INFO: Container env3cont ready: false, restart count 0 Aug 18 11:55:30.679: INFO: kube-multus-ds-amd64-rrvmb started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:55:30.679: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:55:30.679: INFO: node-feature-discovery-worker-pflgw started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:55:30.679: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:55:30.679: INFO: node-exporter-kcwvn started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:55:30.679: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:55:30.679: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:55:30.679: INFO: pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a started at 2021-08-18 11:52:01 +0000 UTC (0+1 container statuses recorded) Aug 18 11:55:30.679: INFO: Container env-test ready: false, restart count 0 Aug 18 11:55:30.679: INFO: ss-0 started at 2021-08-18 11:47:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:55:30.679: INFO: Container webserver ready: false, restart count 0 Aug 18 11:55:30.679: INFO: foo-xpsfd started at 2021-08-18 11:53:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:55:30.679: INFO: Container c ready: false, restart count 0 Aug 18 11:55:30.679: INFO: server-envvars-dcc91a28-e119-476f-ad7b-86dc853ddeb4 started at 2021-08-18 11:52:28 +0000 UTC (0+1 container statuses recorded) Aug 18 11:55:30.679: INFO: Container srv ready: true, restart count 0 Aug 18 11:55:30.679: INFO: kube-proxy-p6jvp started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:55:30.680: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:55:30.680: INFO: kubernetes-metrics-scraper-678c97765c-9nsv5 started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:55:30.680: INFO: Container kubernetes-metrics-scraper ready: true, restart count 2 Aug 18 11:55:30.680: INFO: cmk-init-discover-node1-bxznx started at 2021-08-18 08:32:10 +0000 UTC (0+3 container statuses recorded) Aug 18 11:55:30.680: INFO: Container discover ready: false, restart count 0 Aug 18 11:55:30.680: INFO: Container init ready: false, restart count 0 Aug 18 11:55:30.680: INFO: Container install ready: false, restart count 0 Aug 18 11:55:30.680: INFO: cmk-d8r27 started at 2021-08-18 08:32:52 +0000 UTC (0+2 container statuses recorded) Aug 18 11:55:30.680: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:55:30.680: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:55:30.680: INFO: collectd-xdprr started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:55:30.680: INFO: Container collectd ready: true, restart count 0 Aug 18 11:55:30.680: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:55:30.680: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:55:30.680: INFO: nginx-proxy-node1 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:55:30.680: INFO: Container nginx-proxy ready: true, restart count 2 Aug 18 11:55:30.680: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-vsxvg started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:55:30.680: INFO: Container kube-sriovdp ready: true, restart count 0 W0818 11:55:30.695112 26 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:55:30.728: INFO: Latency metrics for node node1 Aug 18 11:55:30.728: INFO: Logging node info for node node2 Aug 18 11:55:30.732: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 1d01177e-3dbb-48a1-a0bc-d18af27ab7f8 75171 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:d1:47:f8:1d:22"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:36 +0000 UTC,LastTransitionTime:2021-08-18 08:26:36 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:55:21 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:55:21 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:55:21 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:55:21 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:dc1f286135c145349b8a016880b65a2f,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:037e7e2d-94e9-42f4-a719-896e5005ac70,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:55:30.733: INFO: Logging kubelet events for node node2 Aug 18 11:55:30.735: INFO: Logging pods the kubelet thinks is on node node2 Aug 18 11:55:30.745: INFO: cmk-webhook-6c9d5f8578-7cxjr started at 2021-08-18 08:32:53 +0000 UTC (0+1 container statuses recorded) Aug 18 11:55:30.745: INFO: Container cmk-webhook ready: true, restart count 0 Aug 18 11:55:30.745: INFO: kube-flannel-h7t5h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:55:30.745: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:55:30.745: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:55:30.745: INFO: node-exporter-lrrf2 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:55:30.745: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:55:30.745: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:55:30.745: INFO: foo-mcmfh started at 2021-08-18 11:53:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:55:30.745: INFO: Container c ready: false, restart count 0 Aug 18 11:55:30.745: INFO: nginx-proxy-node2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:55:30.745: INFO: Container nginx-proxy ready: true, restart count 1 Aug 18 11:55:30.745: INFO: cmk-init-discover-node2-6b2kz started at 2021-08-18 08:32:30 +0000 UTC (0+3 container statuses recorded) Aug 18 11:55:30.745: INFO: Container discover ready: false, restart count 0 Aug 18 11:55:30.745: INFO: Container init ready: false, restart count 0 Aug 18 11:55:30.745: INFO: Container install ready: false, restart count 0 Aug 18 11:55:30.745: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-7rn45 started at 2021-08-18 08:36:42 +0000 UTC (0+2 container statuses recorded) Aug 18 11:55:30.745: INFO: Container tas-controller ready: true, restart count 0 Aug 18 11:55:30.745: INFO: Container tas-extender ready: true, restart count 0 Aug 18 11:55:30.745: INFO: pod-update-399ed819-acd4-424c-8e46-fca448681026 started at 2021-08-18 11:53:12 +0000 UTC (0+1 container statuses recorded) Aug 18 11:55:30.745: INFO: Container nginx ready: false, restart count 0 Aug 18 11:55:30.745: INFO: kubernetes-dashboard-86c6f9df5b-qrtdk started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:55:30.745: INFO: Container kubernetes-dashboard ready: true, restart count 2 Aug 18 11:55:30.745: INFO: busybox-3dfd903c-68f3-48ac-a884-dd6ba807fca5 started at 2021-08-18 11:52:58 +0000 UTC (0+1 container statuses recorded) Aug 18 11:55:30.745: INFO: Container busybox ready: false, restart count 0 Aug 18 11:55:30.745: INFO: cmk-748rz started at 2021-08-18 08:32:53 +0000 UTC (0+2 container statuses recorded) Aug 18 11:55:30.745: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:55:30.745: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:55:30.745: INFO: kube-proxy-qkj9c started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:55:30.745: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:55:30.745: INFO: node-feature-discovery-worker-hzpf5 started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:55:30.745: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:55:30.745: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-c82pt started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:55:30.745: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:55:30.745: INFO: prometheus-operator-5bb8cb9d8f-k97ws started at 2021-08-18 08:33:38 +0000 UTC (0+2 container statuses recorded) Aug 18 11:55:30.745: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:55:30.745: INFO: Container prometheus-operator ready: true, restart count 0 Aug 18 11:55:30.745: INFO: kube-multus-ds-amd64-rvzsg started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:55:30.745: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:55:30.745: INFO: collectd-67ntq started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:55:30.745: INFO: Container collectd ready: true, restart count 0 Aug 18 11:55:30.745: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:55:30.745: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:55:30.745: INFO: ss-0 started at 2021-08-18 11:46:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:55:30.745: INFO: Container webserver ready: false, restart count 0 Aug 18 11:55:30.745: INFO: termination-message-container84499a62-bd35-4cdc-809d-811cd552608a started at 2021-08-18 11:51:42 +0000 UTC (0+1 container statuses recorded) Aug 18 11:55:30.745: INFO: Container termination-message-container ready: false, restart count 0 W0818 11:55:30.761933 26 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:55:30.793: INFO: Latency metrics for node node2 Aug 18 11:55:30.793: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "container-runtime-9320" for this suite. • Failure [300.369 seconds] [k8s.io] Container Runtime /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 blackbox test /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/runtime.go:41 when starting a container that exits /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/runtime.go:42 should run with the expected status [NodeConformance] [Conformance] [It] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:55:30.467: Timed out after 300.000s. Expected : 0 to equal : 2 /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/runtime.go:111 ------------------------------ {"msg":"FAILED [k8s.io] Container Runtime blackbox test when starting a container that exits should run with the expected status [NodeConformance] [Conformance]","total":-1,"completed":17,"skipped":247,"failed":5,"failures":["[sig-apps] Deployment deployment should support rollover [Conformance]","[sig-network] Services should be able to switch session affinity for NodePort service [LinuxOnly] [Conformance]","[sig-node] Downward API should provide container's limits.cpu/memory and requests.cpu/memory as env vars [NodeConformance] [Conformance]","[k8s.io] [sig-node] PreStop should call prestop when killing a pod [Conformance]","[k8s.io] Container Runtime blackbox test when starting a container that exits should run with the expected status [NodeConformance] [Conformance]"]} SS ------------------------------ [BeforeEach] [sig-network] DNS /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:55:30.817: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename dns STEP: Waiting for a default service account to be provisioned in namespace [It] should provide DNS for ExternalName services [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating a test externalName service STEP: Running these commands on wheezy: for i in `seq 1 30`; do dig +short dns-test-service-3.dns-7117.svc.cluster.local CNAME > /results/wheezy_udp@dns-test-service-3.dns-7117.svc.cluster.local; sleep 1; done STEP: Running these commands on jessie: for i in `seq 1 30`; do dig +short dns-test-service-3.dns-7117.svc.cluster.local CNAME > /results/jessie_udp@dns-test-service-3.dns-7117.svc.cluster.local; sleep 1; done STEP: creating a pod to probe DNS STEP: submitting the pod to kubernetes STEP: retrieving the pod STEP: looking for the results for each expected name from probers Aug 18 11:55:36.872: INFO: DNS probes using dns-test-ed26f2ac-69c0-461e-92de-ea7c85c68da2 succeeded STEP: deleting the pod STEP: changing the externalName to bar.example.com STEP: Running these commands on wheezy: for i in `seq 1 30`; do dig +short dns-test-service-3.dns-7117.svc.cluster.local CNAME > /results/wheezy_udp@dns-test-service-3.dns-7117.svc.cluster.local; sleep 1; done STEP: Running these commands on jessie: for i in `seq 1 30`; do dig +short dns-test-service-3.dns-7117.svc.cluster.local CNAME > /results/jessie_udp@dns-test-service-3.dns-7117.svc.cluster.local; sleep 1; done STEP: creating a second pod to probe DNS STEP: submitting the pod to kubernetes STEP: retrieving the pod STEP: looking for the results for each expected name from probers Aug 18 11:55:42.908: INFO: DNS probes using dns-test-5ff50877-bcd7-4596-9621-aad0da7d9e97 succeeded STEP: deleting the pod STEP: changing the service to type=ClusterIP STEP: Running these commands on wheezy: for i in `seq 1 30`; do dig +short dns-test-service-3.dns-7117.svc.cluster.local A > /results/wheezy_udp@dns-test-service-3.dns-7117.svc.cluster.local; sleep 1; done STEP: Running these commands on jessie: for i in `seq 1 30`; do dig +short dns-test-service-3.dns-7117.svc.cluster.local A > /results/jessie_udp@dns-test-service-3.dns-7117.svc.cluster.local; sleep 1; done STEP: creating a third pod to probe DNS STEP: submitting the pod to kubernetes STEP: retrieving the pod STEP: looking for the results for each expected name from probers Aug 18 11:55:48.950: INFO: DNS probes using dns-test-37607eba-787c-4175-812f-9e86d6fe69f7 succeeded STEP: deleting the pod STEP: deleting the test externalName service [AfterEach] [sig-network] DNS /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:55:48.965: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "dns-7117" for this suite. • [SLOW TEST:18.155 seconds] [sig-network] DNS /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/framework.go:23 should provide DNS for ExternalName services [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-network] DNS should provide DNS for ExternalName services [Conformance]","total":-1,"completed":18,"skipped":249,"failed":5,"failures":["[sig-apps] Deployment deployment should support rollover [Conformance]","[sig-network] Services should be able to switch session affinity for NodePort service [LinuxOnly] [Conformance]","[sig-node] Downward API should provide container's limits.cpu/memory and requests.cpu/memory as env vars [NodeConformance] [Conformance]","[k8s.io] [sig-node] PreStop should call prestop when killing a pod [Conformance]","[k8s.io] Container Runtime blackbox test when starting a container that exits should run with the expected status [NodeConformance] [Conformance]"]} SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-api-machinery] Garbage collector /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:55:00.658: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename gc STEP: Waiting for a default service account to be provisioned in namespace [It] should delete pods created by rc when not orphaning [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: create the rc STEP: delete the rc STEP: wait for all pods to be garbage collected STEP: Gathering metrics W0818 11:55:10.704742 31 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:56:12.721: INFO: MetricsGrabber failed grab metrics. Skipping metrics gathering. [AfterEach] [sig-api-machinery] Garbage collector /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:56:12.721: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "gc-4964" for this suite. • [SLOW TEST:72.074 seconds] [sig-api-machinery] Garbage collector /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23 should delete pods created by rc when not orphaning [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-api-machinery] Garbage collector should delete pods created by rc when not orphaning [Conformance]","total":-1,"completed":11,"skipped":277,"failed":4,"failures":["[sig-apps] StatefulSet [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] should perform rolling updates and roll backs of template modifications [Conformance]","[k8s.io] Probing container should be restarted with a exec \"cat /tmp/health\" liveness probe [NodeConformance] [Conformance]","[k8s.io] Container Runtime blackbox test on terminated container should report termination message [LinuxOnly] from log output if TerminationMessagePolicy FallbackToLogsOnError is set [NodeConformance] [Conformance]","[k8s.io] Kubelet when scheduling a busybox command that always fails in a pod should have an terminated reason [NodeConformance] [Conformance]"]} SSSSSSSSSSS ------------------------------ [BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:56:12.755: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename webhook STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:87 STEP: Setting up server cert STEP: Create role binding to let webhook read extension-apiserver-authentication STEP: Deploying the webhook pod STEP: Wait for the deployment to be ready Aug 18 11:56:13.026: INFO: new replicaset for deployment "sample-webhook-deployment" is yet to be created Aug 18 11:56:15.037: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764884573, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764884573, loc:(*time.Location)(0x77169a0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764884573, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764884573, loc:(*time.Location)(0x77169a0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-cbccbf6bb\" is progressing."}}, CollisionCount:(*int32)(nil)} Aug 18 11:56:17.040: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764884573, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764884573, loc:(*time.Location)(0x77169a0)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63764884573, loc:(*time.Location)(0x77169a0)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63764884573, loc:(*time.Location)(0x77169a0)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-cbccbf6bb\" is progressing."}}, CollisionCount:(*int32)(nil)} STEP: Deploying the webhook service STEP: Verifying the service has paired with the endpoint Aug 18 11:56:20.047: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1 [It] should mutate configmap [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Registering the mutating configmap webhook via the AdmissionRegistration API STEP: create a configmap that should be updated by the webhook [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:56:20.079: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "webhook-4543" for this suite. STEP: Destroying namespace "webhook-4543-markers" for this suite. [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:102 • [SLOW TEST:7.360 seconds] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23 should mutate configmap [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should mutate configmap [Conformance]","total":-1,"completed":12,"skipped":288,"failed":4,"failures":["[sig-apps] StatefulSet [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] should perform rolling updates and roll backs of template modifications [Conformance]","[k8s.io] Probing container should be restarted with a exec \"cat /tmp/health\" liveness probe [NodeConformance] [Conformance]","[k8s.io] Container Runtime blackbox test on terminated container should report termination message [LinuxOnly] from log output if TerminationMessagePolicy FallbackToLogsOnError is set [NodeConformance] [Conformance]","[k8s.io] Kubelet when scheduling a busybox command that always fails in a pod should have an terminated reason [NodeConformance] [Conformance]"]} SSSSSSSSSSSSSS ------------------------------ [BeforeEach] [k8s.io] Container Runtime /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:51:42.414: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename container-runtime STEP: Waiting for a default service account to be provisioned in namespace [It] should report termination message [LinuxOnly] from file when pod succeeds and TerminationMessagePolicy FallbackToLogsOnError is set [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: create the container STEP: wait for the container to reach Succeeded Aug 18 11:56:42.446: FAIL: Timed out after 300.000s. Expected : Pending to equal : Succeeded Full Stack Trace k8s.io/kubernetes/test/e2e/common.glob..func25.1.2.1(0x4c650ad, 0x1d, 0xc000564960, 0x1e, 0xc00428fd00, 0x2, 0x2, 0xc002342f80, 0x1, 0x1, ...) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/runtime.go:154 +0x3f1 k8s.io/kubernetes/test/e2e/common.glob..func25.1.2.6() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/runtime.go:262 +0x1d2 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc003602780) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc003602780) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc003602780, 0x4deb2c0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] Container Runtime /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "container-runtime-3922". STEP: Found 9 events. Aug 18 11:56:42.460: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for termination-message-container84499a62-bd35-4cdc-809d-811cd552608a: { } Scheduled: Successfully assigned container-runtime-3922/termination-message-container84499a62-bd35-4cdc-809d-811cd552608a to node2 Aug 18 11:56:42.460: INFO: At 2021-08-18 11:51:44 +0000 UTC - event for termination-message-container84499a62-bd35-4cdc-809d-811cd552608a: {multus } AddedInterface: Add eth0 [10.244.3.94/24] Aug 18 11:56:42.461: INFO: At 2021-08-18 11:51:44 +0000 UTC - event for termination-message-container84499a62-bd35-4cdc-809d-811cd552608a: {kubelet node2} Pulling: Pulling image "docker.io/library/busybox:1.29" Aug 18 11:56:42.461: INFO: At 2021-08-18 11:51:45 +0000 UTC - event for termination-message-container84499a62-bd35-4cdc-809d-811cd552608a: {kubelet node2} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit Aug 18 11:56:42.461: INFO: At 2021-08-18 11:51:45 +0000 UTC - event for termination-message-container84499a62-bd35-4cdc-809d-811cd552608a: {kubelet node2} Failed: Error: ErrImagePull Aug 18 11:56:42.461: INFO: At 2021-08-18 11:51:45 +0000 UTC - event for termination-message-container84499a62-bd35-4cdc-809d-811cd552608a: {kubelet node2} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Aug 18 11:56:42.461: INFO: At 2021-08-18 11:51:47 +0000 UTC - event for termination-message-container84499a62-bd35-4cdc-809d-811cd552608a: {multus } AddedInterface: Add eth0 [10.244.3.95/24] Aug 18 11:56:42.461: INFO: At 2021-08-18 11:51:47 +0000 UTC - event for termination-message-container84499a62-bd35-4cdc-809d-811cd552608a: {kubelet node2} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" Aug 18 11:56:42.461: INFO: At 2021-08-18 11:51:47 +0000 UTC - event for termination-message-container84499a62-bd35-4cdc-809d-811cd552608a: {kubelet node2} Failed: Error: ImagePullBackOff Aug 18 11:56:42.463: INFO: POD NODE PHASE GRACE CONDITIONS Aug 18 11:56:42.463: INFO: Aug 18 11:56:42.467: INFO: Logging node info for node master1 Aug 18 11:56:42.470: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 ebb211fa-503f-4cfe-b1ed-c95d27a70e6e 75801 0 2021-08-18 08:20:52 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"3a:82:be:72:b5:15"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:20:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:20:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:25:59 +0000 UTC,LastTransitionTime:2021-08-18 08:25:59 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:56:39 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:56:39 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:56:39 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:56:39 +0000 UTC,LastTransitionTime:2021-08-18 08:25:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:58c3e57359b641ad92fa1959f2fecf5d,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:012cd796-2076-45d6-8b14-d3e0451b1e64,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[@ :],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:56:42.470: INFO: Logging kubelet events for node master1 Aug 18 11:56:42.473: INFO: Logging pods the kubelet thinks is on node master1 Aug 18 11:56:42.482: INFO: kube-scheduler-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:42.482: INFO: Container kube-scheduler ready: true, restart count 0 Aug 18 11:56:42.482: INFO: kube-apiserver-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:42.482: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:56:42.482: INFO: kube-proxy-vqk4v started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:42.482: INFO: Container kube-proxy ready: true, restart count 1 Aug 18 11:56:42.482: INFO: kube-flannel-q64cq started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:56:42.482: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:56:42.482: INFO: Container kube-flannel ready: true, restart count 3 Aug 18 11:56:42.482: INFO: coredns-7677f9bb54-kn2qg started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:42.482: INFO: Container coredns ready: true, restart count 2 Aug 18 11:56:42.482: INFO: node-exporter-5hwz9 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:56:42.482: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:56:42.482: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:56:42.482: INFO: kube-controller-manager-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:42.482: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:56:42.482: INFO: kube-multus-ds-amd64-kbcp6 started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:42.482: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:56:42.482: INFO: docker-registry-docker-registry-56cbc7bc58-49kl2 started at 2021-08-18 08:26:23 +0000 UTC (0+2 container statuses recorded) Aug 18 11:56:42.482: INFO: Container docker-registry ready: true, restart count 0 Aug 18 11:56:42.482: INFO: Container nginx ready: true, restart count 0 W0818 11:56:42.495811 30 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:56:42.522: INFO: Latency metrics for node master1 Aug 18 11:56:42.522: INFO: Logging node info for node master2 Aug 18 11:56:42.524: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 78946293-3abe-4442-84d4-8ed6b1d15ce0 75793 0 2021-08-18 08:21:31 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"7e:f5:c2:cc:3a:b4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:21:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:21:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-08-18 08:29:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:56:37 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:56:37 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:56:37 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:56:37 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0c44122c7a7248c18d8571e1cc667258,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:0cd329f2-48e0-4c8f-b8b9-fa3ae0ed8406,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:56:42.525: INFO: Logging kubelet events for node master2 Aug 18 11:56:42.527: INFO: Logging pods the kubelet thinks is on node master2 Aug 18 11:56:42.537: INFO: kube-controller-manager-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:42.537: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:56:42.537: INFO: kube-proxy-kh2l9 started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:42.537: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:56:42.537: INFO: kube-flannel-pp56h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:56:42.537: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:56:42.537: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:56:42.537: INFO: kube-apiserver-master2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:42.537: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:56:42.537: INFO: kube-scheduler-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:42.537: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:56:42.537: INFO: kube-multus-ds-amd64-mld8g started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:42.537: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:56:42.537: INFO: dns-autoscaler-5b7b5c9b6f-hh47r started at 2021-08-18 08:23:57 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:42.537: INFO: Container autoscaler ready: true, restart count 2 Aug 18 11:56:42.537: INFO: node-feature-discovery-controller-5bf5c49849-mq57c started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:42.537: INFO: Container nfd-controller ready: true, restart count 0 Aug 18 11:56:42.537: INFO: node-exporter-48nfx started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:56:42.537: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:56:42.537: INFO: Container node-exporter ready: true, restart count 0 W0818 11:56:42.550811 30 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:56:42.576: INFO: Latency metrics for node master2 Aug 18 11:56:42.576: INFO: Logging node info for node master3 Aug 18 11:56:42.579: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 44feac2b-9447-4be2-9fcd-62f836d67c72 75768 0 2021-08-18 08:21:41 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"86:e4:31:99:58:40"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {kubelet Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:56:33 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:56:33 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:56:33 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:56:33 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1fae19ae59884c44899bcd08aa243244,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:5db926c5-6530-4635-a0d5-806974a3b732,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:56:42.579: INFO: Logging kubelet events for node master3 Aug 18 11:56:42.581: INFO: Logging pods the kubelet thinks is on node master3 Aug 18 11:56:42.592: INFO: kube-scheduler-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:42.592: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:56:42.592: INFO: kube-apiserver-master3 started at 2021-08-18 08:29:12 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:42.592: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:56:42.592: INFO: kube-proxy-sd5lc started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:42.592: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:56:42.592: INFO: kube-flannel-x6tlr started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:56:42.592: INFO: Init container install-cni ready: true, restart count 1 Aug 18 11:56:42.592: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:56:42.592: INFO: kube-multus-ds-amd64-bkw6c started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:42.592: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:56:42.592: INFO: coredns-7677f9bb54-5hxfh started at 2021-08-18 08:23:54 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:42.592: INFO: Container coredns ready: true, restart count 1 Aug 18 11:56:42.592: INFO: node-exporter-vq7d8 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:56:42.592: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:56:42.592: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:56:42.592: INFO: kube-controller-manager-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:42.592: INFO: Container kube-controller-manager ready: true, restart count 2 W0818 11:56:42.606703 30 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:56:42.630: INFO: Latency metrics for node master3 Aug 18 11:56:42.630: INFO: Logging node info for node node1 Aug 18 11:56:42.633: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 84defabd-6ebf-43ec-a629-44c6713da9c9 75798 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"9a:87:55:36:7b:df"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:13 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:35 +0000 UTC,LastTransitionTime:2021-08-18 08:26:35 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:56:38 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:56:38 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:56:38 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:56:38 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:69946ff2b7bc462fa25eb7adb4703c23,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:736dc52f-f5e3-494e-86ca-01eedbea015c,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:a7cea43d9d2f67c38fbf0407786edbe660ee9072945f7bb272b55fd255e8eaca opnfv/barometer-collectd:stable],SizeBytes:1075746799,},ContainerImage{Names:[@ :],SizeBytes:1003788820,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[aquasec/kube-hunter@sha256:2be6820bc1d7e0f57193a9a27d5a3e16b2fd93c53747b03ce8ca48c6fc323781 aquasec/kube-hunter:0.3.1],SizeBytes:347611549,},ContainerImage{Names:[golang@sha256:db2475a1dbb2149508e5db31d7d77a75e6600d54be645f37681f03f2762169ba golang:alpine3.12],SizeBytes:301186719,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:de25c7fc6c4f3a27c7f0c2dff454e4671823a34d88abd533f210848d527e0fbb alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:56:42.634: INFO: Logging kubelet events for node node1 Aug 18 11:56:42.636: INFO: Logging pods the kubelet thinks is on node node1 Aug 18 11:56:42.653: INFO: pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a started at 2021-08-18 11:52:01 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:42.653: INFO: Container env-test ready: false, restart count 0 Aug 18 11:56:42.653: INFO: ss-0 started at 2021-08-18 11:47:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:42.653: INFO: Container webserver ready: false, restart count 0 Aug 18 11:56:42.653: INFO: foo-xpsfd started at 2021-08-18 11:53:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:42.653: INFO: Container c ready: false, restart count 0 Aug 18 11:56:42.653: INFO: server-envvars-dcc91a28-e119-476f-ad7b-86dc853ddeb4 started at 2021-08-18 11:52:28 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:42.653: INFO: Container srv ready: true, restart count 0 Aug 18 11:56:42.653: INFO: externalname-service-mlvh7 started at 2021-08-18 11:56:20 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:42.653: INFO: Container externalname-service ready: true, restart count 0 Aug 18 11:56:42.653: INFO: kube-multus-ds-amd64-rrvmb started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:42.653: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:56:42.653: INFO: node-feature-discovery-worker-pflgw started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:42.653: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:56:42.653: INFO: node-exporter-kcwvn started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:56:42.653: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:56:42.653: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:56:42.653: INFO: cmk-d8r27 started at 2021-08-18 08:32:52 +0000 UTC (0+2 container statuses recorded) Aug 18 11:56:42.653: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:56:42.653: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:56:42.653: INFO: collectd-xdprr started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:56:42.653: INFO: Container collectd ready: true, restart count 0 Aug 18 11:56:42.653: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:56:42.653: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:56:42.653: INFO: kube-proxy-p6jvp started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:42.653: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:56:42.653: INFO: kubernetes-metrics-scraper-678c97765c-9nsv5 started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:42.653: INFO: Container kubernetes-metrics-scraper ready: true, restart count 2 Aug 18 11:56:42.653: INFO: cmk-init-discover-node1-bxznx started at 2021-08-18 08:32:10 +0000 UTC (0+3 container statuses recorded) Aug 18 11:56:42.653: INFO: Container discover ready: false, restart count 0 Aug 18 11:56:42.653: INFO: Container init ready: false, restart count 0 Aug 18 11:56:42.653: INFO: Container install ready: false, restart count 0 Aug 18 11:56:42.653: INFO: nginx-proxy-node1 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:42.653: INFO: Container nginx-proxy ready: true, restart count 2 Aug 18 11:56:42.653: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-vsxvg started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:42.653: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:56:42.653: INFO: downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c started at 2021-08-18 11:55:49 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:42.653: INFO: Container dapi-container ready: false, restart count 0 Aug 18 11:56:42.653: INFO: client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419 started at 2021-08-18 11:52:32 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:42.653: INFO: Container env3cont ready: false, restart count 0 Aug 18 11:56:42.653: INFO: kube-flannel-q78nd started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:56:42.653: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:56:42.653: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:56:42.653: INFO: prometheus-k8s-0 started at 2021-08-18 08:34:03 +0000 UTC (0+5 container statuses recorded) Aug 18 11:56:42.653: INFO: Container custom-metrics-apiserver ready: true, restart count 0 Aug 18 11:56:42.653: INFO: Container grafana ready: true, restart count 0 Aug 18 11:56:42.653: INFO: Container prometheus ready: true, restart count 1 Aug 18 11:56:42.653: INFO: Container prometheus-config-reloader ready: true, restart count 0 Aug 18 11:56:42.653: INFO: Container rules-configmap-reloader ready: true, restart count 0 W0818 11:56:42.667724 30 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:56:42.701: INFO: Latency metrics for node node1 Aug 18 11:56:42.701: INFO: Logging node info for node node2 Aug 18 11:56:42.704: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 1d01177e-3dbb-48a1-a0bc-d18af27ab7f8 75813 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:d1:47:f8:1d:22"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:36 +0000 UTC,LastTransitionTime:2021-08-18 08:26:36 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:56:41 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:56:41 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:56:41 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:56:41 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:dc1f286135c145349b8a016880b65a2f,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:037e7e2d-94e9-42f4-a719-896e5005ac70,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:56:42.705: INFO: Logging kubelet events for node node2 Aug 18 11:56:42.708: INFO: Logging pods the kubelet thinks is on node node2 Aug 18 11:56:42.774: INFO: kube-multus-ds-amd64-rvzsg started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:42.774: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:56:42.774: INFO: collectd-67ntq started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:56:42.774: INFO: Container collectd ready: true, restart count 0 Aug 18 11:56:42.774: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:56:42.774: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:56:42.774: INFO: cmk-webhook-6c9d5f8578-7cxjr started at 2021-08-18 08:32:53 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:42.774: INFO: Container cmk-webhook ready: true, restart count 0 Aug 18 11:56:42.774: INFO: kube-flannel-h7t5h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:56:42.774: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:56:42.774: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:56:42.774: INFO: node-exporter-lrrf2 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:56:42.774: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:56:42.774: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:56:42.774: INFO: foo-mcmfh started at 2021-08-18 11:53:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:42.774: INFO: Container c ready: false, restart count 0 Aug 18 11:56:42.774: INFO: nginx-proxy-node2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:42.774: INFO: Container nginx-proxy ready: true, restart count 1 Aug 18 11:56:42.774: INFO: cmk-init-discover-node2-6b2kz started at 2021-08-18 08:32:30 +0000 UTC (0+3 container statuses recorded) Aug 18 11:56:42.774: INFO: Container discover ready: false, restart count 0 Aug 18 11:56:42.774: INFO: Container init ready: false, restart count 0 Aug 18 11:56:42.774: INFO: Container install ready: false, restart count 0 Aug 18 11:56:42.774: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-7rn45 started at 2021-08-18 08:36:42 +0000 UTC (0+2 container statuses recorded) Aug 18 11:56:42.774: INFO: Container tas-controller ready: true, restart count 0 Aug 18 11:56:42.774: INFO: Container tas-extender ready: true, restart count 0 Aug 18 11:56:42.774: INFO: pod-update-399ed819-acd4-424c-8e46-fca448681026 started at 2021-08-18 11:53:12 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:42.774: INFO: Container nginx ready: false, restart count 0 Aug 18 11:56:42.774: INFO: kubernetes-dashboard-86c6f9df5b-qrtdk started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:42.774: INFO: Container kubernetes-dashboard ready: true, restart count 2 Aug 18 11:56:42.774: INFO: busybox-3dfd903c-68f3-48ac-a884-dd6ba807fca5 started at 2021-08-18 11:52:58 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:42.774: INFO: Container busybox ready: false, restart count 0 Aug 18 11:56:42.774: INFO: cmk-748rz started at 2021-08-18 08:32:53 +0000 UTC (0+2 container statuses recorded) Aug 18 11:56:42.774: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:56:42.774: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:56:42.774: INFO: externalname-service-9x22f started at 2021-08-18 11:56:20 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:42.774: INFO: Container externalname-service ready: true, restart count 0 Aug 18 11:56:42.774: INFO: execpodxr7sj started at 2021-08-18 11:56:26 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:42.774: INFO: Container agnhost-container ready: true, restart count 0 Aug 18 11:56:42.774: INFO: kube-proxy-qkj9c started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:42.774: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:56:42.774: INFO: node-feature-discovery-worker-hzpf5 started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:42.774: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:56:42.774: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-c82pt started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:42.774: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:56:42.774: INFO: prometheus-operator-5bb8cb9d8f-k97ws started at 2021-08-18 08:33:38 +0000 UTC (0+2 container statuses recorded) Aug 18 11:56:42.774: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:56:42.774: INFO: Container prometheus-operator ready: true, restart count 0 W0818 11:56:42.788509 30 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:56:42.821: INFO: Latency metrics for node node2 Aug 18 11:56:42.821: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "container-runtime-3922" for this suite. • Failure [300.415 seconds] [k8s.io] Container Runtime /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 blackbox test /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/runtime.go:41 on terminated container /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/runtime.go:134 should report termination message [LinuxOnly] from file when pod succeeds and TerminationMessagePolicy FallbackToLogsOnError is set [NodeConformance] [Conformance] [It] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:56:42.446: Timed out after 300.000s. Expected : Pending to equal : Succeeded /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/runtime.go:154 ------------------------------ {"msg":"FAILED [k8s.io] Container Runtime blackbox test on terminated container should report termination message [LinuxOnly] from file when pod succeeds and TerminationMessagePolicy FallbackToLogsOnError is set [NodeConformance] [Conformance]","total":-1,"completed":33,"skipped":640,"failed":5,"failures":["[sig-apps] Deployment RollingUpdateDeployment should delete old pods and create new ones [Conformance]","[sig-storage] ConfigMap binary data should be reflected in volume [NodeConformance] [Conformance]","[k8s.io] Kubelet when scheduling a busybox command in a pod should print the output to logs [NodeConformance] [Conformance]","[k8s.io] Pods should support remote command execution over websockets [NodeConformance] [Conformance]","[k8s.io] Container Runtime blackbox test on terminated container should report termination message [LinuxOnly] from file when pod succeeds and TerminationMessagePolicy FallbackToLogsOnError is set [NodeConformance] [Conformance]"]} SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-node] ConfigMap /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:56:42.928: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename configmap STEP: Waiting for a default service account to be provisioned in namespace [It] should fail to create ConfigMap with empty key [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating configMap that has name configmap-test-emptyKey-2e89271e-ca06-4691-816e-482d94109400 [AfterEach] [sig-node] ConfigMap /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:56:42.948: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "configmap-9092" for this suite. • ------------------------------ {"msg":"PASSED [sig-node] ConfigMap should fail to create ConfigMap with empty key [Conformance]","total":-1,"completed":34,"skipped":691,"failed":5,"failures":["[sig-apps] Deployment RollingUpdateDeployment should delete old pods and create new ones [Conformance]","[sig-storage] ConfigMap binary data should be reflected in volume [NodeConformance] [Conformance]","[k8s.io] Kubelet when scheduling a busybox command in a pod should print the output to logs [NodeConformance] [Conformance]","[k8s.io] Pods should support remote command execution over websockets [NodeConformance] [Conformance]","[k8s.io] Container Runtime blackbox test on terminated container should report termination message [LinuxOnly] from file when pod succeeds and TerminationMessagePolicy FallbackToLogsOnError is set [NodeConformance] [Conformance]"]} SSSS ------------------------------ [BeforeEach] [sig-apps] StatefulSet /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:46:34.589: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename statefulset STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-apps] StatefulSet /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/statefulset.go:88 [BeforeEach] [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/statefulset.go:103 STEP: Creating service test in namespace statefulset-4478 [It] should have a working scale subresource [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating statefulset ss in namespace statefulset-4478 Aug 18 11:46:34.619: INFO: Found 0 stateful pods, waiting for 1 Aug 18 11:46:44.626: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:46:54.624: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:47:04.624: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:47:14.624: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:47:24.623: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:47:34.625: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:47:44.623: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:47:54.623: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:48:04.623: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:48:14.622: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:48:24.623: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:48:34.624: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:48:44.623: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:48:54.624: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:49:04.623: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:49:14.622: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:49:24.622: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:49:34.624: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:49:44.623: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:49:54.623: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:50:04.622: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:50:14.623: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:50:24.623: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:50:34.623: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:50:44.623: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:50:54.623: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:51:04.623: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:51:14.623: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:51:24.623: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:51:34.622: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:51:44.624: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:51:54.623: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:52:04.623: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:52:14.624: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:52:24.623: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:52:34.624: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:52:44.623: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:52:54.623: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:53:04.624: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:53:14.624: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:53:24.622: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:53:34.623: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:53:44.623: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:53:54.624: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:54:04.624: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:54:14.624: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:54:24.623: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:54:34.622: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:54:44.623: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:54:54.622: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:55:04.624: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:55:14.624: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:55:24.622: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:55:34.622: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:55:44.624: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:55:54.624: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:56:04.623: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:56:14.623: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:56:24.623: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:56:34.623: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:56:34.625: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:56:34.625: FAIL: Failed waiting for pods to enter running: timed out waiting for the condition Full Stack Trace k8s.io/kubernetes/test/e2e/framework/statefulset.WaitForRunning(0x5410260, 0xc00919cdc0, 0x100000001, 0xc000550a00) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/statefulset/wait.go:58 +0x10e k8s.io/kubernetes/test/e2e/framework/statefulset.WaitForRunningAndReady(...) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/statefulset/wait.go:80 k8s.io/kubernetes/test/e2e/apps.glob..func10.2.13() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/statefulset.go:845 +0x2e9 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc00393c780) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc00393c780) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc00393c780, 0x4deb2c0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/statefulset.go:114 Aug 18 11:56:34.630: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=statefulset-4478 describe po ss-0' Aug 18 11:56:34.794: INFO: stderr: "" Aug 18 11:56:34.794: INFO: stdout: "Name: ss-0\nNamespace: statefulset-4478\nPriority: 0\nNode: node2/10.10.190.208\nStart Time: Wed, 18 Aug 2021 11:46:34 +0000\nLabels: baz=blah\n controller-revision-hash=ss-65c7964b94\n foo=bar\n statefulset.kubernetes.io/pod-name=ss-0\nAnnotations: k8s.v1.cni.cncf.io/network-status:\n [{\n \"name\": \"default-cni-network\",\n \"interface\": \"eth0\",\n \"ips\": [\n \"10.244.3.65\"\n ],\n \"mac\": \"b2:dd:9e:33:13:26\",\n \"default\": true,\n \"dns\": {}\n }]\n k8s.v1.cni.cncf.io/networks-status:\n [{\n \"name\": \"default-cni-network\",\n \"interface\": \"eth0\",\n \"ips\": [\n \"10.244.3.65\"\n ],\n \"mac\": \"b2:dd:9e:33:13:26\",\n \"default\": true,\n \"dns\": {}\n }]\n kubernetes.io/psp: collectd\nStatus: Pending\nIP: 10.244.3.65\nIPs:\n IP: 10.244.3.65\nControlled By: StatefulSet/ss\nContainers:\n webserver:\n Container ID: \n Image: docker.io/library/httpd:2.4.38-alpine\n Image ID: \n Port: \n Host Port: \n State: Waiting\n Reason: ImagePullBackOff\n Ready: False\n Restart Count: 0\n Readiness: http-get http://:80/index.html delay=0s timeout=1s period=1s #success=1 #failure=1\n Environment: \n Mounts:\n /var/run/secrets/kubernetes.io/serviceaccount from default-token-n5bjh (ro)\nConditions:\n Type Status\n Initialized True \n Ready False \n ContainersReady False \n PodScheduled True \nVolumes:\n default-token-n5bjh:\n Type: Secret (a volume populated by a Secret)\n SecretName: default-token-n5bjh\n Optional: false\nQoS Class: BestEffort\nNode-Selectors: \nTolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s\n node.kubernetes.io/unreachable:NoExecute op=Exists for 300s\nEvents:\n Type Reason Age From Message\n ---- ------ ---- ---- -------\n Normal Scheduled 10m default-scheduler Successfully assigned statefulset-4478/ss-0 to node2\n Normal AddedInterface 9m58s multus Add eth0 [10.244.3.65/24]\n Normal Pulling 8m34s (x4 over 9m58s) kubelet Pulling image \"docker.io/library/httpd:2.4.38-alpine\"\n Warning Failed 8m32s (x4 over 9m57s) kubelet Failed to pull image \"docker.io/library/httpd:2.4.38-alpine\": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit\n Warning Failed 8m32s (x4 over 9m57s) kubelet Error: ErrImagePull\n Normal BackOff 8m3s (x6 over 9m56s) kubelet Back-off pulling image \"docker.io/library/httpd:2.4.38-alpine\"\n Warning Failed 4m50s (x20 over 9m56s) kubelet Error: ImagePullBackOff\n" Aug 18 11:56:34.795: INFO: Output of kubectl describe ss-0: Name: ss-0 Namespace: statefulset-4478 Priority: 0 Node: node2/10.10.190.208 Start Time: Wed, 18 Aug 2021 11:46:34 +0000 Labels: baz=blah controller-revision-hash=ss-65c7964b94 foo=bar statefulset.kubernetes.io/pod-name=ss-0 Annotations: k8s.v1.cni.cncf.io/network-status: [{ "name": "default-cni-network", "interface": "eth0", "ips": [ "10.244.3.65" ], "mac": "b2:dd:9e:33:13:26", "default": true, "dns": {} }] k8s.v1.cni.cncf.io/networks-status: [{ "name": "default-cni-network", "interface": "eth0", "ips": [ "10.244.3.65" ], "mac": "b2:dd:9e:33:13:26", "default": true, "dns": {} }] kubernetes.io/psp: collectd Status: Pending IP: 10.244.3.65 IPs: IP: 10.244.3.65 Controlled By: StatefulSet/ss Containers: webserver: Container ID: Image: docker.io/library/httpd:2.4.38-alpine Image ID: Port: Host Port: State: Waiting Reason: ImagePullBackOff Ready: False Restart Count: 0 Readiness: http-get http://:80/index.html delay=0s timeout=1s period=1s #success=1 #failure=1 Environment: Mounts: /var/run/secrets/kubernetes.io/serviceaccount from default-token-n5bjh (ro) Conditions: Type Status Initialized True Ready False ContainersReady False PodScheduled True Volumes: default-token-n5bjh: Type: Secret (a volume populated by a Secret) SecretName: default-token-n5bjh Optional: false QoS Class: BestEffort Node-Selectors: Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s node.kubernetes.io/unreachable:NoExecute op=Exists for 300s Events: Type Reason Age From Message ---- ------ ---- ---- ------- Normal Scheduled 10m default-scheduler Successfully assigned statefulset-4478/ss-0 to node2 Normal AddedInterface 9m58s multus Add eth0 [10.244.3.65/24] Normal Pulling 8m34s (x4 over 9m58s) kubelet Pulling image "docker.io/library/httpd:2.4.38-alpine" Warning Failed 8m32s (x4 over 9m57s) kubelet Failed to pull image "docker.io/library/httpd:2.4.38-alpine": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit Warning Failed 8m32s (x4 over 9m57s) kubelet Error: ErrImagePull Normal BackOff 8m3s (x6 over 9m56s) kubelet Back-off pulling image "docker.io/library/httpd:2.4.38-alpine" Warning Failed 4m50s (x20 over 9m56s) kubelet Error: ImagePullBackOff Aug 18 11:56:34.795: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=statefulset-4478 logs ss-0 --tail=100' Aug 18 11:56:34.965: INFO: rc: 1 Aug 18 11:56:34.965: INFO: Last 100 log lines of ss-0: Aug 18 11:56:34.965: INFO: Deleting all statefulset in ns statefulset-4478 Aug 18 11:56:34.968: INFO: Scaling statefulset ss to 0 Aug 18 11:56:44.983: INFO: Waiting for statefulset status.replicas updated to 0 Aug 18 11:56:44.985: INFO: Deleting statefulset ss [AfterEach] [sig-apps] StatefulSet /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "statefulset-4478". STEP: Found 9 events. Aug 18 11:56:45.000: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for ss-0: { } Scheduled: Successfully assigned statefulset-4478/ss-0 to node2 Aug 18 11:56:45.000: INFO: At 2021-08-18 11:46:34 +0000 UTC - event for ss: {statefulset-controller } SuccessfulCreate: create Pod ss-0 in StatefulSet ss successful Aug 18 11:56:45.000: INFO: At 2021-08-18 11:46:36 +0000 UTC - event for ss-0: {kubelet node2} Pulling: Pulling image "docker.io/library/httpd:2.4.38-alpine" Aug 18 11:56:45.000: INFO: At 2021-08-18 11:46:36 +0000 UTC - event for ss-0: {multus } AddedInterface: Add eth0 [10.244.3.65/24] Aug 18 11:56:45.000: INFO: At 2021-08-18 11:46:37 +0000 UTC - event for ss-0: {kubelet node2} Failed: Failed to pull image "docker.io/library/httpd:2.4.38-alpine": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit Aug 18 11:56:45.001: INFO: At 2021-08-18 11:46:37 +0000 UTC - event for ss-0: {kubelet node2} Failed: Error: ErrImagePull Aug 18 11:56:45.001: INFO: At 2021-08-18 11:46:38 +0000 UTC - event for ss-0: {kubelet node2} BackOff: Back-off pulling image "docker.io/library/httpd:2.4.38-alpine" Aug 18 11:56:45.001: INFO: At 2021-08-18 11:46:38 +0000 UTC - event for ss-0: {kubelet node2} Failed: Error: ImagePullBackOff Aug 18 11:56:45.001: INFO: At 2021-08-18 11:56:34 +0000 UTC - event for ss: {statefulset-controller } SuccessfulDelete: delete Pod ss-0 in StatefulSet ss successful Aug 18 11:56:45.002: INFO: POD NODE PHASE GRACE CONDITIONS Aug 18 11:56:45.002: INFO: Aug 18 11:56:45.007: INFO: Logging node info for node master1 Aug 18 11:56:45.010: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 ebb211fa-503f-4cfe-b1ed-c95d27a70e6e 75801 0 2021-08-18 08:20:52 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"3a:82:be:72:b5:15"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:20:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:20:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:25:59 +0000 UTC,LastTransitionTime:2021-08-18 08:25:59 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:56:39 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:56:39 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:56:39 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:56:39 +0000 UTC,LastTransitionTime:2021-08-18 08:25:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:58c3e57359b641ad92fa1959f2fecf5d,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:012cd796-2076-45d6-8b14-d3e0451b1e64,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[@ :],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:56:45.011: INFO: Logging kubelet events for node master1 Aug 18 11:56:45.013: INFO: Logging pods the kubelet thinks is on node master1 Aug 18 11:56:45.022: INFO: kube-multus-ds-amd64-kbcp6 started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:45.022: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:56:45.022: INFO: docker-registry-docker-registry-56cbc7bc58-49kl2 started at 2021-08-18 08:26:23 +0000 UTC (0+2 container statuses recorded) Aug 18 11:56:45.022: INFO: Container docker-registry ready: true, restart count 0 Aug 18 11:56:45.022: INFO: Container nginx ready: true, restart count 0 Aug 18 11:56:45.022: INFO: node-exporter-5hwz9 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:56:45.022: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:56:45.022: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:56:45.022: INFO: kube-controller-manager-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:45.022: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:56:45.022: INFO: kube-flannel-q64cq started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:56:45.023: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:56:45.023: INFO: Container kube-flannel ready: true, restart count 3 Aug 18 11:56:45.023: INFO: coredns-7677f9bb54-kn2qg started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:45.023: INFO: Container coredns ready: true, restart count 2 Aug 18 11:56:45.023: INFO: kube-scheduler-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:45.023: INFO: Container kube-scheduler ready: true, restart count 0 Aug 18 11:56:45.023: INFO: kube-apiserver-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:45.023: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:56:45.023: INFO: kube-proxy-vqk4v started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:45.023: INFO: Container kube-proxy ready: true, restart count 1 W0818 11:56:45.035603 29 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:56:45.065: INFO: Latency metrics for node master1 Aug 18 11:56:45.065: INFO: Logging node info for node master2 Aug 18 11:56:45.068: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 78946293-3abe-4442-84d4-8ed6b1d15ce0 75793 0 2021-08-18 08:21:31 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"7e:f5:c2:cc:3a:b4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:21:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:21:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-08-18 08:29:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:56:37 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:56:37 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:56:37 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:56:37 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0c44122c7a7248c18d8571e1cc667258,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:0cd329f2-48e0-4c8f-b8b9-fa3ae0ed8406,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:56:45.069: INFO: Logging kubelet events for node master2 Aug 18 11:56:45.071: INFO: Logging pods the kubelet thinks is on node master2 Aug 18 11:56:45.078: INFO: kube-multus-ds-amd64-mld8g started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:45.078: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:56:45.078: INFO: dns-autoscaler-5b7b5c9b6f-hh47r started at 2021-08-18 08:23:57 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:45.078: INFO: Container autoscaler ready: true, restart count 2 Aug 18 11:56:45.078: INFO: node-feature-discovery-controller-5bf5c49849-mq57c started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:45.078: INFO: Container nfd-controller ready: true, restart count 0 Aug 18 11:56:45.078: INFO: node-exporter-48nfx started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:56:45.078: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:56:45.078: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:56:45.078: INFO: kube-apiserver-master2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:45.078: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:56:45.078: INFO: kube-scheduler-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:45.078: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:56:45.078: INFO: kube-flannel-pp56h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:56:45.078: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:56:45.078: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:56:45.078: INFO: kube-controller-manager-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:45.078: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:56:45.078: INFO: kube-proxy-kh2l9 started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:45.078: INFO: Container kube-proxy ready: true, restart count 2 W0818 11:56:45.093361 29 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:56:45.124: INFO: Latency metrics for node master2 Aug 18 11:56:45.124: INFO: Logging node info for node master3 Aug 18 11:56:45.126: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 44feac2b-9447-4be2-9fcd-62f836d67c72 75831 0 2021-08-18 08:21:41 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"86:e4:31:99:58:40"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {kubelet Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:56:43 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:56:43 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:56:43 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:56:43 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1fae19ae59884c44899bcd08aa243244,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:5db926c5-6530-4635-a0d5-806974a3b732,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:56:45.127: INFO: Logging kubelet events for node master3 Aug 18 11:56:45.129: INFO: Logging pods the kubelet thinks is on node master3 Aug 18 11:56:45.137: INFO: kube-flannel-x6tlr started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:56:45.137: INFO: Init container install-cni ready: true, restart count 1 Aug 18 11:56:45.137: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:56:45.137: INFO: kube-multus-ds-amd64-bkw6c started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:45.137: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:56:45.137: INFO: coredns-7677f9bb54-5hxfh started at 2021-08-18 08:23:54 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:45.137: INFO: Container coredns ready: true, restart count 1 Aug 18 11:56:45.137: INFO: node-exporter-vq7d8 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:56:45.137: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:56:45.137: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:56:45.137: INFO: kube-controller-manager-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:45.137: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:56:45.137: INFO: kube-scheduler-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:45.137: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:56:45.137: INFO: kube-apiserver-master3 started at 2021-08-18 08:29:12 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:45.137: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:56:45.137: INFO: kube-proxy-sd5lc started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:45.137: INFO: Container kube-proxy ready: true, restart count 2 W0818 11:56:45.151769 29 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:56:45.183: INFO: Latency metrics for node master3 Aug 18 11:56:45.183: INFO: Logging node info for node node1 Aug 18 11:56:45.186: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 84defabd-6ebf-43ec-a629-44c6713da9c9 75798 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"9a:87:55:36:7b:df"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:13 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:35 +0000 UTC,LastTransitionTime:2021-08-18 08:26:35 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:56:38 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:56:38 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:56:38 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:56:38 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:69946ff2b7bc462fa25eb7adb4703c23,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:736dc52f-f5e3-494e-86ca-01eedbea015c,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:a7cea43d9d2f67c38fbf0407786edbe660ee9072945f7bb272b55fd255e8eaca opnfv/barometer-collectd:stable],SizeBytes:1075746799,},ContainerImage{Names:[@ :],SizeBytes:1003788820,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[aquasec/kube-hunter@sha256:2be6820bc1d7e0f57193a9a27d5a3e16b2fd93c53747b03ce8ca48c6fc323781 aquasec/kube-hunter:0.3.1],SizeBytes:347611549,},ContainerImage{Names:[golang@sha256:db2475a1dbb2149508e5db31d7d77a75e6600d54be645f37681f03f2762169ba golang:alpine3.12],SizeBytes:301186719,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:de25c7fc6c4f3a27c7f0c2dff454e4671823a34d88abd533f210848d527e0fbb alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:56:45.188: INFO: Logging kubelet events for node node1 Aug 18 11:56:45.190: INFO: Logging pods the kubelet thinks is on node node1 Aug 18 11:56:45.206: INFO: nginx-proxy-node1 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:45.206: INFO: Container nginx-proxy ready: true, restart count 2 Aug 18 11:56:45.206: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-vsxvg started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:45.206: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:56:45.206: INFO: downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c started at 2021-08-18 11:55:49 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:45.206: INFO: Container dapi-container ready: false, restart count 0 Aug 18 11:56:45.206: INFO: update-demo-nautilus-x5psd started at 2021-08-18 11:56:43 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:45.206: INFO: Container update-demo ready: false, restart count 0 Aug 18 11:56:45.206: INFO: kube-flannel-q78nd started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:56:45.206: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:56:45.206: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:56:45.206: INFO: prometheus-k8s-0 started at 2021-08-18 08:34:03 +0000 UTC (0+5 container statuses recorded) Aug 18 11:56:45.206: INFO: Container custom-metrics-apiserver ready: true, restart count 0 Aug 18 11:56:45.206: INFO: Container grafana ready: true, restart count 0 Aug 18 11:56:45.206: INFO: Container prometheus ready: true, restart count 1 Aug 18 11:56:45.206: INFO: Container prometheus-config-reloader ready: true, restart count 0 Aug 18 11:56:45.206: INFO: Container rules-configmap-reloader ready: true, restart count 0 Aug 18 11:56:45.206: INFO: client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419 started at 2021-08-18 11:52:32 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:45.206: INFO: Container env3cont ready: false, restart count 0 Aug 18 11:56:45.206: INFO: kube-multus-ds-amd64-rrvmb started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:45.206: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:56:45.207: INFO: node-feature-discovery-worker-pflgw started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:45.207: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:56:45.207: INFO: node-exporter-kcwvn started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:56:45.207: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:56:45.207: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:56:45.207: INFO: pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a started at 2021-08-18 11:52:01 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:45.207: INFO: Container env-test ready: false, restart count 0 Aug 18 11:56:45.207: INFO: ss-0 started at 2021-08-18 11:47:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:45.207: INFO: Container webserver ready: false, restart count 0 Aug 18 11:56:45.207: INFO: foo-xpsfd started at 2021-08-18 11:53:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:45.207: INFO: Container c ready: false, restart count 0 Aug 18 11:56:45.207: INFO: server-envvars-dcc91a28-e119-476f-ad7b-86dc853ddeb4 started at 2021-08-18 11:52:28 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:45.207: INFO: Container srv ready: true, restart count 0 Aug 18 11:56:45.207: INFO: externalname-service-mlvh7 started at 2021-08-18 11:56:20 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:45.207: INFO: Container externalname-service ready: true, restart count 0 Aug 18 11:56:45.207: INFO: kube-proxy-p6jvp started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:45.207: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:56:45.207: INFO: kubernetes-metrics-scraper-678c97765c-9nsv5 started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:45.207: INFO: Container kubernetes-metrics-scraper ready: true, restart count 2 Aug 18 11:56:45.207: INFO: cmk-init-discover-node1-bxznx started at 2021-08-18 08:32:10 +0000 UTC (0+3 container statuses recorded) Aug 18 11:56:45.207: INFO: Container discover ready: false, restart count 0 Aug 18 11:56:45.207: INFO: Container init ready: false, restart count 0 Aug 18 11:56:45.207: INFO: Container install ready: false, restart count 0 Aug 18 11:56:45.207: INFO: cmk-d8r27 started at 2021-08-18 08:32:52 +0000 UTC (0+2 container statuses recorded) Aug 18 11:56:45.207: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:56:45.207: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:56:45.207: INFO: collectd-xdprr started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:56:45.207: INFO: Container collectd ready: true, restart count 0 Aug 18 11:56:45.207: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:56:45.207: INFO: Container rbac-proxy ready: true, restart count 0 W0818 11:56:45.222303 29 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:56:45.268: INFO: Latency metrics for node node1 Aug 18 11:56:45.268: INFO: Logging node info for node node2 Aug 18 11:56:45.271: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 1d01177e-3dbb-48a1-a0bc-d18af27ab7f8 75813 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:d1:47:f8:1d:22"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:36 +0000 UTC,LastTransitionTime:2021-08-18 08:26:36 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:56:41 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:56:41 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:56:41 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:56:41 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:dc1f286135c145349b8a016880b65a2f,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:037e7e2d-94e9-42f4-a719-896e5005ac70,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:56:45.272: INFO: Logging kubelet events for node node2 Aug 18 11:56:45.276: INFO: Logging pods the kubelet thinks is on node node2 Aug 18 11:56:45.300: INFO: nginx-proxy-node2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:45.300: INFO: Container nginx-proxy ready: true, restart count 1 Aug 18 11:56:45.300: INFO: cmk-init-discover-node2-6b2kz started at 2021-08-18 08:32:30 +0000 UTC (0+3 container statuses recorded) Aug 18 11:56:45.300: INFO: Container discover ready: false, restart count 0 Aug 18 11:56:45.300: INFO: Container init ready: false, restart count 0 Aug 18 11:56:45.300: INFO: Container install ready: false, restart count 0 Aug 18 11:56:45.300: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-7rn45 started at 2021-08-18 08:36:42 +0000 UTC (0+2 container statuses recorded) Aug 18 11:56:45.300: INFO: Container tas-controller ready: true, restart count 0 Aug 18 11:56:45.300: INFO: Container tas-extender ready: true, restart count 0 Aug 18 11:56:45.300: INFO: pod-update-399ed819-acd4-424c-8e46-fca448681026 started at 2021-08-18 11:53:12 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:45.300: INFO: Container nginx ready: false, restart count 0 Aug 18 11:56:45.300: INFO: kubernetes-dashboard-86c6f9df5b-qrtdk started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:45.300: INFO: Container kubernetes-dashboard ready: true, restart count 2 Aug 18 11:56:45.300: INFO: busybox-3dfd903c-68f3-48ac-a884-dd6ba807fca5 started at 2021-08-18 11:52:58 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:45.300: INFO: Container busybox ready: false, restart count 0 Aug 18 11:56:45.300: INFO: cmk-748rz started at 2021-08-18 08:32:53 +0000 UTC (0+2 container statuses recorded) Aug 18 11:56:45.301: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:56:45.301: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:56:45.301: INFO: externalname-service-9x22f started at 2021-08-18 11:56:20 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:45.301: INFO: Container externalname-service ready: true, restart count 0 Aug 18 11:56:45.301: INFO: execpodxr7sj started at 2021-08-18 11:56:26 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:45.301: INFO: Container agnhost-container ready: true, restart count 0 Aug 18 11:56:45.301: INFO: kube-proxy-qkj9c started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:45.301: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:56:45.301: INFO: node-feature-discovery-worker-hzpf5 started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:45.301: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:56:45.301: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-c82pt started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:45.301: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:56:45.301: INFO: prometheus-operator-5bb8cb9d8f-k97ws started at 2021-08-18 08:33:38 +0000 UTC (0+2 container statuses recorded) Aug 18 11:56:45.301: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:56:45.301: INFO: Container prometheus-operator ready: true, restart count 0 Aug 18 11:56:45.301: INFO: kube-multus-ds-amd64-rvzsg started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:45.301: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:56:45.301: INFO: collectd-67ntq started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:56:45.301: INFO: Container collectd ready: true, restart count 0 Aug 18 11:56:45.301: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:56:45.301: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:56:45.301: INFO: cmk-webhook-6c9d5f8578-7cxjr started at 2021-08-18 08:32:53 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:45.301: INFO: Container cmk-webhook ready: true, restart count 0 Aug 18 11:56:45.301: INFO: kube-flannel-h7t5h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:56:45.301: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:56:45.301: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:56:45.301: INFO: node-exporter-lrrf2 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:56:45.301: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:56:45.301: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:56:45.301: INFO: foo-mcmfh started at 2021-08-18 11:53:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:45.301: INFO: Container c ready: false, restart count 0 Aug 18 11:56:45.301: INFO: update-demo-nautilus-d488c started at 2021-08-18 11:56:43 +0000 UTC (0+1 container statuses recorded) Aug 18 11:56:45.301: INFO: Container update-demo ready: false, restart count 0 W0818 11:56:45.315439 29 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:56:45.515: INFO: Latency metrics for node node2 Aug 18 11:56:45.515: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "statefulset-4478" for this suite. • Failure [610.935 seconds] [sig-apps] StatefulSet /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/framework.go:23 [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 should have a working scale subresource [Conformance] [It] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:56:34.626: Failed waiting for pods to enter running: timed out waiting for the condition /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/statefulset/wait.go:58 ------------------------------ {"msg":"FAILED [sig-apps] StatefulSet [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] should have a working scale subresource [Conformance]","total":-1,"completed":29,"skipped":649,"failed":4,"failures":["[k8s.io] InitContainer [NodeConformance] should invoke init containers on a RestartAlways pod [Conformance]","[k8s.io] Pods should allow activeDeadlineSeconds to be updated [NodeConformance] [Conformance]","[k8s.io] Variable Expansion should allow substituting values in a container's args [NodeConformance] [Conformance]","[sig-apps] StatefulSet [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] should have a working scale subresource [Conformance]"]} SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-cli] Kubectl client /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:56:42.965: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename kubectl STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-cli] Kubectl client /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/kubectl.go:247 [BeforeEach] Update Demo /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/kubectl.go:299 [It] should create and stop a replication controller [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: creating a replication controller Aug 18 11:56:42.990: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-8310 create -f -' Aug 18 11:56:43.290: INFO: stderr: "" Aug 18 11:56:43.290: INFO: stdout: "replicationcontroller/update-demo-nautilus created\n" STEP: waiting for all containers in name=update-demo pods to come up. Aug 18 11:56:43.290: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-8310 get pods -o template --template={{range.items}}{{.metadata.name}} {{end}} -l name=update-demo' Aug 18 11:56:43.453: INFO: stderr: "" Aug 18 11:56:43.453: INFO: stdout: "update-demo-nautilus-d488c update-demo-nautilus-x5psd " Aug 18 11:56:43.453: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-8310 get pods update-demo-nautilus-d488c -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}' Aug 18 11:56:43.627: INFO: stderr: "" Aug 18 11:56:43.627: INFO: stdout: "" Aug 18 11:56:43.627: INFO: update-demo-nautilus-d488c is created but not running Aug 18 11:56:48.627: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-8310 get pods -o template --template={{range.items}}{{.metadata.name}} {{end}} -l name=update-demo' Aug 18 11:56:48.778: INFO: stderr: "" Aug 18 11:56:48.778: INFO: stdout: "update-demo-nautilus-d488c update-demo-nautilus-x5psd " Aug 18 11:56:48.778: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-8310 get pods update-demo-nautilus-d488c -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}' Aug 18 11:56:48.952: INFO: stderr: "" Aug 18 11:56:48.952: INFO: stdout: "true" Aug 18 11:56:48.952: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-8310 get pods update-demo-nautilus-d488c -o template --template={{if (exists . "spec" "containers")}}{{range .spec.containers}}{{if eq .name "update-demo"}}{{.image}}{{end}}{{end}}{{end}}' Aug 18 11:56:49.099: INFO: stderr: "" Aug 18 11:56:49.099: INFO: stdout: "gcr.io/kubernetes-e2e-test-images/nautilus:1.0" Aug 18 11:56:49.099: INFO: validating pod update-demo-nautilus-d488c Aug 18 11:56:49.103: INFO: got data: { "image": "nautilus.jpg" } Aug 18 11:56:49.103: INFO: Unmarshalled json jpg/img => {nautilus.jpg} , expecting nautilus.jpg . Aug 18 11:56:49.103: INFO: update-demo-nautilus-d488c is verified up and running Aug 18 11:56:49.103: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-8310 get pods update-demo-nautilus-x5psd -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}' Aug 18 11:56:49.262: INFO: stderr: "" Aug 18 11:56:49.262: INFO: stdout: "true" Aug 18 11:56:49.262: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-8310 get pods update-demo-nautilus-x5psd -o template --template={{if (exists . "spec" "containers")}}{{range .spec.containers}}{{if eq .name "update-demo"}}{{.image}}{{end}}{{end}}{{end}}' Aug 18 11:56:49.402: INFO: stderr: "" Aug 18 11:56:49.402: INFO: stdout: "gcr.io/kubernetes-e2e-test-images/nautilus:1.0" Aug 18 11:56:49.402: INFO: validating pod update-demo-nautilus-x5psd Aug 18 11:56:49.406: INFO: got data: { "image": "nautilus.jpg" } Aug 18 11:56:49.406: INFO: Unmarshalled json jpg/img => {nautilus.jpg} , expecting nautilus.jpg . Aug 18 11:56:49.407: INFO: update-demo-nautilus-x5psd is verified up and running STEP: using delete to clean up resources Aug 18 11:56:49.407: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-8310 delete --grace-period=0 --force -f -' Aug 18 11:56:49.529: INFO: stderr: "warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely.\n" Aug 18 11:56:49.529: INFO: stdout: "replicationcontroller \"update-demo-nautilus\" force deleted\n" Aug 18 11:56:49.529: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-8310 get rc,svc -l name=update-demo --no-headers' Aug 18 11:56:49.721: INFO: stderr: "No resources found in kubectl-8310 namespace.\n" Aug 18 11:56:49.721: INFO: stdout: "" Aug 18 11:56:49.721: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-8310 get pods -l name=update-demo -o go-template={{ range .items }}{{ if not .metadata.deletionTimestamp }}{{ .metadata.name }}{{ "\n" }}{{ end }}{{ end }}' Aug 18 11:56:49.889: INFO: stderr: "" Aug 18 11:56:49.889: INFO: stdout: "" [AfterEach] [sig-cli] Kubectl client /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:56:49.889: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "kubectl-8310" for this suite. • [SLOW TEST:6.932 seconds] [sig-cli] Kubectl client /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/framework.go:23 Update Demo /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/kubectl.go:297 should create and stop a replication controller [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-cli] Kubectl client Update Demo should create and stop a replication controller [Conformance]","total":-1,"completed":35,"skipped":695,"failed":5,"failures":["[sig-apps] Deployment RollingUpdateDeployment should delete old pods and create new ones [Conformance]","[sig-storage] ConfigMap binary data should be reflected in volume [NodeConformance] [Conformance]","[k8s.io] Kubelet when scheduling a busybox command in a pod should print the output to logs [NodeConformance] [Conformance]","[k8s.io] Pods should support remote command execution over websockets [NodeConformance] [Conformance]","[k8s.io] Container Runtime blackbox test on terminated container should report termination message [LinuxOnly] from file when pod succeeds and TerminationMessagePolicy FallbackToLogsOnError is set [NodeConformance] [Conformance]"]} SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-cli] Kubectl client /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:56:45.645: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename kubectl STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-cli] Kubectl client /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/kubectl.go:247 [BeforeEach] Kubectl label /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/kubectl.go:1307 STEP: creating the pod Aug 18 11:56:45.666: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-5094 create -f -' Aug 18 11:56:45.953: INFO: stderr: "" Aug 18 11:56:45.953: INFO: stdout: "pod/pause created\n" Aug 18 11:56:45.953: INFO: Waiting up to 5m0s for 1 pods to be running and ready: [pause] Aug 18 11:56:45.954: INFO: Waiting up to 5m0s for pod "pause" in namespace "kubectl-5094" to be "running and ready" Aug 18 11:56:45.956: INFO: Pod "pause": Phase="Pending", Reason="", readiness=false. Elapsed: 2.419343ms Aug 18 11:56:47.959: INFO: Pod "pause": Phase="Pending", Reason="", readiness=false. Elapsed: 2.00507841s Aug 18 11:56:49.972: INFO: Pod "pause": Phase="Running", Reason="", readiness=true. Elapsed: 4.018775282s Aug 18 11:56:49.972: INFO: Pod "pause" satisfied condition "running and ready" Aug 18 11:56:49.972: INFO: Wanted all 1 pods to be running and ready. Result: true. Pods: [pause] [It] should update the label on a resource [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: adding the label testing-label with value testing-label-value to a pod Aug 18 11:56:49.973: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-5094 label pods pause testing-label=testing-label-value' Aug 18 11:56:50.148: INFO: stderr: "" Aug 18 11:56:50.148: INFO: stdout: "pod/pause labeled\n" STEP: verifying the pod has the label testing-label with the value testing-label-value Aug 18 11:56:50.148: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-5094 get pod pause -L testing-label' Aug 18 11:56:50.290: INFO: stderr: "" Aug 18 11:56:50.290: INFO: stdout: "NAME READY STATUS RESTARTS AGE TESTING-LABEL\npause 1/1 Running 0 5s testing-label-value\n" STEP: removing the label testing-label of a pod Aug 18 11:56:50.290: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-5094 label pods pause testing-label-' Aug 18 11:56:50.451: INFO: stderr: "" Aug 18 11:56:50.451: INFO: stdout: "pod/pause labeled\n" STEP: verifying the pod doesn't have the label testing-label Aug 18 11:56:50.451: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-5094 get pod pause -L testing-label' Aug 18 11:56:50.601: INFO: stderr: "" Aug 18 11:56:50.601: INFO: stdout: "NAME READY STATUS RESTARTS AGE TESTING-LABEL\npause 1/1 Running 0 5s \n" [AfterEach] Kubectl label /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/kubectl.go:1313 STEP: using delete to clean up resources Aug 18 11:56:50.601: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-5094 delete --grace-period=0 --force -f -' Aug 18 11:56:50.751: INFO: stderr: "warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely.\n" Aug 18 11:56:50.751: INFO: stdout: "pod \"pause\" force deleted\n" Aug 18 11:56:50.751: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-5094 get rc,svc -l name=pause --no-headers' Aug 18 11:56:50.948: INFO: stderr: "No resources found in kubectl-5094 namespace.\n" Aug 18 11:56:50.948: INFO: stdout: "" Aug 18 11:56:50.948: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-5094 get pods -l name=pause -o go-template={{ range .items }}{{ if not .metadata.deletionTimestamp }}{{ .metadata.name }}{{ "\n" }}{{ end }}{{ end }}' Aug 18 11:56:51.103: INFO: stderr: "" Aug 18 11:56:51.103: INFO: stdout: "" [AfterEach] [sig-cli] Kubectl client /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:56:51.103: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "kubectl-5094" for this suite. • [SLOW TEST:5.471 seconds] [sig-cli] Kubectl client /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/framework.go:23 Kubectl label /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/kubectl.go:1305 should update the label on a resource [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-cli] Kubectl client Kubectl label should update the label on a resource [Conformance]","total":-1,"completed":30,"skipped":702,"failed":4,"failures":["[k8s.io] InitContainer [NodeConformance] should invoke init containers on a RestartAlways pod [Conformance]","[k8s.io] Pods should allow activeDeadlineSeconds to be updated [NodeConformance] [Conformance]","[k8s.io] Variable Expansion should allow substituting values in a container's args [NodeConformance] [Conformance]","[sig-apps] StatefulSet [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] should have a working scale subresource [Conformance]"]} SSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-node] ConfigMap /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:52:01.282: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename configmap STEP: Waiting for a default service account to be provisioned in namespace [It] should be consumable via the environment [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating configMap configmap-9506/configmap-test-d65b7fc8-3bb3-48fc-ac4e-b22636f8903d STEP: Creating a pod to test consume configMaps Aug 18 11:52:01.318: INFO: Waiting up to 5m0s for pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a" in namespace "configmap-9506" to be "Succeeded or Failed" Aug 18 11:52:01.321: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 2.78098ms Aug 18 11:52:03.325: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 2.006636958s Aug 18 11:52:05.329: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 4.010985304s Aug 18 11:52:07.334: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 6.015281257s Aug 18 11:52:09.337: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 8.018173841s Aug 18 11:52:11.340: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 10.021570677s Aug 18 11:52:13.343: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 12.025085465s Aug 18 11:52:15.348: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 14.02994484s Aug 18 11:52:17.351: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 16.0330722s Aug 18 11:52:19.354: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 18.035802712s Aug 18 11:52:21.357: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 20.038911763s Aug 18 11:52:23.361: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 22.04300585s Aug 18 11:52:25.364: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 24.045512858s Aug 18 11:52:27.367: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 26.049127168s Aug 18 11:52:29.371: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 28.05223182s Aug 18 11:52:31.374: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 30.056005469s Aug 18 11:52:33.377: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 32.058409739s Aug 18 11:52:35.380: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 34.061875533s Aug 18 11:52:37.385: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 36.066206308s Aug 18 11:52:39.387: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 38.068953168s Aug 18 11:52:41.390: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 40.071813969s Aug 18 11:52:43.393: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 42.07489019s Aug 18 11:52:45.396: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 44.078019579s Aug 18 11:52:47.401: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 46.083087422s Aug 18 11:52:49.406: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 48.087234707s Aug 18 11:52:51.409: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 50.090619071s Aug 18 11:52:53.413: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 52.09493468s Aug 18 11:52:55.416: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 54.097466758s Aug 18 11:52:57.420: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 56.101994021s Aug 18 11:52:59.424: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 58.105340194s Aug 18 11:53:01.427: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.108633604s Aug 18 11:53:03.430: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.111967864s Aug 18 11:53:05.435: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.116563627s Aug 18 11:53:07.438: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.119406324s Aug 18 11:53:09.440: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.122133193s Aug 18 11:53:11.444: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.12534936s Aug 18 11:53:13.447: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.128821502s Aug 18 11:53:15.451: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.132904786s Aug 18 11:53:17.455: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.137043996s Aug 18 11:53:19.460: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.14158345s Aug 18 11:53:21.464: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.145326807s Aug 18 11:53:23.467: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.148884417s Aug 18 11:53:25.470: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.152079339s Aug 18 11:53:27.474: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.155504478s Aug 18 11:53:29.477: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.158340105s Aug 18 11:53:31.480: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.161577845s Aug 18 11:53:33.483: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.165071332s Aug 18 11:53:35.487: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.168503786s Aug 18 11:53:37.491: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.172195363s Aug 18 11:53:39.493: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.175010999s Aug 18 11:53:41.497: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.178490507s Aug 18 11:53:43.501: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.182495849s Aug 18 11:53:45.504: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.185195331s Aug 18 11:53:47.508: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.189244633s Aug 18 11:53:49.510: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.191965496s Aug 18 11:53:51.513: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.194501922s Aug 18 11:53:53.516: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.198002477s Aug 18 11:53:55.523: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.204302987s Aug 18 11:53:57.527: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.209118767s Aug 18 11:53:59.532: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.213525261s Aug 18 11:54:01.536: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.217475691s Aug 18 11:54:03.541: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.222368876s Aug 18 11:54:05.545: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.226465577s Aug 18 11:54:07.549: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.231122694s Aug 18 11:54:09.553: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.234667064s Aug 18 11:54:11.556: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.23789172s Aug 18 11:54:13.559: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.240652648s Aug 18 11:54:15.562: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.244014776s Aug 18 11:54:17.566: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.247734424s Aug 18 11:54:19.569: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.250534792s Aug 18 11:54:21.572: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.253769634s Aug 18 11:54:23.575: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.256684674s Aug 18 11:54:25.578: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.260093664s Aug 18 11:54:27.582: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.263677668s Aug 18 11:54:29.585: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.266778768s Aug 18 11:54:31.589: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.27085504s Aug 18 11:54:33.592: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.273586226s Aug 18 11:54:35.596: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.277224795s Aug 18 11:54:37.599: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.280175503s Aug 18 11:54:39.603: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.284261346s Aug 18 11:54:41.607: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.288611336s Aug 18 11:54:43.610: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.291733523s Aug 18 11:54:45.613: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.294573108s Aug 18 11:54:47.616: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.297864005s Aug 18 11:54:49.619: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.300967352s Aug 18 11:54:51.623: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.304953764s Aug 18 11:54:53.626: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.307814765s Aug 18 11:54:55.631: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.313101563s Aug 18 11:54:57.635: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.316282963s Aug 18 11:54:59.638: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.320062277s Aug 18 11:55:01.643: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.324450698s Aug 18 11:55:03.647: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.328332933s Aug 18 11:55:05.650: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.331578459s Aug 18 11:55:07.653: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.334383165s Aug 18 11:55:09.656: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.337630434s Aug 18 11:55:11.659: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.340857228s Aug 18 11:55:13.663: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.344279944s Aug 18 11:55:15.666: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.347204682s Aug 18 11:55:17.668: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.350138837s Aug 18 11:55:19.671: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.353147673s Aug 18 11:55:21.676: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.357208743s Aug 18 11:55:23.681: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.36276246s Aug 18 11:55:25.685: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.366456798s Aug 18 11:55:27.688: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.369863608s Aug 18 11:55:29.693: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.374619684s Aug 18 11:55:31.696: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.377918668s Aug 18 11:55:33.700: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.381556139s Aug 18 11:55:35.705: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.386593467s Aug 18 11:55:37.708: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.389450918s Aug 18 11:55:39.712: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.393662404s Aug 18 11:55:41.716: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.398072463s Aug 18 11:55:43.720: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.401223188s Aug 18 11:55:45.722: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.404020508s Aug 18 11:55:47.726: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.407495781s Aug 18 11:55:49.729: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.410975083s Aug 18 11:55:51.731: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.413115727s Aug 18 11:55:53.735: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.41712778s Aug 18 11:55:55.739: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.420744709s Aug 18 11:55:57.742: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.423273167s Aug 18 11:55:59.745: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.426997365s Aug 18 11:56:01.749: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.430610819s Aug 18 11:56:03.752: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.433832015s Aug 18 11:56:05.756: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.437241249s Aug 18 11:56:07.758: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.439924406s Aug 18 11:56:09.761: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.442819007s Aug 18 11:56:11.764: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.44601205s Aug 18 11:56:13.768: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.449345849s Aug 18 11:56:15.771: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.452327467s Aug 18 11:56:17.774: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.455256072s Aug 18 11:56:19.779: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.460311643s Aug 18 11:56:21.781: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.462947975s Aug 18 11:56:23.784: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.466152458s Aug 18 11:56:25.788: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.469826859s Aug 18 11:56:27.791: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.472876498s Aug 18 11:56:29.795: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.47637718s Aug 18 11:56:31.798: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.479969651s Aug 18 11:56:33.802: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.483857545s Aug 18 11:56:35.806: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.488041952s Aug 18 11:56:37.809: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.491119142s Aug 18 11:56:39.813: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.494314647s Aug 18 11:56:41.816: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.497520336s Aug 18 11:56:43.819: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.500661429s Aug 18 11:56:45.822: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.503397149s Aug 18 11:56:47.825: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.506990069s Aug 18 11:56:49.829: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.510232844s Aug 18 11:56:51.832: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.513565471s Aug 18 11:56:53.835: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.517156556s Aug 18 11:56:55.840: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.521835579s Aug 18 11:56:57.843: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.524666898s Aug 18 11:56:59.848: INFO: Pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.529184154s Aug 18 11:57:01.857: INFO: Failed to get logs from node "node1" pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a" container "env-test": the server rejected our request for an unknown reason (get pods pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a) STEP: delete the pod Aug 18 11:57:01.861: INFO: Waiting for pod pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a to disappear Aug 18 11:57:01.863: INFO: Pod pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a still exists Aug 18 11:57:03.864: INFO: Waiting for pod pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a to disappear Aug 18 11:57:03.866: INFO: Pod pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a still exists Aug 18 11:57:05.864: INFO: Waiting for pod pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a to disappear Aug 18 11:57:05.867: INFO: Pod pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a still exists Aug 18 11:57:07.864: INFO: Waiting for pod pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a to disappear Aug 18 11:57:07.866: INFO: Pod pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a no longer exists Aug 18 11:57:07.867: FAIL: Unexpected error: <*errors.errorString | 0xc003f36d80>: { s: "expected pod \"pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a\" success: Gave up after waiting 5m0s for pod \"pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a\" to be \"Succeeded or Failed\"", } expected pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a" success: Gave up after waiting 5m0s for pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a" to be "Succeeded or Failed" occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).testContainerOutputMatcher(0xc0001b2f20, 0x4c203ba, 0x12, 0xc00396ac00, 0x0, 0xc004993178, 0x6, 0x6, 0x4deefa8) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 +0x1ee k8s.io/kubernetes/test/e2e/framework.(*Framework).TestContainerOutput(...) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:525 k8s.io/kubernetes/test/e2e/common.glob..func1.2() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/configmap.go:124 +0x954 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc001a9de00) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc001a9de00) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc001a9de00, 0x4deb2c0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [sig-node] ConfigMap /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "configmap-9506". STEP: Found 7 events. Aug 18 11:57:07.872: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a: { } Scheduled: Successfully assigned configmap-9506/pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a to node1 Aug 18 11:57:07.872: INFO: At 2021-08-18 11:52:02 +0000 UTC - event for pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a: {multus } AddedInterface: Add eth0 [10.244.4.105/24] Aug 18 11:57:07.872: INFO: At 2021-08-18 11:52:02 +0000 UTC - event for pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a: {kubelet node1} Pulling: Pulling image "docker.io/library/busybox:1.29" Aug 18 11:57:07.872: INFO: At 2021-08-18 11:52:03 +0000 UTC - event for pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a: {kubelet node1} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit Aug 18 11:57:07.872: INFO: At 2021-08-18 11:52:03 +0000 UTC - event for pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a: {kubelet node1} Failed: Error: ErrImagePull Aug 18 11:57:07.872: INFO: At 2021-08-18 11:52:04 +0000 UTC - event for pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a: {kubelet node1} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" Aug 18 11:57:07.872: INFO: At 2021-08-18 11:52:04 +0000 UTC - event for pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a: {kubelet node1} Failed: Error: ImagePullBackOff Aug 18 11:57:07.874: INFO: POD NODE PHASE GRACE CONDITIONS Aug 18 11:57:07.874: INFO: Aug 18 11:57:07.879: INFO: Logging node info for node master1 Aug 18 11:57:07.882: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 ebb211fa-503f-4cfe-b1ed-c95d27a70e6e 76242 0 2021-08-18 08:20:52 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"3a:82:be:72:b5:15"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:20:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:20:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:25:59 +0000 UTC,LastTransitionTime:2021-08-18 08:25:59 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:56:59 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:56:59 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:56:59 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:56:59 +0000 UTC,LastTransitionTime:2021-08-18 08:25:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:58c3e57359b641ad92fa1959f2fecf5d,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:012cd796-2076-45d6-8b14-d3e0451b1e64,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[@ :],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:57:07.882: INFO: Logging kubelet events for node master1 Aug 18 11:57:07.885: INFO: Logging pods the kubelet thinks is on node master1 Aug 18 11:57:07.894: INFO: docker-registry-docker-registry-56cbc7bc58-49kl2 started at 2021-08-18 08:26:23 +0000 UTC (0+2 container statuses recorded) Aug 18 11:57:07.894: INFO: Container docker-registry ready: true, restart count 0 Aug 18 11:57:07.894: INFO: Container nginx ready: true, restart count 0 Aug 18 11:57:07.894: INFO: node-exporter-5hwz9 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:57:07.894: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:57:07.894: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:57:07.894: INFO: kube-controller-manager-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:07.894: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:57:07.894: INFO: kube-multus-ds-amd64-kbcp6 started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:07.894: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:57:07.894: INFO: coredns-7677f9bb54-kn2qg started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:07.894: INFO: Container coredns ready: true, restart count 2 Aug 18 11:57:07.894: INFO: kube-scheduler-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:07.894: INFO: Container kube-scheduler ready: true, restart count 0 Aug 18 11:57:07.894: INFO: kube-apiserver-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:07.894: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:57:07.894: INFO: kube-proxy-vqk4v started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:07.894: INFO: Container kube-proxy ready: true, restart count 1 Aug 18 11:57:07.894: INFO: kube-flannel-q64cq started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:57:07.894: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:57:07.894: INFO: Container kube-flannel ready: true, restart count 3 W0818 11:57:07.907207 34 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:57:07.940: INFO: Latency metrics for node master1 Aug 18 11:57:07.940: INFO: Logging node info for node master2 Aug 18 11:57:07.943: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 78946293-3abe-4442-84d4-8ed6b1d15ce0 76404 0 2021-08-18 08:21:31 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"7e:f5:c2:cc:3a:b4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:21:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:21:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-08-18 08:29:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:57:07 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:57:07 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:57:07 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:57:07 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0c44122c7a7248c18d8571e1cc667258,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:0cd329f2-48e0-4c8f-b8b9-fa3ae0ed8406,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:57:07.943: INFO: Logging kubelet events for node master2 Aug 18 11:57:07.946: INFO: Logging pods the kubelet thinks is on node master2 Aug 18 11:57:07.953: INFO: kube-apiserver-master2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:07.953: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:57:07.953: INFO: kube-scheduler-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:07.953: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:57:07.953: INFO: kube-multus-ds-amd64-mld8g started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:07.953: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:57:07.953: INFO: dns-autoscaler-5b7b5c9b6f-hh47r started at 2021-08-18 08:23:57 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:07.953: INFO: Container autoscaler ready: true, restart count 2 Aug 18 11:57:07.953: INFO: node-feature-discovery-controller-5bf5c49849-mq57c started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:07.953: INFO: Container nfd-controller ready: true, restart count 0 Aug 18 11:57:07.953: INFO: node-exporter-48nfx started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:57:07.953: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:57:07.953: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:57:07.953: INFO: kube-controller-manager-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:07.953: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:57:07.953: INFO: kube-proxy-kh2l9 started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:07.953: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:57:07.953: INFO: kube-flannel-pp56h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:57:07.953: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:57:07.953: INFO: Container kube-flannel ready: true, restart count 1 W0818 11:57:07.964172 34 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:57:07.995: INFO: Latency metrics for node master2 Aug 18 11:57:07.995: INFO: Logging node info for node master3 Aug 18 11:57:07.998: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 44feac2b-9447-4be2-9fcd-62f836d67c72 76328 0 2021-08-18 08:21:41 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"86:e4:31:99:58:40"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {kubelet Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:57:03 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:57:03 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:57:03 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:57:03 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1fae19ae59884c44899bcd08aa243244,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:5db926c5-6530-4635-a0d5-806974a3b732,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:57:07.998: INFO: Logging kubelet events for node master3 Aug 18 11:57:08.001: INFO: Logging pods the kubelet thinks is on node master3 Aug 18 11:57:08.010: INFO: kube-flannel-x6tlr started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:57:08.010: INFO: Init container install-cni ready: true, restart count 1 Aug 18 11:57:08.010: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:57:08.010: INFO: kube-multus-ds-amd64-bkw6c started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:08.010: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:57:08.010: INFO: coredns-7677f9bb54-5hxfh started at 2021-08-18 08:23:54 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:08.010: INFO: Container coredns ready: true, restart count 1 Aug 18 11:57:08.010: INFO: node-exporter-vq7d8 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:57:08.010: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:57:08.010: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:57:08.010: INFO: kube-controller-manager-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:08.010: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:57:08.010: INFO: kube-scheduler-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:08.010: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:57:08.010: INFO: kube-apiserver-master3 started at 2021-08-18 08:29:12 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:08.010: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:57:08.010: INFO: kube-proxy-sd5lc started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:08.010: INFO: Container kube-proxy ready: true, restart count 2 W0818 11:57:08.024458 34 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:57:08.047: INFO: Latency metrics for node master3 Aug 18 11:57:08.047: INFO: Logging node info for node node1 Aug 18 11:57:08.049: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 84defabd-6ebf-43ec-a629-44c6713da9c9 76220 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"9a:87:55:36:7b:df"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:13 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:35 +0000 UTC,LastTransitionTime:2021-08-18 08:26:35 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:56:58 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:56:58 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:56:58 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:56:58 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:69946ff2b7bc462fa25eb7adb4703c23,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:736dc52f-f5e3-494e-86ca-01eedbea015c,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:a7cea43d9d2f67c38fbf0407786edbe660ee9072945f7bb272b55fd255e8eaca opnfv/barometer-collectd:stable],SizeBytes:1075746799,},ContainerImage{Names:[@ :],SizeBytes:1003788820,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[aquasec/kube-hunter@sha256:2be6820bc1d7e0f57193a9a27d5a3e16b2fd93c53747b03ce8ca48c6fc323781 aquasec/kube-hunter:0.3.1],SizeBytes:347611549,},ContainerImage{Names:[golang@sha256:db2475a1dbb2149508e5db31d7d77a75e6600d54be645f37681f03f2762169ba golang:alpine3.12],SizeBytes:301186719,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:de25c7fc6c4f3a27c7f0c2dff454e4671823a34d88abd533f210848d527e0fbb alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:57:08.050: INFO: Logging kubelet events for node node1 Aug 18 11:57:08.052: INFO: Logging pods the kubelet thinks is on node node1 Aug 18 11:57:08.069: INFO: ss-0 started at 2021-08-18 11:47:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:08.069: INFO: Container webserver ready: false, restart count 0 Aug 18 11:57:08.069: INFO: webserver-deployment-dd94f59b7-rws9q started at 2021-08-18 11:56:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:08.069: INFO: Container httpd ready: false, restart count 0 Aug 18 11:57:08.069: INFO: simpletest.rc-v7qrv started at 2021-08-18 11:56:50 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:08.069: INFO: Container nginx ready: false, restart count 0 Aug 18 11:57:08.069: INFO: simpletest.rc-dhc6q started at 2021-08-18 11:56:50 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:08.069: INFO: Container nginx ready: false, restart count 0 Aug 18 11:57:08.069: INFO: kube-proxy-p6jvp started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:08.069: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:57:08.069: INFO: kubernetes-metrics-scraper-678c97765c-9nsv5 started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:08.069: INFO: Container kubernetes-metrics-scraper ready: true, restart count 2 Aug 18 11:57:08.069: INFO: cmk-d8r27 started at 2021-08-18 08:32:52 +0000 UTC (0+2 container statuses recorded) Aug 18 11:57:08.069: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:57:08.069: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:57:08.069: INFO: nginx-proxy-node1 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:08.069: INFO: Container nginx-proxy ready: true, restart count 2 Aug 18 11:57:08.069: INFO: foo-xpsfd started at 2021-08-18 11:53:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:08.069: INFO: Container c ready: false, restart count 0 Aug 18 11:57:08.069: INFO: server-envvars-dcc91a28-e119-476f-ad7b-86dc853ddeb4 started at 2021-08-18 11:52:28 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:08.069: INFO: Container srv ready: true, restart count 0 Aug 18 11:57:08.069: INFO: externalname-service-mlvh7 started at 2021-08-18 11:56:20 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:08.069: INFO: Container externalname-service ready: true, restart count 0 Aug 18 11:57:08.069: INFO: simpletest.rc-l2xlg started at 2021-08-18 11:56:50 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:08.069: INFO: Container nginx ready: false, restart count 0 Aug 18 11:57:08.069: INFO: kube-multus-ds-amd64-rrvmb started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:08.069: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:57:08.069: INFO: node-feature-discovery-worker-pflgw started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:08.069: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:57:08.069: INFO: node-exporter-kcwvn started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:57:08.069: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:57:08.069: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:57:08.069: INFO: webserver-deployment-dd94f59b7-dqt7r started at 2021-08-18 11:56:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:08.069: INFO: Container httpd ready: false, restart count 0 Aug 18 11:57:08.069: INFO: webserver-deployment-dd94f59b7-x65jh started at 2021-08-18 11:56:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:08.069: INFO: Container httpd ready: false, restart count 0 Aug 18 11:57:08.069: INFO: cmk-init-discover-node1-bxznx started at 2021-08-18 08:32:10 +0000 UTC (0+3 container statuses recorded) Aug 18 11:57:08.069: INFO: Container discover ready: false, restart count 0 Aug 18 11:57:08.069: INFO: Container init ready: false, restart count 0 Aug 18 11:57:08.069: INFO: Container install ready: false, restart count 0 Aug 18 11:57:08.069: INFO: collectd-xdprr started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:57:08.069: INFO: Container collectd ready: true, restart count 0 Aug 18 11:57:08.069: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:57:08.069: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:57:08.069: INFO: webserver-deployment-dd94f59b7-dbsxb started at 2021-08-18 11:56:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:08.069: INFO: Container httpd ready: false, restart count 0 Aug 18 11:57:08.069: INFO: simpletest.rc-pkcsq started at 2021-08-18 11:56:50 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:08.069: INFO: Container nginx ready: false, restart count 0 Aug 18 11:57:08.069: INFO: webserver-deployment-dd94f59b7-h8pvd started at 2021-08-18 11:56:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:08.069: INFO: Container httpd ready: false, restart count 0 Aug 18 11:57:08.069: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-vsxvg started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:08.069: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:57:08.069: INFO: downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c started at 2021-08-18 11:55:49 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:08.069: INFO: Container dapi-container ready: false, restart count 0 Aug 18 11:57:08.069: INFO: client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419 started at 2021-08-18 11:52:32 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:08.069: INFO: Container env3cont ready: false, restart count 0 Aug 18 11:57:08.069: INFO: kube-flannel-q78nd started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:57:08.069: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:57:08.069: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:57:08.069: INFO: prometheus-k8s-0 started at 2021-08-18 08:34:03 +0000 UTC (0+5 container statuses recorded) Aug 18 11:57:08.069: INFO: Container custom-metrics-apiserver ready: true, restart count 0 Aug 18 11:57:08.069: INFO: Container grafana ready: true, restart count 0 Aug 18 11:57:08.069: INFO: Container prometheus ready: true, restart count 1 Aug 18 11:57:08.069: INFO: Container prometheus-config-reloader ready: true, restart count 0 Aug 18 11:57:08.069: INFO: Container rules-configmap-reloader ready: true, restart count 0 Aug 18 11:57:08.069: INFO: simpletest.rc-6vlbj started at 2021-08-18 11:56:50 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:08.069: INFO: Container nginx ready: false, restart count 0 W0818 11:57:08.082078 34 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:57:08.132: INFO: Latency metrics for node node1 Aug 18 11:57:08.132: INFO: Logging node info for node node2 Aug 18 11:57:08.134: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 1d01177e-3dbb-48a1-a0bc-d18af27ab7f8 76299 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:d1:47:f8:1d:22"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:36 +0000 UTC,LastTransitionTime:2021-08-18 08:26:36 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:57:01 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:57:01 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:57:01 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:57:01 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:dc1f286135c145349b8a016880b65a2f,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:037e7e2d-94e9-42f4-a719-896e5005ac70,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:57:08.135: INFO: Logging kubelet events for node node2 Aug 18 11:57:08.137: INFO: Logging pods the kubelet thinks is on node node2 Aug 18 11:57:08.152: INFO: nginx-proxy-node2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:08.152: INFO: Container nginx-proxy ready: true, restart count 1 Aug 18 11:57:08.152: INFO: cmk-init-discover-node2-6b2kz started at 2021-08-18 08:32:30 +0000 UTC (0+3 container statuses recorded) Aug 18 11:57:08.152: INFO: Container discover ready: false, restart count 0 Aug 18 11:57:08.152: INFO: Container init ready: false, restart count 0 Aug 18 11:57:08.153: INFO: Container install ready: false, restart count 0 Aug 18 11:57:08.153: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-7rn45 started at 2021-08-18 08:36:42 +0000 UTC (0+2 container statuses recorded) Aug 18 11:57:08.153: INFO: Container tas-controller ready: true, restart count 0 Aug 18 11:57:08.153: INFO: Container tas-extender ready: true, restart count 0 Aug 18 11:57:08.153: INFO: pod-update-399ed819-acd4-424c-8e46-fca448681026 started at 2021-08-18 11:53:12 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:08.153: INFO: Container nginx ready: false, restart count 0 Aug 18 11:57:08.153: INFO: simpletest.rc-6zlz2 started at 2021-08-18 11:56:50 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:08.153: INFO: Container nginx ready: false, restart count 0 Aug 18 11:57:08.153: INFO: webserver-deployment-dd94f59b7-ttks8 started at 2021-08-18 11:56:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:08.153: INFO: Container httpd ready: false, restart count 0 Aug 18 11:57:08.153: INFO: kubernetes-dashboard-86c6f9df5b-qrtdk started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:08.153: INFO: Container kubernetes-dashboard ready: true, restart count 2 Aug 18 11:57:08.153: INFO: webserver-deployment-dd94f59b7-4pbnc started at 2021-08-18 11:56:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:08.153: INFO: Container httpd ready: false, restart count 0 Aug 18 11:57:08.153: INFO: busybox-3dfd903c-68f3-48ac-a884-dd6ba807fca5 started at 2021-08-18 11:52:58 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:08.153: INFO: Container busybox ready: false, restart count 0 Aug 18 11:57:08.153: INFO: webserver-deployment-dd94f59b7-qmb69 started at 2021-08-18 11:56:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:08.153: INFO: Container httpd ready: false, restart count 0 Aug 18 11:57:08.153: INFO: webserver-deployment-dd94f59b7-bvwxs started at 2021-08-18 11:56:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:08.153: INFO: Container httpd ready: false, restart count 0 Aug 18 11:57:08.153: INFO: cmk-748rz started at 2021-08-18 08:32:53 +0000 UTC (0+2 container statuses recorded) Aug 18 11:57:08.153: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:57:08.153: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:57:08.153: INFO: externalname-service-9x22f started at 2021-08-18 11:56:20 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:08.153: INFO: Container externalname-service ready: true, restart count 0 Aug 18 11:57:08.153: INFO: execpodxr7sj started at 2021-08-18 11:56:26 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:08.153: INFO: Container agnhost-container ready: true, restart count 0 Aug 18 11:57:08.153: INFO: kube-proxy-qkj9c started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:08.153: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:57:08.153: INFO: node-feature-discovery-worker-hzpf5 started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:08.153: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:57:08.153: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-c82pt started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:08.153: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:57:08.153: INFO: prometheus-operator-5bb8cb9d8f-k97ws started at 2021-08-18 08:33:38 +0000 UTC (0+2 container statuses recorded) Aug 18 11:57:08.153: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:57:08.153: INFO: Container prometheus-operator ready: true, restart count 0 Aug 18 11:57:08.153: INFO: simpletest.rc-cwkg7 started at 2021-08-18 11:56:50 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:08.153: INFO: Container nginx ready: false, restart count 0 Aug 18 11:57:08.153: INFO: kube-multus-ds-amd64-rvzsg started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:08.153: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:57:08.153: INFO: collectd-67ntq started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:57:08.153: INFO: Container collectd ready: true, restart count 0 Aug 18 11:57:08.153: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:57:08.153: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:57:08.153: INFO: simpletest.rc-rgnt2 started at 2021-08-18 11:56:50 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:08.153: INFO: Container nginx ready: false, restart count 0 Aug 18 11:57:08.153: INFO: simpletest.rc-zqlmq started at 2021-08-18 11:56:50 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:08.153: INFO: Container nginx ready: false, restart count 0 Aug 18 11:57:08.153: INFO: cmk-webhook-6c9d5f8578-7cxjr started at 2021-08-18 08:32:53 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:08.153: INFO: Container cmk-webhook ready: true, restart count 0 Aug 18 11:57:08.153: INFO: kube-flannel-h7t5h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:57:08.153: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:57:08.153: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:57:08.153: INFO: node-exporter-lrrf2 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:57:08.153: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:57:08.153: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:57:08.153: INFO: simpletest.rc-qrd85 started at 2021-08-18 11:56:50 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:08.153: INFO: Container nginx ready: false, restart count 0 Aug 18 11:57:08.153: INFO: webserver-deployment-dd94f59b7-g45zh started at 2021-08-18 11:56:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:08.153: INFO: Container httpd ready: false, restart count 0 Aug 18 11:57:08.153: INFO: foo-mcmfh started at 2021-08-18 11:53:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:08.153: INFO: Container c ready: false, restart count 0 W0818 11:57:08.164790 34 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:57:08.206: INFO: Latency metrics for node node2 Aug 18 11:57:08.206: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "configmap-9506" for this suite. • Failure [306.934 seconds] [sig-node] ConfigMap /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/configmap.go:34 should be consumable via the environment [NodeConformance] [Conformance] [It] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:57:07.867: Unexpected error: <*errors.errorString | 0xc003f36d80>: { s: "expected pod \"pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a\" success: Gave up after waiting 5m0s for pod \"pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a\" to be \"Succeeded or Failed\"", } expected pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a" success: Gave up after waiting 5m0s for pod "pod-configmaps-8147b50c-9b4e-4060-b2ec-a8985fa5ba9a" to be "Succeeded or Failed" occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 ------------------------------ {"msg":"FAILED [sig-node] ConfigMap should be consumable via the environment [NodeConformance] [Conformance]","total":-1,"completed":13,"skipped":156,"failed":6,"failures":["[k8s.io] Variable Expansion should verify that a failing subpath expansion can be modified during the lifecycle of a container [sig-storage][Slow] [Conformance]","[sig-apps] Deployment deployment should delete old replica sets [Conformance]","[k8s.io] Variable Expansion should succeed in writing subpaths in container [sig-storage][Slow] [Conformance]","[k8s.io] Security Context When creating a pod with privileged should run the container as unprivileged when false [LinuxOnly] [NodeConformance] [Conformance]","[sig-node] ConfigMap should be consumable via environment variable [NodeConformance] [Conformance]","[sig-node] ConfigMap should be consumable via the environment [NodeConformance] [Conformance]"]} SSSSSSSSS ------------------------------ [BeforeEach] [sig-cli] Kubectl client /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:57:08.244: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename kubectl STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-cli] Kubectl client /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/kubectl.go:247 [It] should create services for rc [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: creating Agnhost RC Aug 18 11:57:08.264: INFO: namespace kubectl-7256 Aug 18 11:57:08.264: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-7256 create -f -' Aug 18 11:57:08.545: INFO: stderr: "" Aug 18 11:57:08.545: INFO: stdout: "replicationcontroller/agnhost-primary created\n" STEP: Waiting for Agnhost primary to start. Aug 18 11:57:09.548: INFO: Selector matched 1 pods for map[app:agnhost] Aug 18 11:57:09.548: INFO: Found 0 / 1 Aug 18 11:57:10.548: INFO: Selector matched 1 pods for map[app:agnhost] Aug 18 11:57:10.548: INFO: Found 0 / 1 Aug 18 11:57:11.549: INFO: Selector matched 1 pods for map[app:agnhost] Aug 18 11:57:11.549: INFO: Found 0 / 1 Aug 18 11:57:12.548: INFO: Selector matched 1 pods for map[app:agnhost] Aug 18 11:57:12.549: INFO: Found 1 / 1 Aug 18 11:57:12.549: INFO: WaitFor completed with timeout 5m0s. Pods found = 1 out of 1 Aug 18 11:57:12.552: INFO: Selector matched 1 pods for map[app:agnhost] Aug 18 11:57:12.552: INFO: ForEach: Found 1 pods from the filter. Now looping through them. Aug 18 11:57:12.552: INFO: wait on agnhost-primary startup in kubectl-7256 Aug 18 11:57:12.552: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-7256 logs agnhost-primary-glw6d agnhost-primary' Aug 18 11:57:12.719: INFO: stderr: "" Aug 18 11:57:12.719: INFO: stdout: "Paused\n" STEP: exposing RC Aug 18 11:57:12.719: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-7256 expose rc agnhost-primary --name=rm2 --port=1234 --target-port=6379' Aug 18 11:57:12.905: INFO: stderr: "" Aug 18 11:57:12.905: INFO: stdout: "service/rm2 exposed\n" Aug 18 11:57:12.907: INFO: Service rm2 in namespace kubectl-7256 found. STEP: exposing service Aug 18 11:57:14.913: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=kubectl-7256 expose service rm2 --name=rm3 --port=2345 --target-port=6379' Aug 18 11:57:15.102: INFO: stderr: "" Aug 18 11:57:15.102: INFO: stdout: "service/rm3 exposed\n" Aug 18 11:57:15.105: INFO: Service rm3 in namespace kubectl-7256 found. [AfterEach] [sig-cli] Kubectl client /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:57:17.110: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "kubectl-7256" for this suite. • [SLOW TEST:8.877 seconds] [sig-cli] Kubectl client /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/framework.go:23 Kubectl expose /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/kubectl.go:1222 should create services for rc [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-cli] Kubectl client Kubectl expose should create services for rc [Conformance]","total":-1,"completed":14,"skipped":165,"failed":6,"failures":["[k8s.io] Variable Expansion should verify that a failing subpath expansion can be modified during the lifecycle of a container [sig-storage][Slow] [Conformance]","[sig-apps] Deployment deployment should delete old replica sets [Conformance]","[k8s.io] Variable Expansion should succeed in writing subpaths in container [sig-storage][Slow] [Conformance]","[k8s.io] Security Context When creating a pod with privileged should run the container as unprivileged when false [LinuxOnly] [NodeConformance] [Conformance]","[sig-node] ConfigMap should be consumable via environment variable [NodeConformance] [Conformance]","[sig-node] ConfigMap should be consumable via the environment [NodeConformance] [Conformance]"]} SSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [k8s.io] Pods /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:57:17.153: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename pods STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [k8s.io] Pods /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/pods.go:181 [It] should get a host IP [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: creating pod Aug 18 11:57:21.194: INFO: Pod pod-hostip-f98b0bf5-af54-4971-b3bf-e096edfead7c has hostIP: 10.10.190.208 [AfterEach] [k8s.io] Pods /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:57:21.194: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "pods-3614" for this suite. • ------------------------------ {"msg":"PASSED [k8s.io] Pods should get a host IP [NodeConformance] [Conformance]","total":-1,"completed":15,"skipped":181,"failed":6,"failures":["[k8s.io] Variable Expansion should verify that a failing subpath expansion can be modified during the lifecycle of a container [sig-storage][Slow] [Conformance]","[sig-apps] Deployment deployment should delete old replica sets [Conformance]","[k8s.io] Variable Expansion should succeed in writing subpaths in container [sig-storage][Slow] [Conformance]","[k8s.io] Security Context When creating a pod with privileged should run the container as unprivileged when false [LinuxOnly] [NodeConformance] [Conformance]","[sig-node] ConfigMap should be consumable via environment variable [NodeConformance] [Conformance]","[sig-node] ConfigMap should be consumable via the environment [NodeConformance] [Conformance]"]} SSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-storage] ConfigMap /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:57:21.235: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename configmap STEP: Waiting for a default service account to be provisioned in namespace [It] should be consumable from pods in volume with mappings and Item mode set [LinuxOnly] [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating configMap with name configmap-test-volume-map-3e1db833-4007-4522-aa5f-e2efdc14b647 STEP: Creating a pod to test consume configMaps Aug 18 11:57:21.274: INFO: Waiting up to 5m0s for pod "pod-configmaps-34b476ec-bf4c-40a7-aede-3b2616af1bdc" in namespace "configmap-8860" to be "Succeeded or Failed" Aug 18 11:57:21.278: INFO: Pod "pod-configmaps-34b476ec-bf4c-40a7-aede-3b2616af1bdc": Phase="Pending", Reason="", readiness=false. Elapsed: 3.941926ms Aug 18 11:57:23.282: INFO: Pod "pod-configmaps-34b476ec-bf4c-40a7-aede-3b2616af1bdc": Phase="Pending", Reason="", readiness=false. Elapsed: 2.007532855s Aug 18 11:57:25.284: INFO: Pod "pod-configmaps-34b476ec-bf4c-40a7-aede-3b2616af1bdc": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.010165706s STEP: Saw pod success Aug 18 11:57:25.284: INFO: Pod "pod-configmaps-34b476ec-bf4c-40a7-aede-3b2616af1bdc" satisfied condition "Succeeded or Failed" Aug 18 11:57:25.287: INFO: Trying to get logs from node node2 pod pod-configmaps-34b476ec-bf4c-40a7-aede-3b2616af1bdc container configmap-volume-test: STEP: delete the pod Aug 18 11:57:25.305: INFO: Waiting for pod pod-configmaps-34b476ec-bf4c-40a7-aede-3b2616af1bdc to disappear Aug 18 11:57:25.307: INFO: Pod pod-configmaps-34b476ec-bf4c-40a7-aede-3b2616af1bdc no longer exists [AfterEach] [sig-storage] ConfigMap /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:57:25.307: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "configmap-8860" for this suite. • ------------------------------ {"msg":"PASSED [sig-storage] ConfigMap should be consumable from pods in volume with mappings and Item mode set [LinuxOnly] [NodeConformance] [Conformance]","total":-1,"completed":16,"skipped":194,"failed":6,"failures":["[k8s.io] Variable Expansion should verify that a failing subpath expansion can be modified during the lifecycle of a container [sig-storage][Slow] [Conformance]","[sig-apps] Deployment deployment should delete old replica sets [Conformance]","[k8s.io] Variable Expansion should succeed in writing subpaths in container [sig-storage][Slow] [Conformance]","[k8s.io] Security Context When creating a pod with privileged should run the container as unprivileged when false [LinuxOnly] [NodeConformance] [Conformance]","[sig-node] ConfigMap should be consumable via environment variable [NodeConformance] [Conformance]","[sig-node] ConfigMap should be consumable via the environment [NodeConformance] [Conformance]"]} SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-api-machinery] ResourceQuota /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:57:25.408: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename resourcequota STEP: Waiting for a default service account to be provisioned in namespace [It] should create a ResourceQuota and capture the life of a configMap. [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Counting existing ResourceQuota STEP: Creating a ResourceQuota STEP: Ensuring resource quota status is calculated STEP: Creating a ConfigMap STEP: Ensuring resource quota status captures configMap creation STEP: Deleting a ConfigMap STEP: Ensuring resource quota status released usage [AfterEach] [sig-api-machinery] ResourceQuota /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:57:41.460: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "resourcequota-5903" for this suite. • [SLOW TEST:16.061 seconds] [sig-api-machinery] ResourceQuota /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23 should create a ResourceQuota and capture the life of a configMap. [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-api-machinery] ResourceQuota should create a ResourceQuota and capture the life of a configMap. [Conformance]","total":-1,"completed":17,"skipped":239,"failed":6,"failures":["[k8s.io] Variable Expansion should verify that a failing subpath expansion can be modified during the lifecycle of a container [sig-storage][Slow] [Conformance]","[sig-apps] Deployment deployment should delete old replica sets [Conformance]","[k8s.io] Variable Expansion should succeed in writing subpaths in container [sig-storage][Slow] [Conformance]","[k8s.io] Security Context When creating a pod with privileged should run the container as unprivileged when false [LinuxOnly] [NodeConformance] [Conformance]","[sig-node] ConfigMap should be consumable via environment variable [NodeConformance] [Conformance]","[sig-node] ConfigMap should be consumable via the environment [NodeConformance] [Conformance]"]} SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [BeforeEach] [sig-apps] StatefulSet /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:47:34.497: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename statefulset STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-apps] StatefulSet /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/statefulset.go:88 [BeforeEach] [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/statefulset.go:103 STEP: Creating service test in namespace statefulset-6735 [It] Burst scaling should run to completion even with unhealthy pods [Slow] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating stateful set ss in namespace statefulset-6735 STEP: Waiting until all stateful set ss replicas will be running in namespace statefulset-6735 Aug 18 11:47:34.527: INFO: Found 0 stateful pods, waiting for 1 Aug 18 11:47:44.530: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:47:54.532: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:48:04.532: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:48:14.530: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:48:24.530: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:48:34.530: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:48:44.531: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:48:54.532: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:49:04.530: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:49:14.530: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:49:24.531: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:49:34.532: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:49:44.532: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:49:54.530: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:50:04.531: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:50:14.531: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:50:24.530: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:50:34.531: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:50:44.531: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:50:54.530: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:51:04.530: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:51:14.531: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:51:24.531: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:51:34.530: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:51:44.530: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:51:54.530: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:52:04.530: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:52:14.531: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:52:24.530: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:52:34.530: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:52:44.530: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:52:54.530: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:53:04.531: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:53:14.530: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:53:24.530: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:53:34.530: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:53:44.531: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:53:54.532: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:54:04.530: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:54:14.530: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:54:24.530: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:54:34.531: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:54:44.530: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:54:54.530: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:55:04.532: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:55:14.529: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:55:24.530: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:55:34.530: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:55:44.530: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:55:54.531: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:56:04.531: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:56:14.530: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:56:24.531: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:56:34.530: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:56:44.531: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:56:54.530: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:57:04.531: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:57:14.531: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:57:24.530: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:57:34.530: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:57:34.533: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false Aug 18 11:57:34.534: FAIL: Failed waiting for pods to enter running: timed out waiting for the condition Full Stack Trace k8s.io/kubernetes/test/e2e/framework/statefulset.WaitForRunning(0x5410260, 0xc0016cc2c0, 0x100000001, 0xc000bc6500) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/statefulset/wait.go:58 +0x10e k8s.io/kubernetes/test/e2e/framework/statefulset.WaitForRunningAndReady(...) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/statefulset/wait.go:80 k8s.io/kubernetes/test/e2e/apps.glob..func10.2.11() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/statefulset.go:698 +0x395 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc00359cc00) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc00359cc00) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc00359cc00, 0x4deb2c0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/statefulset.go:114 Aug 18 11:57:34.537: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=statefulset-6735 describe po ss-0' Aug 18 11:57:34.728: INFO: stderr: "" Aug 18 11:57:34.728: INFO: stdout: "Name: ss-0\nNamespace: statefulset-6735\nPriority: 0\nNode: node1/10.10.190.207\nStart Time: Wed, 18 Aug 2021 11:47:34 +0000\nLabels: baz=blah\n controller-revision-hash=ss-65c7964b94\n foo=bar\n statefulset.kubernetes.io/pod-name=ss-0\nAnnotations: k8s.v1.cni.cncf.io/network-status:\n [{\n \"name\": \"default-cni-network\",\n \"interface\": \"eth0\",\n \"ips\": [\n \"10.244.4.79\"\n ],\n \"mac\": \"0a:c3:b1:98:a7:f8\",\n \"default\": true,\n \"dns\": {}\n }]\n k8s.v1.cni.cncf.io/networks-status:\n [{\n \"name\": \"default-cni-network\",\n \"interface\": \"eth0\",\n \"ips\": [\n \"10.244.4.79\"\n ],\n \"mac\": \"0a:c3:b1:98:a7:f8\",\n \"default\": true,\n \"dns\": {}\n }]\n kubernetes.io/psp: collectd\nStatus: Pending\nIP: 10.244.4.79\nIPs:\n IP: 10.244.4.79\nControlled By: StatefulSet/ss\nContainers:\n webserver:\n Container ID: \n Image: docker.io/library/httpd:2.4.38-alpine\n Image ID: \n Port: \n Host Port: \n State: Waiting\n Reason: ImagePullBackOff\n Ready: False\n Restart Count: 0\n Readiness: http-get http://:80/index.html delay=0s timeout=1s period=1s #success=1 #failure=1\n Environment: \n Mounts:\n /var/run/secrets/kubernetes.io/serviceaccount from default-token-qllrl (ro)\nConditions:\n Type Status\n Initialized True \n Ready False \n ContainersReady False \n PodScheduled True \nVolumes:\n default-token-qllrl:\n Type: Secret (a volume populated by a Secret)\n SecretName: default-token-qllrl\n Optional: false\nQoS Class: BestEffort\nNode-Selectors: \nTolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s\n node.kubernetes.io/unreachable:NoExecute op=Exists for 300s\nEvents:\n Type Reason Age From Message\n ---- ------ ---- ---- -------\n Normal Scheduled 10m default-scheduler Successfully assigned statefulset-6735/ss-0 to node1\n Normal AddedInterface 9m59s multus Add eth0 [10.244.4.78/24]\n Normal SandboxChanged 9m57s kubelet Pod sandbox changed, it will be killed and re-created.\n Normal AddedInterface 9m55s multus Add eth0 [10.244.4.79/24]\n Normal BackOff 8m43s (x6 over 9m55s) kubelet Back-off pulling image \"docker.io/library/httpd:2.4.38-alpine\"\n Normal Pulling 8m28s (x4 over 9m59s) kubelet Pulling image \"docker.io/library/httpd:2.4.38-alpine\"\n Warning Failed 8m27s (x4 over 9m58s) kubelet Failed to pull image \"docker.io/library/httpd:2.4.38-alpine\": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit\n Warning Failed 8m27s (x4 over 9m58s) kubelet Error: ErrImagePull\n Warning Failed 4m58s (x21 over 9m55s) kubelet Error: ImagePullBackOff\n" Aug 18 11:57:34.728: INFO: Output of kubectl describe ss-0: Name: ss-0 Namespace: statefulset-6735 Priority: 0 Node: node1/10.10.190.207 Start Time: Wed, 18 Aug 2021 11:47:34 +0000 Labels: baz=blah controller-revision-hash=ss-65c7964b94 foo=bar statefulset.kubernetes.io/pod-name=ss-0 Annotations: k8s.v1.cni.cncf.io/network-status: [{ "name": "default-cni-network", "interface": "eth0", "ips": [ "10.244.4.79" ], "mac": "0a:c3:b1:98:a7:f8", "default": true, "dns": {} }] k8s.v1.cni.cncf.io/networks-status: [{ "name": "default-cni-network", "interface": "eth0", "ips": [ "10.244.4.79" ], "mac": "0a:c3:b1:98:a7:f8", "default": true, "dns": {} }] kubernetes.io/psp: collectd Status: Pending IP: 10.244.4.79 IPs: IP: 10.244.4.79 Controlled By: StatefulSet/ss Containers: webserver: Container ID: Image: docker.io/library/httpd:2.4.38-alpine Image ID: Port: Host Port: State: Waiting Reason: ImagePullBackOff Ready: False Restart Count: 0 Readiness: http-get http://:80/index.html delay=0s timeout=1s period=1s #success=1 #failure=1 Environment: Mounts: /var/run/secrets/kubernetes.io/serviceaccount from default-token-qllrl (ro) Conditions: Type Status Initialized True Ready False ContainersReady False PodScheduled True Volumes: default-token-qllrl: Type: Secret (a volume populated by a Secret) SecretName: default-token-qllrl Optional: false QoS Class: BestEffort Node-Selectors: Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s node.kubernetes.io/unreachable:NoExecute op=Exists for 300s Events: Type Reason Age From Message ---- ------ ---- ---- ------- Normal Scheduled 10m default-scheduler Successfully assigned statefulset-6735/ss-0 to node1 Normal AddedInterface 9m59s multus Add eth0 [10.244.4.78/24] Normal SandboxChanged 9m57s kubelet Pod sandbox changed, it will be killed and re-created. Normal AddedInterface 9m55s multus Add eth0 [10.244.4.79/24] Normal BackOff 8m43s (x6 over 9m55s) kubelet Back-off pulling image "docker.io/library/httpd:2.4.38-alpine" Normal Pulling 8m28s (x4 over 9m59s) kubelet Pulling image "docker.io/library/httpd:2.4.38-alpine" Warning Failed 8m27s (x4 over 9m58s) kubelet Failed to pull image "docker.io/library/httpd:2.4.38-alpine": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit Warning Failed 8m27s (x4 over 9m58s) kubelet Error: ErrImagePull Warning Failed 4m58s (x21 over 9m55s) kubelet Error: ImagePullBackOff Aug 18 11:57:34.728: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=statefulset-6735 logs ss-0 --tail=100' Aug 18 11:57:34.891: INFO: rc: 1 Aug 18 11:57:34.891: INFO: Last 100 log lines of ss-0: Aug 18 11:57:34.891: INFO: Deleting all statefulset in ns statefulset-6735 Aug 18 11:57:34.893: INFO: Scaling statefulset ss to 0 Aug 18 11:57:44.905: INFO: Waiting for statefulset status.replicas updated to 0 Aug 18 11:57:44.908: INFO: Deleting statefulset ss [AfterEach] [sig-apps] StatefulSet /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "statefulset-6735". STEP: Found 11 events. Aug 18 11:57:44.921: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for ss-0: { } Scheduled: Successfully assigned statefulset-6735/ss-0 to node1 Aug 18 11:57:44.921: INFO: At 2021-08-18 11:47:34 +0000 UTC - event for ss: {statefulset-controller } SuccessfulCreate: create Pod ss-0 in StatefulSet ss successful Aug 18 11:57:44.921: INFO: At 2021-08-18 11:47:35 +0000 UTC - event for ss-0: {multus } AddedInterface: Add eth0 [10.244.4.78/24] Aug 18 11:57:44.921: INFO: At 2021-08-18 11:47:35 +0000 UTC - event for ss-0: {kubelet node1} Pulling: Pulling image "docker.io/library/httpd:2.4.38-alpine" Aug 18 11:57:44.921: INFO: At 2021-08-18 11:47:36 +0000 UTC - event for ss-0: {kubelet node1} Failed: Error: ErrImagePull Aug 18 11:57:44.921: INFO: At 2021-08-18 11:47:36 +0000 UTC - event for ss-0: {kubelet node1} Failed: Failed to pull image "docker.io/library/httpd:2.4.38-alpine": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit Aug 18 11:57:44.921: INFO: At 2021-08-18 11:47:37 +0000 UTC - event for ss-0: {kubelet node1} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Aug 18 11:57:44.921: INFO: At 2021-08-18 11:47:39 +0000 UTC - event for ss-0: {multus } AddedInterface: Add eth0 [10.244.4.79/24] Aug 18 11:57:44.921: INFO: At 2021-08-18 11:47:39 +0000 UTC - event for ss-0: {kubelet node1} BackOff: Back-off pulling image "docker.io/library/httpd:2.4.38-alpine" Aug 18 11:57:44.921: INFO: At 2021-08-18 11:47:39 +0000 UTC - event for ss-0: {kubelet node1} Failed: Error: ImagePullBackOff Aug 18 11:57:44.921: INFO: At 2021-08-18 11:57:34 +0000 UTC - event for ss: {statefulset-controller } SuccessfulDelete: delete Pod ss-0 in StatefulSet ss successful Aug 18 11:57:44.923: INFO: POD NODE PHASE GRACE CONDITIONS Aug 18 11:57:44.923: INFO: Aug 18 11:57:44.926: INFO: Logging node info for node master1 Aug 18 11:57:44.929: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 ebb211fa-503f-4cfe-b1ed-c95d27a70e6e 76825 0 2021-08-18 08:20:52 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"3a:82:be:72:b5:15"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:20:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:20:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:25:59 +0000 UTC,LastTransitionTime:2021-08-18 08:25:59 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:57:39 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:57:39 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:57:39 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:57:39 +0000 UTC,LastTransitionTime:2021-08-18 08:25:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:58c3e57359b641ad92fa1959f2fecf5d,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:012cd796-2076-45d6-8b14-d3e0451b1e64,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[@ :],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:57:44.929: INFO: Logging kubelet events for node master1 Aug 18 11:57:44.931: INFO: Logging pods the kubelet thinks is on node master1 Aug 18 11:57:44.940: INFO: kube-flannel-q64cq started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:57:44.940: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:57:44.940: INFO: Container kube-flannel ready: true, restart count 3 Aug 18 11:57:44.940: INFO: coredns-7677f9bb54-kn2qg started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:44.940: INFO: Container coredns ready: true, restart count 2 Aug 18 11:57:44.940: INFO: kube-scheduler-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:44.940: INFO: Container kube-scheduler ready: true, restart count 0 Aug 18 11:57:44.940: INFO: kube-apiserver-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:44.940: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:57:44.940: INFO: kube-proxy-vqk4v started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:44.940: INFO: Container kube-proxy ready: true, restart count 1 Aug 18 11:57:44.940: INFO: kube-multus-ds-amd64-kbcp6 started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:44.940: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:57:44.940: INFO: docker-registry-docker-registry-56cbc7bc58-49kl2 started at 2021-08-18 08:26:23 +0000 UTC (0+2 container statuses recorded) Aug 18 11:57:44.940: INFO: Container docker-registry ready: true, restart count 0 Aug 18 11:57:44.940: INFO: Container nginx ready: true, restart count 0 Aug 18 11:57:44.940: INFO: node-exporter-5hwz9 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:57:44.940: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:57:44.940: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:57:44.940: INFO: kube-controller-manager-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:44.940: INFO: Container kube-controller-manager ready: true, restart count 2 W0818 11:57:44.952947 23 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:57:44.981: INFO: Latency metrics for node master1 Aug 18 11:57:44.981: INFO: Logging node info for node master2 Aug 18 11:57:44.984: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 78946293-3abe-4442-84d4-8ed6b1d15ce0 76814 0 2021-08-18 08:21:31 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"7e:f5:c2:cc:3a:b4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:21:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:21:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-08-18 08:29:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:57:38 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:57:38 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:57:38 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:57:38 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0c44122c7a7248c18d8571e1cc667258,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:0cd329f2-48e0-4c8f-b8b9-fa3ae0ed8406,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:57:44.985: INFO: Logging kubelet events for node master2 Aug 18 11:57:44.986: INFO: Logging pods the kubelet thinks is on node master2 Aug 18 11:57:44.994: INFO: kube-multus-ds-amd64-mld8g started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:44.994: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:57:44.994: INFO: dns-autoscaler-5b7b5c9b6f-hh47r started at 2021-08-18 08:23:57 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:44.994: INFO: Container autoscaler ready: true, restart count 2 Aug 18 11:57:44.994: INFO: node-feature-discovery-controller-5bf5c49849-mq57c started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:44.994: INFO: Container nfd-controller ready: true, restart count 0 Aug 18 11:57:44.994: INFO: node-exporter-48nfx started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:57:44.994: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:57:44.994: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:57:44.994: INFO: kube-apiserver-master2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:44.994: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:57:44.994: INFO: kube-scheduler-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:44.994: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:57:44.994: INFO: kube-flannel-pp56h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:57:44.994: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:57:44.994: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:57:44.994: INFO: kube-controller-manager-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:44.994: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:57:44.994: INFO: kube-proxy-kh2l9 started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:44.994: INFO: Container kube-proxy ready: true, restart count 2 W0818 11:57:45.008041 23 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:57:45.038: INFO: Latency metrics for node master2 Aug 18 11:57:45.038: INFO: Logging node info for node master3 Aug 18 11:57:45.041: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 44feac2b-9447-4be2-9fcd-62f836d67c72 76902 0 2021-08-18 08:21:41 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"86:e4:31:99:58:40"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {kubelet Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:57:43 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:57:43 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:57:43 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:57:43 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1fae19ae59884c44899bcd08aa243244,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:5db926c5-6530-4635-a0d5-806974a3b732,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:57:45.041: INFO: Logging kubelet events for node master3 Aug 18 11:57:45.044: INFO: Logging pods the kubelet thinks is on node master3 Aug 18 11:57:45.052: INFO: kube-multus-ds-amd64-bkw6c started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:45.052: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:57:45.052: INFO: coredns-7677f9bb54-5hxfh started at 2021-08-18 08:23:54 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:45.052: INFO: Container coredns ready: true, restart count 1 Aug 18 11:57:45.052: INFO: node-exporter-vq7d8 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:57:45.052: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:57:45.052: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:57:45.052: INFO: kube-controller-manager-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:45.052: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:57:45.052: INFO: kube-scheduler-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:45.052: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:57:45.052: INFO: kube-apiserver-master3 started at 2021-08-18 08:29:12 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:45.052: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:57:45.052: INFO: kube-proxy-sd5lc started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:45.052: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:57:45.052: INFO: kube-flannel-x6tlr started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:57:45.053: INFO: Init container install-cni ready: true, restart count 1 Aug 18 11:57:45.053: INFO: Container kube-flannel ready: true, restart count 1 W0818 11:57:45.064317 23 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:57:45.092: INFO: Latency metrics for node master3 Aug 18 11:57:45.092: INFO: Logging node info for node node1 Aug 18 11:57:45.096: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 84defabd-6ebf-43ec-a629-44c6713da9c9 76828 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"9a:87:55:36:7b:df"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:13 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:35 +0000 UTC,LastTransitionTime:2021-08-18 08:26:35 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:57:39 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:57:39 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:57:39 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:57:39 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:69946ff2b7bc462fa25eb7adb4703c23,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:736dc52f-f5e3-494e-86ca-01eedbea015c,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:a7cea43d9d2f67c38fbf0407786edbe660ee9072945f7bb272b55fd255e8eaca opnfv/barometer-collectd:stable],SizeBytes:1075746799,},ContainerImage{Names:[@ :],SizeBytes:1003788820,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[aquasec/kube-hunter@sha256:2be6820bc1d7e0f57193a9a27d5a3e16b2fd93c53747b03ce8ca48c6fc323781 aquasec/kube-hunter:0.3.1],SizeBytes:347611549,},ContainerImage{Names:[golang@sha256:db2475a1dbb2149508e5db31d7d77a75e6600d54be645f37681f03f2762169ba golang:alpine3.12],SizeBytes:301186719,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:de25c7fc6c4f3a27c7f0c2dff454e4671823a34d88abd533f210848d527e0fbb alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:57:45.096: INFO: Logging kubelet events for node node1 Aug 18 11:57:45.099: INFO: Logging pods the kubelet thinks is on node node1 Aug 18 11:57:45.116: INFO: webserver-deployment-dd94f59b7-dqt7r started at 2021-08-18 11:56:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:45.116: INFO: Container httpd ready: false, restart count 0 Aug 18 11:57:45.116: INFO: webserver-deployment-dd94f59b7-x65jh started at 2021-08-18 11:56:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:45.116: INFO: Container httpd ready: false, restart count 0 Aug 18 11:57:45.116: INFO: cmk-init-discover-node1-bxznx started at 2021-08-18 08:32:10 +0000 UTC (0+3 container statuses recorded) Aug 18 11:57:45.116: INFO: Container discover ready: false, restart count 0 Aug 18 11:57:45.116: INFO: Container init ready: false, restart count 0 Aug 18 11:57:45.116: INFO: Container install ready: false, restart count 0 Aug 18 11:57:45.116: INFO: collectd-xdprr started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:57:45.116: INFO: Container collectd ready: true, restart count 0 Aug 18 11:57:45.116: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:57:45.116: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:57:45.116: INFO: webserver-deployment-dd94f59b7-dbsxb started at 2021-08-18 11:56:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:45.116: INFO: Container httpd ready: false, restart count 0 Aug 18 11:57:45.116: INFO: simpletest.rc-pkcsq started at 2021-08-18 11:56:50 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:45.116: INFO: Container nginx ready: false, restart count 0 Aug 18 11:57:45.116: INFO: webserver-deployment-dd94f59b7-h8pvd started at 2021-08-18 11:56:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:45.116: INFO: Container httpd ready: false, restart count 0 Aug 18 11:57:45.116: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-vsxvg started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:45.116: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:57:45.116: INFO: downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c started at 2021-08-18 11:55:49 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:45.116: INFO: Container dapi-container ready: false, restart count 0 Aug 18 11:57:45.116: INFO: kube-flannel-q78nd started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:57:45.117: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:57:45.117: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:57:45.117: INFO: prometheus-k8s-0 started at 2021-08-18 08:34:03 +0000 UTC (0+5 container statuses recorded) Aug 18 11:57:45.117: INFO: Container custom-metrics-apiserver ready: true, restart count 0 Aug 18 11:57:45.117: INFO: Container grafana ready: true, restart count 0 Aug 18 11:57:45.117: INFO: Container prometheus ready: true, restart count 1 Aug 18 11:57:45.117: INFO: Container prometheus-config-reloader ready: true, restart count 0 Aug 18 11:57:45.117: INFO: Container rules-configmap-reloader ready: true, restart count 0 Aug 18 11:57:45.117: INFO: simpletest.rc-6vlbj started at 2021-08-18 11:56:50 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:45.117: INFO: Container nginx ready: false, restart count 0 Aug 18 11:57:45.117: INFO: webserver-deployment-dd94f59b7-rws9q started at 2021-08-18 11:56:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:45.117: INFO: Container httpd ready: false, restart count 0 Aug 18 11:57:45.117: INFO: simpletest.rc-v7qrv started at 2021-08-18 11:56:50 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:45.117: INFO: Container nginx ready: false, restart count 0 Aug 18 11:57:45.117: INFO: simpletest.rc-dhc6q started at 2021-08-18 11:56:50 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:45.117: INFO: Container nginx ready: false, restart count 0 Aug 18 11:57:45.117: INFO: kube-proxy-p6jvp started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:45.117: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:57:45.117: INFO: kubernetes-metrics-scraper-678c97765c-9nsv5 started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:45.117: INFO: Container kubernetes-metrics-scraper ready: true, restart count 2 Aug 18 11:57:45.117: INFO: cmk-d8r27 started at 2021-08-18 08:32:52 +0000 UTC (0+2 container statuses recorded) Aug 18 11:57:45.117: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:57:45.117: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:57:45.117: INFO: nginx-proxy-node1 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:45.117: INFO: Container nginx-proxy ready: true, restart count 2 Aug 18 11:57:45.117: INFO: foo-xpsfd started at 2021-08-18 11:53:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:45.117: INFO: Container c ready: false, restart count 0 Aug 18 11:57:45.117: INFO: server-envvars-dcc91a28-e119-476f-ad7b-86dc853ddeb4 started at 2021-08-18 11:52:28 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:45.117: INFO: Container srv ready: true, restart count 0 Aug 18 11:57:45.117: INFO: externalname-service-mlvh7 started at 2021-08-18 11:56:20 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:45.117: INFO: Container externalname-service ready: true, restart count 0 Aug 18 11:57:45.117: INFO: simpletest.rc-l2xlg started at 2021-08-18 11:56:50 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:45.117: INFO: Container nginx ready: false, restart count 0 Aug 18 11:57:45.117: INFO: kube-multus-ds-amd64-rrvmb started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:45.117: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:57:45.117: INFO: node-feature-discovery-worker-pflgw started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:45.117: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:57:45.117: INFO: node-exporter-kcwvn started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:57:45.117: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:57:45.117: INFO: Container node-exporter ready: true, restart count 0 W0818 11:57:45.129749 23 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:57:45.160: INFO: Latency metrics for node node1 Aug 18 11:57:45.160: INFO: Logging node info for node node2 Aug 18 11:57:45.162: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 1d01177e-3dbb-48a1-a0bc-d18af27ab7f8 76885 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:d1:47:f8:1d:22"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:36 +0000 UTC,LastTransitionTime:2021-08-18 08:26:36 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:57:42 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:57:42 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:57:42 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:57:42 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:dc1f286135c145349b8a016880b65a2f,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:037e7e2d-94e9-42f4-a719-896e5005ac70,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:57:45.162: INFO: Logging kubelet events for node node2 Aug 18 11:57:45.164: INFO: Logging pods the kubelet thinks is on node node2 Aug 18 11:57:45.182: INFO: kube-flannel-h7t5h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:57:45.182: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:57:45.182: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:57:45.182: INFO: node-exporter-lrrf2 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:57:45.183: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:57:45.183: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:57:45.183: INFO: simpletest.rc-qrd85 started at 2021-08-18 11:56:50 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:45.183: INFO: Container nginx ready: false, restart count 0 Aug 18 11:57:45.183: INFO: webserver-deployment-dd94f59b7-g45zh started at 2021-08-18 11:56:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:45.183: INFO: Container httpd ready: false, restart count 0 Aug 18 11:57:45.183: INFO: foo-mcmfh started at 2021-08-18 11:53:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:45.183: INFO: Container c ready: false, restart count 0 Aug 18 11:57:45.183: INFO: nginx-proxy-node2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:45.183: INFO: Container nginx-proxy ready: true, restart count 1 Aug 18 11:57:45.183: INFO: cmk-init-discover-node2-6b2kz started at 2021-08-18 08:32:30 +0000 UTC (0+3 container statuses recorded) Aug 18 11:57:45.183: INFO: Container discover ready: false, restart count 0 Aug 18 11:57:45.183: INFO: Container init ready: false, restart count 0 Aug 18 11:57:45.183: INFO: Container install ready: false, restart count 0 Aug 18 11:57:45.183: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-7rn45 started at 2021-08-18 08:36:42 +0000 UTC (0+2 container statuses recorded) Aug 18 11:57:45.183: INFO: Container tas-controller ready: true, restart count 0 Aug 18 11:57:45.183: INFO: Container tas-extender ready: true, restart count 0 Aug 18 11:57:45.183: INFO: pod-update-399ed819-acd4-424c-8e46-fca448681026 started at 2021-08-18 11:53:12 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:45.183: INFO: Container nginx ready: false, restart count 0 Aug 18 11:57:45.183: INFO: simpletest.rc-6zlz2 started at 2021-08-18 11:56:50 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:45.183: INFO: Container nginx ready: false, restart count 0 Aug 18 11:57:45.183: INFO: webserver-deployment-dd94f59b7-ttks8 started at 2021-08-18 11:56:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:45.183: INFO: Container httpd ready: false, restart count 0 Aug 18 11:57:45.183: INFO: kubernetes-dashboard-86c6f9df5b-qrtdk started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:45.183: INFO: Container kubernetes-dashboard ready: true, restart count 2 Aug 18 11:57:45.183: INFO: webserver-deployment-dd94f59b7-4pbnc started at 2021-08-18 11:56:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:45.183: INFO: Container httpd ready: false, restart count 0 Aug 18 11:57:45.183: INFO: busybox-3dfd903c-68f3-48ac-a884-dd6ba807fca5 started at 2021-08-18 11:52:58 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:45.183: INFO: Container busybox ready: false, restart count 0 Aug 18 11:57:45.183: INFO: webserver-deployment-dd94f59b7-qmb69 started at 2021-08-18 11:56:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:45.183: INFO: Container httpd ready: false, restart count 0 Aug 18 11:57:45.183: INFO: webserver-deployment-dd94f59b7-bvwxs started at 2021-08-18 11:56:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:45.183: INFO: Container httpd ready: false, restart count 0 Aug 18 11:57:45.183: INFO: cmk-748rz started at 2021-08-18 08:32:53 +0000 UTC (0+2 container statuses recorded) Aug 18 11:57:45.183: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:57:45.183: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:57:45.183: INFO: externalname-service-9x22f started at 2021-08-18 11:56:20 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:45.183: INFO: Container externalname-service ready: true, restart count 0 Aug 18 11:57:45.183: INFO: execpodxr7sj started at 2021-08-18 11:56:26 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:45.183: INFO: Container agnhost-container ready: true, restart count 0 Aug 18 11:57:45.183: INFO: kube-proxy-qkj9c started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:45.183: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:57:45.183: INFO: node-feature-discovery-worker-hzpf5 started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:45.183: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:57:45.183: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-c82pt started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:45.183: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:57:45.183: INFO: prometheus-operator-5bb8cb9d8f-k97ws started at 2021-08-18 08:33:38 +0000 UTC (0+2 container statuses recorded) Aug 18 11:57:45.183: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:57:45.183: INFO: Container prometheus-operator ready: true, restart count 0 Aug 18 11:57:45.183: INFO: simpletest.rc-cwkg7 started at 2021-08-18 11:56:50 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:45.183: INFO: Container nginx ready: false, restart count 0 Aug 18 11:57:45.183: INFO: kube-multus-ds-amd64-rvzsg started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:45.183: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:57:45.183: INFO: collectd-67ntq started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:57:45.183: INFO: Container collectd ready: true, restart count 0 Aug 18 11:57:45.183: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:57:45.183: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:57:45.183: INFO: simpletest.rc-rgnt2 started at 2021-08-18 11:56:50 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:45.183: INFO: Container nginx ready: false, restart count 0 Aug 18 11:57:45.183: INFO: simpletest.rc-zqlmq started at 2021-08-18 11:56:50 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:45.183: INFO: Container nginx ready: false, restart count 0 Aug 18 11:57:45.183: INFO: cmk-webhook-6c9d5f8578-7cxjr started at 2021-08-18 08:32:53 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:45.183: INFO: Container cmk-webhook ready: true, restart count 0 Aug 18 11:57:45.183: INFO: client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419 started at 2021-08-18 11:57:37 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:45.183: INFO: Container env3cont ready: false, restart count 0 Aug 18 11:57:45.183: INFO: dns-1310 started at 2021-08-18 11:57:41 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:45.183: INFO: Container agnhost ready: false, restart count 0 W0818 11:57:45.196834 23 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:57:45.255: INFO: Latency metrics for node node2 Aug 18 11:57:45.255: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "statefulset-6735" for this suite. • Failure [610.767 seconds] [sig-apps] StatefulSet /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/framework.go:23 [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 Burst scaling should run to completion even with unhealthy pods [Slow] [Conformance] [It] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:57:34.534: Failed waiting for pods to enter running: timed out waiting for the condition /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/statefulset/wait.go:58 ------------------------------ {"msg":"FAILED [sig-apps] StatefulSet [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] Burst scaling should run to completion even with unhealthy pods [Slow] [Conformance]","total":-1,"completed":12,"skipped":329,"failed":6,"failures":["[sig-apps] StatefulSet [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] Should recreate evicted statefulset [Conformance]","[sig-node] Downward API should provide pod UID as env vars [NodeConformance] [Conformance]","[sig-apps] ReplicationController should adopt matching pods on creation [Conformance]","[sig-apps] ReplicaSet should adopt matching pods on creation and release no longer matching pods [Conformance]","[k8s.io] InitContainer [NodeConformance] should not start app containers and fail the pod if init containers fail on a RestartNever pod [Conformance]","[sig-apps] StatefulSet [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] Burst scaling should run to completion even with unhealthy pods [Slow] [Conformance]"]} SSSSSS ------------------------------ [BeforeEach] [sig-network] DNS /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:57:41.552: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename dns STEP: Waiting for a default service account to be provisioned in namespace [It] should support configurable pod DNS nameservers [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating a pod with dnsPolicy=None and customized dnsConfig... Aug 18 11:57:41.588: INFO: Created pod &Pod{ObjectMeta:{dns-1310 dns-1310 /api/v1/namespaces/dns-1310/pods/dns-1310 cf765863-0992-4558-89a2-b33f38a37878 76867 0 2021-08-18 11:57:41 +0000 UTC map[] map[kubernetes.io/psp:collectd] [] [] [{e2e.test Update v1 2021-08-18 11:57:41 +0000 UTC FieldsV1 {"f:spec":{"f:containers":{"k:{\"name\":\"agnhost\"}":{".":{},"f:args":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsConfig":{".":{},"f:nameservers":{},"f:searches":{}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:default-token-d76kf,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:&SecretVolumeSource{SecretName:default-token-d76kf,Items:[]KeyToPath{},DefaultMode:*420,Optional:nil,},NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:agnhost,Image:k8s.gcr.io/e2e-test-images/agnhost:2.20,Command:[],Args:[pause],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:default-token-d76kf,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:Always,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*0,ActiveDeadlineSeconds:nil,DNSPolicy:None,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:&PodDNSConfig{Nameservers:[1.1.1.1],Searches:[resolv.conf.local],Options:[]PodDNSConfigOption{},},ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,},Status:PodStatus{Phase:Pending,Conditions:[]PodCondition{},Message:,Reason:,HostIP:,PodIP:,StartTime:,ContainerStatuses:[]ContainerStatus{},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{},EphemeralContainerStatuses:[]ContainerStatus{},},} Aug 18 11:57:41.590: INFO: The status of Pod dns-1310 is Pending, waiting for it to be Running (with Ready = true) Aug 18 11:57:43.593: INFO: The status of Pod dns-1310 is Pending, waiting for it to be Running (with Ready = true) Aug 18 11:57:45.594: INFO: The status of Pod dns-1310 is Pending, waiting for it to be Running (with Ready = true) Aug 18 11:57:47.594: INFO: The status of Pod dns-1310 is Pending, waiting for it to be Running (with Ready = true) Aug 18 11:57:49.594: INFO: The status of Pod dns-1310 is Running (Ready = true) STEP: Verifying customized DNS suffix list is configured on pod... Aug 18 11:57:49.594: INFO: ExecWithOptions {Command:[/agnhost dns-suffix] Namespace:dns-1310 PodName:dns-1310 ContainerName:agnhost Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:false} Aug 18 11:57:49.594: INFO: >>> kubeConfig: /root/.kube/config STEP: Verifying customized DNS server is configured on pod... Aug 18 11:57:49.717: INFO: ExecWithOptions {Command:[/agnhost dns-server-list] Namespace:dns-1310 PodName:dns-1310 ContainerName:agnhost Stdin: CaptureStdout:true CaptureStderr:true PreserveWhitespace:false} Aug 18 11:57:49.717: INFO: >>> kubeConfig: /root/.kube/config Aug 18 11:57:49.831: INFO: Deleting pod dns-1310... [AfterEach] [sig-network] DNS /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:57:49.838: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "dns-1310" for this suite. • [SLOW TEST:8.293 seconds] [sig-network] DNS /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/framework.go:23 should support configurable pod DNS nameservers [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-network] DNS should support configurable pod DNS nameservers [Conformance]","total":-1,"completed":18,"skipped":280,"failed":6,"failures":["[k8s.io] Variable Expansion should verify that a failing subpath expansion can be modified during the lifecycle of a container [sig-storage][Slow] [Conformance]","[sig-apps] Deployment deployment should delete old replica sets [Conformance]","[k8s.io] Variable Expansion should succeed in writing subpaths in container [sig-storage][Slow] [Conformance]","[k8s.io] Security Context When creating a pod with privileged should run the container as unprivileged when false [LinuxOnly] [NodeConformance] [Conformance]","[sig-node] ConfigMap should be consumable via environment variable [NodeConformance] [Conformance]","[sig-node] ConfigMap should be consumable via the environment [NodeConformance] [Conformance]"]} SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ Aug 18 11:57:49.912: INFO: Running AfterSuite actions on all nodes [BeforeEach] [k8s.io] Probing container /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:52:58.547: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename container-probe STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [k8s.io] Probing container /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:54 [It] should *not* be restarted with a exec "cat /tmp/health" liveness probe [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating pod busybox-3dfd903c-68f3-48ac-a884-dd6ba807fca5 in namespace container-probe-5430 Aug 18 11:57:58.591: FAIL: starting pod busybox-3dfd903c-68f3-48ac-a884-dd6ba807fca5 in namespace container-probe-5430 Unexpected error: <*errors.errorString | 0xc0003001f0>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/common.RunLivenessTest(0xc000aa3e40, 0xc003d1c000, 0x0, 0x37e11d6000) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:426 +0x4b9 k8s.io/kubernetes/test/e2e/common.glob..func3.5() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:146 +0x197 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc003198780) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc003198780) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc003198780, 0x4deb2c0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 STEP: deleting the pod [AfterEach] [k8s.io] Probing container /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "container-probe-5430". STEP: Found 7 events. Aug 18 11:57:58.604: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for busybox-3dfd903c-68f3-48ac-a884-dd6ba807fca5: { } Scheduled: Successfully assigned container-probe-5430/busybox-3dfd903c-68f3-48ac-a884-dd6ba807fca5 to node2 Aug 18 11:57:58.604: INFO: At 2021-08-18 11:53:00 +0000 UTC - event for busybox-3dfd903c-68f3-48ac-a884-dd6ba807fca5: {multus } AddedInterface: Add eth0 [10.244.3.104/24] Aug 18 11:57:58.604: INFO: At 2021-08-18 11:53:00 +0000 UTC - event for busybox-3dfd903c-68f3-48ac-a884-dd6ba807fca5: {kubelet node2} Pulling: Pulling image "docker.io/library/busybox:1.29" Aug 18 11:57:58.604: INFO: At 2021-08-18 11:53:01 +0000 UTC - event for busybox-3dfd903c-68f3-48ac-a884-dd6ba807fca5: {kubelet node2} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit Aug 18 11:57:58.604: INFO: At 2021-08-18 11:53:01 +0000 UTC - event for busybox-3dfd903c-68f3-48ac-a884-dd6ba807fca5: {kubelet node2} Failed: Error: ErrImagePull Aug 18 11:57:58.604: INFO: At 2021-08-18 11:53:02 +0000 UTC - event for busybox-3dfd903c-68f3-48ac-a884-dd6ba807fca5: {kubelet node2} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" Aug 18 11:57:58.604: INFO: At 2021-08-18 11:53:02 +0000 UTC - event for busybox-3dfd903c-68f3-48ac-a884-dd6ba807fca5: {kubelet node2} Failed: Error: ImagePullBackOff Aug 18 11:57:58.606: INFO: POD NODE PHASE GRACE CONDITIONS Aug 18 11:57:58.606: INFO: Aug 18 11:57:58.610: INFO: Logging node info for node master1 Aug 18 11:57:58.613: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 ebb211fa-503f-4cfe-b1ed-c95d27a70e6e 77006 0 2021-08-18 08:20:52 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"3a:82:be:72:b5:15"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:20:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:20:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:25:59 +0000 UTC,LastTransitionTime:2021-08-18 08:25:59 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:57:49 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:57:49 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:57:49 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:57:49 +0000 UTC,LastTransitionTime:2021-08-18 08:25:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:58c3e57359b641ad92fa1959f2fecf5d,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:012cd796-2076-45d6-8b14-d3e0451b1e64,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[@ :],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:57:58.613: INFO: Logging kubelet events for node master1 Aug 18 11:57:58.615: INFO: Logging pods the kubelet thinks is on node master1 Aug 18 11:57:58.624: INFO: kube-controller-manager-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:58.624: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:57:58.624: INFO: kube-multus-ds-amd64-kbcp6 started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:58.624: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:57:58.624: INFO: docker-registry-docker-registry-56cbc7bc58-49kl2 started at 2021-08-18 08:26:23 +0000 UTC (0+2 container statuses recorded) Aug 18 11:57:58.624: INFO: Container docker-registry ready: true, restart count 0 Aug 18 11:57:58.624: INFO: Container nginx ready: true, restart count 0 Aug 18 11:57:58.624: INFO: node-exporter-5hwz9 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:57:58.624: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:57:58.624: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:57:58.624: INFO: kube-apiserver-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:58.624: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:57:58.624: INFO: kube-proxy-vqk4v started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:58.624: INFO: Container kube-proxy ready: true, restart count 1 Aug 18 11:57:58.624: INFO: kube-flannel-q64cq started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:57:58.624: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:57:58.624: INFO: Container kube-flannel ready: true, restart count 3 Aug 18 11:57:58.624: INFO: coredns-7677f9bb54-kn2qg started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:58.624: INFO: Container coredns ready: true, restart count 2 Aug 18 11:57:58.624: INFO: kube-scheduler-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:58.624: INFO: Container kube-scheduler ready: true, restart count 0 W0818 11:57:58.636928 28 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:57:58.660: INFO: Latency metrics for node master1 Aug 18 11:57:58.660: INFO: Logging node info for node master2 Aug 18 11:57:58.662: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 78946293-3abe-4442-84d4-8ed6b1d15ce0 77113 0 2021-08-18 08:21:31 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"7e:f5:c2:cc:3a:b4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:21:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:21:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-08-18 08:29:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:57:58 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:57:58 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:57:58 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:57:58 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0c44122c7a7248c18d8571e1cc667258,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:0cd329f2-48e0-4c8f-b8b9-fa3ae0ed8406,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:57:58.663: INFO: Logging kubelet events for node master2 Aug 18 11:57:58.666: INFO: Logging pods the kubelet thinks is on node master2 Aug 18 11:57:58.675: INFO: kube-scheduler-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:58.675: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:57:58.675: INFO: kube-multus-ds-amd64-mld8g started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:58.675: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:57:58.675: INFO: dns-autoscaler-5b7b5c9b6f-hh47r started at 2021-08-18 08:23:57 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:58.675: INFO: Container autoscaler ready: true, restart count 2 Aug 18 11:57:58.675: INFO: node-feature-discovery-controller-5bf5c49849-mq57c started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:58.675: INFO: Container nfd-controller ready: true, restart count 0 Aug 18 11:57:58.675: INFO: node-exporter-48nfx started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:57:58.675: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:57:58.675: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:57:58.675: INFO: kube-apiserver-master2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:58.675: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:57:58.675: INFO: kube-proxy-kh2l9 started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:58.675: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:57:58.675: INFO: kube-flannel-pp56h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:57:58.675: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:57:58.675: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:57:58.675: INFO: kube-controller-manager-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:58.675: INFO: Container kube-controller-manager ready: true, restart count 2 W0818 11:57:58.687682 28 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:57:58.711: INFO: Latency metrics for node master2 Aug 18 11:57:58.711: INFO: Logging node info for node master3 Aug 18 11:57:58.715: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 44feac2b-9447-4be2-9fcd-62f836d67c72 77068 0 2021-08-18 08:21:41 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"86:e4:31:99:58:40"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {kubelet Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:57:53 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:57:53 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:57:53 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:57:53 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1fae19ae59884c44899bcd08aa243244,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:5db926c5-6530-4635-a0d5-806974a3b732,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:57:58.715: INFO: Logging kubelet events for node master3 Aug 18 11:57:58.718: INFO: Logging pods the kubelet thinks is on node master3 Aug 18 11:57:58.726: INFO: kube-proxy-sd5lc started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:58.726: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:57:58.726: INFO: kube-flannel-x6tlr started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:57:58.726: INFO: Init container install-cni ready: true, restart count 1 Aug 18 11:57:58.726: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:57:58.726: INFO: kube-multus-ds-amd64-bkw6c started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:58.726: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:57:58.726: INFO: coredns-7677f9bb54-5hxfh started at 2021-08-18 08:23:54 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:58.726: INFO: Container coredns ready: true, restart count 1 Aug 18 11:57:58.726: INFO: node-exporter-vq7d8 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:57:58.726: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:57:58.726: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:57:58.726: INFO: kube-controller-manager-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:58.726: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:57:58.726: INFO: kube-scheduler-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:58.726: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:57:58.726: INFO: kube-apiserver-master3 started at 2021-08-18 08:29:12 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:58.726: INFO: Container kube-apiserver ready: true, restart count 0 W0818 11:57:58.738285 28 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:57:58.761: INFO: Latency metrics for node master3 Aug 18 11:57:58.762: INFO: Logging node info for node node1 Aug 18 11:57:58.764: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 84defabd-6ebf-43ec-a629-44c6713da9c9 77011 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"9a:87:55:36:7b:df"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:13 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:35 +0000 UTC,LastTransitionTime:2021-08-18 08:26:35 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:57:49 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:57:49 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:57:49 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:57:49 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:69946ff2b7bc462fa25eb7adb4703c23,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:736dc52f-f5e3-494e-86ca-01eedbea015c,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:a7cea43d9d2f67c38fbf0407786edbe660ee9072945f7bb272b55fd255e8eaca opnfv/barometer-collectd:stable],SizeBytes:1075746799,},ContainerImage{Names:[@ :],SizeBytes:1003788820,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[aquasec/kube-hunter@sha256:2be6820bc1d7e0f57193a9a27d5a3e16b2fd93c53747b03ce8ca48c6fc323781 aquasec/kube-hunter:0.3.1],SizeBytes:347611549,},ContainerImage{Names:[golang@sha256:db2475a1dbb2149508e5db31d7d77a75e6600d54be645f37681f03f2762169ba golang:alpine3.12],SizeBytes:301186719,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:de25c7fc6c4f3a27c7f0c2dff454e4671823a34d88abd533f210848d527e0fbb alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:57:58.765: INFO: Logging kubelet events for node node1 Aug 18 11:57:58.767: INFO: Logging pods the kubelet thinks is on node node1 Aug 18 11:57:58.785: INFO: simpletest.rc-6vlbj started at 2021-08-18 11:56:50 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:58.785: INFO: Container nginx ready: false, restart count 0 Aug 18 11:57:58.785: INFO: kube-flannel-q78nd started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:57:58.785: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:57:58.785: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:57:58.785: INFO: prometheus-k8s-0 started at 2021-08-18 08:34:03 +0000 UTC (0+5 container statuses recorded) Aug 18 11:57:58.785: INFO: Container custom-metrics-apiserver ready: true, restart count 0 Aug 18 11:57:58.785: INFO: Container grafana ready: true, restart count 0 Aug 18 11:57:58.785: INFO: Container prometheus ready: true, restart count 1 Aug 18 11:57:58.785: INFO: Container prometheus-config-reloader ready: true, restart count 0 Aug 18 11:57:58.785: INFO: Container rules-configmap-reloader ready: true, restart count 0 Aug 18 11:57:58.785: INFO: simpletest.rc-v7qrv started at 2021-08-18 11:56:50 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:58.785: INFO: Container nginx ready: false, restart count 0 Aug 18 11:57:58.785: INFO: webserver-deployment-dd94f59b7-rws9q started at 2021-08-18 11:56:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:58.785: INFO: Container httpd ready: false, restart count 0 Aug 18 11:57:58.785: INFO: cmk-d8r27 started at 2021-08-18 08:32:52 +0000 UTC (0+2 container statuses recorded) Aug 18 11:57:58.785: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:57:58.785: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:57:58.785: INFO: simpletest.rc-dhc6q started at 2021-08-18 11:56:50 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:58.785: INFO: Container nginx ready: false, restart count 0 Aug 18 11:57:58.785: INFO: kube-proxy-p6jvp started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:58.785: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:57:58.785: INFO: kubernetes-metrics-scraper-678c97765c-9nsv5 started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:58.785: INFO: Container kubernetes-metrics-scraper ready: true, restart count 2 Aug 18 11:57:58.785: INFO: nginx-proxy-node1 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:58.785: INFO: Container nginx-proxy ready: true, restart count 2 Aug 18 11:57:58.785: INFO: node-exporter-kcwvn started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:57:58.785: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:57:58.785: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:57:58.785: INFO: foo-xpsfd started at 2021-08-18 11:53:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:58.785: INFO: Container c ready: false, restart count 0 Aug 18 11:57:58.785: INFO: server-envvars-dcc91a28-e119-476f-ad7b-86dc853ddeb4 started at 2021-08-18 11:52:28 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:58.785: INFO: Container srv ready: true, restart count 0 Aug 18 11:57:58.785: INFO: externalname-service-mlvh7 started at 2021-08-18 11:56:20 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:58.785: INFO: Container externalname-service ready: true, restart count 0 Aug 18 11:57:58.785: INFO: simpletest.rc-l2xlg started at 2021-08-18 11:56:50 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:58.785: INFO: Container nginx ready: false, restart count 0 Aug 18 11:57:58.785: INFO: kube-multus-ds-amd64-rrvmb started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:58.785: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:57:58.785: INFO: node-feature-discovery-worker-pflgw started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:58.785: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:57:58.785: INFO: webserver-deployment-dd94f59b7-dbsxb started at 2021-08-18 11:56:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:58.785: INFO: Container httpd ready: false, restart count 0 Aug 18 11:57:58.785: INFO: webserver-deployment-dd94f59b7-dqt7r started at 2021-08-18 11:56:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:58.785: INFO: Container httpd ready: false, restart count 0 Aug 18 11:57:58.785: INFO: webserver-deployment-dd94f59b7-x65jh started at 2021-08-18 11:56:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:58.785: INFO: Container httpd ready: false, restart count 0 Aug 18 11:57:58.785: INFO: simpletest.deployment-7f7555f8bc-cxqff started at 2021-08-18 11:57:46 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:58.785: INFO: Container nginx ready: false, restart count 0 Aug 18 11:57:58.785: INFO: cmk-init-discover-node1-bxznx started at 2021-08-18 08:32:10 +0000 UTC (0+3 container statuses recorded) Aug 18 11:57:58.785: INFO: Container discover ready: false, restart count 0 Aug 18 11:57:58.785: INFO: Container init ready: false, restart count 0 Aug 18 11:57:58.785: INFO: Container install ready: false, restart count 0 Aug 18 11:57:58.785: INFO: collectd-xdprr started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:57:58.785: INFO: Container collectd ready: true, restart count 0 Aug 18 11:57:58.785: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:57:58.785: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:57:58.785: INFO: simpletest.rc-pkcsq started at 2021-08-18 11:56:50 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:58.785: INFO: Container nginx ready: false, restart count 0 Aug 18 11:57:58.785: INFO: webserver-deployment-dd94f59b7-h8pvd started at 2021-08-18 11:56:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:58.785: INFO: Container httpd ready: false, restart count 0 Aug 18 11:57:58.785: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-vsxvg started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:58.785: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:57:58.785: INFO: downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c started at 2021-08-18 11:55:49 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:58.785: INFO: Container dapi-container ready: false, restart count 0 W0818 11:57:58.798288 28 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:57:58.830: INFO: Latency metrics for node node1 Aug 18 11:57:58.830: INFO: Logging node info for node node2 Aug 18 11:57:58.832: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 1d01177e-3dbb-48a1-a0bc-d18af27ab7f8 77056 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:d1:47:f8:1d:22"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:36 +0000 UTC,LastTransitionTime:2021-08-18 08:26:36 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:57:52 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:57:52 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:57:52 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:57:52 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:dc1f286135c145349b8a016880b65a2f,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:037e7e2d-94e9-42f4-a719-896e5005ac70,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:57:58.833: INFO: Logging kubelet events for node node2 Aug 18 11:57:58.836: INFO: Logging pods the kubelet thinks is on node node2 Aug 18 11:57:58.905: INFO: cmk-webhook-6c9d5f8578-7cxjr started at 2021-08-18 08:32:53 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:58.905: INFO: Container cmk-webhook ready: true, restart count 0 Aug 18 11:57:58.905: INFO: client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419 started at 2021-08-18 11:57:37 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:58.905: INFO: Container env3cont ready: false, restart count 0 Aug 18 11:57:58.905: INFO: foo-mcmfh started at 2021-08-18 11:53:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:58.905: INFO: Container c ready: false, restart count 0 Aug 18 11:57:58.905: INFO: kube-flannel-h7t5h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:57:58.905: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:57:58.905: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:57:58.905: INFO: node-exporter-lrrf2 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:57:58.905: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:57:58.905: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:57:58.905: INFO: simpletest.rc-qrd85 started at 2021-08-18 11:56:50 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:58.905: INFO: Container nginx ready: false, restart count 0 Aug 18 11:57:58.905: INFO: webserver-deployment-dd94f59b7-g45zh started at 2021-08-18 11:56:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:58.905: INFO: Container httpd ready: false, restart count 0 Aug 18 11:57:58.905: INFO: simpletest.rc-6zlz2 started at 2021-08-18 11:56:50 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:58.905: INFO: Container nginx ready: false, restart count 0 Aug 18 11:57:58.905: INFO: webserver-deployment-dd94f59b7-ttks8 started at 2021-08-18 11:56:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:58.905: INFO: Container httpd ready: false, restart count 0 Aug 18 11:57:58.905: INFO: nginx-proxy-node2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:58.905: INFO: Container nginx-proxy ready: true, restart count 1 Aug 18 11:57:58.905: INFO: cmk-init-discover-node2-6b2kz started at 2021-08-18 08:32:30 +0000 UTC (0+3 container statuses recorded) Aug 18 11:57:58.905: INFO: Container discover ready: false, restart count 0 Aug 18 11:57:58.905: INFO: Container init ready: false, restart count 0 Aug 18 11:57:58.905: INFO: Container install ready: false, restart count 0 Aug 18 11:57:58.905: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-7rn45 started at 2021-08-18 08:36:42 +0000 UTC (0+2 container statuses recorded) Aug 18 11:57:58.905: INFO: Container tas-controller ready: true, restart count 0 Aug 18 11:57:58.905: INFO: Container tas-extender ready: true, restart count 0 Aug 18 11:57:58.905: INFO: pod-update-399ed819-acd4-424c-8e46-fca448681026 started at 2021-08-18 11:53:12 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:58.905: INFO: Container nginx ready: false, restart count 0 Aug 18 11:57:58.905: INFO: webserver-deployment-dd94f59b7-bvwxs started at 2021-08-18 11:56:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:58.905: INFO: Container httpd ready: false, restart count 0 Aug 18 11:57:58.905: INFO: simpletest.deployment-7f7555f8bc-klkkf started at 2021-08-18 11:57:45 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:58.905: INFO: Container nginx ready: false, restart count 0 Aug 18 11:57:58.905: INFO: kubernetes-dashboard-86c6f9df5b-qrtdk started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:58.905: INFO: Container kubernetes-dashboard ready: true, restart count 2 Aug 18 11:57:58.905: INFO: webserver-deployment-dd94f59b7-4pbnc started at 2021-08-18 11:56:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:58.905: INFO: Container httpd ready: false, restart count 0 Aug 18 11:57:58.905: INFO: webserver-deployment-dd94f59b7-qmb69 started at 2021-08-18 11:56:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:58.905: INFO: Container httpd ready: false, restart count 0 Aug 18 11:57:58.905: INFO: cmk-748rz started at 2021-08-18 08:32:53 +0000 UTC (0+2 container statuses recorded) Aug 18 11:57:58.905: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:57:58.905: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:57:58.905: INFO: externalname-service-9x22f started at 2021-08-18 11:56:20 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:58.905: INFO: Container externalname-service ready: true, restart count 0 Aug 18 11:57:58.905: INFO: execpodxr7sj started at 2021-08-18 11:56:26 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:58.905: INFO: Container agnhost-container ready: true, restart count 0 Aug 18 11:57:58.905: INFO: simpletest.rc-cwkg7 started at 2021-08-18 11:56:50 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:58.905: INFO: Container nginx ready: false, restart count 0 Aug 18 11:57:58.905: INFO: kube-proxy-qkj9c started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:58.905: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:57:58.905: INFO: node-feature-discovery-worker-hzpf5 started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:58.905: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:57:58.905: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-c82pt started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:58.905: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:57:58.905: INFO: prometheus-operator-5bb8cb9d8f-k97ws started at 2021-08-18 08:33:38 +0000 UTC (0+2 container statuses recorded) Aug 18 11:57:58.905: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:57:58.905: INFO: Container prometheus-operator ready: true, restart count 0 Aug 18 11:57:58.905: INFO: kube-multus-ds-amd64-rvzsg started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:58.905: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:57:58.905: INFO: collectd-67ntq started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:57:58.905: INFO: Container collectd ready: true, restart count 0 Aug 18 11:57:58.905: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:57:58.905: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:57:58.905: INFO: simpletest.rc-rgnt2 started at 2021-08-18 11:56:50 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:58.905: INFO: Container nginx ready: false, restart count 0 Aug 18 11:57:58.905: INFO: simpletest.rc-zqlmq started at 2021-08-18 11:56:50 +0000 UTC (0+1 container statuses recorded) Aug 18 11:57:58.905: INFO: Container nginx ready: false, restart count 0 W0818 11:57:58.916941 28 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:57:58.961: INFO: Latency metrics for node node2 Aug 18 11:57:58.961: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "container-probe-5430" for this suite. • Failure [300.423 seconds] [k8s.io] Probing container /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 should *not* be restarted with a exec "cat /tmp/health" liveness probe [NodeConformance] [Conformance] [It] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:57:58.591: starting pod busybox-3dfd903c-68f3-48ac-a884-dd6ba807fca5 in namespace container-probe-5430 Unexpected error: <*errors.errorString | 0xc0003001f0>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:426 ------------------------------ {"msg":"FAILED [k8s.io] Probing container should *not* be restarted with a exec \"cat /tmp/health\" liveness probe [NodeConformance] [Conformance]","total":-1,"completed":15,"skipped":321,"failed":4,"failures":["[k8s.io] Variable Expansion should allow substituting values in a volume subpath [sig-storage] [Conformance]","[sig-apps] StatefulSet [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] should perform canary updates and phased rolling updates of template modifications [Conformance]","[sig-api-machinery] Secrets should be consumable from pods in env vars [NodeConformance] [Conformance]","[k8s.io] Probing container should *not* be restarted with a exec \"cat /tmp/health\" liveness probe [NodeConformance] [Conformance]"]} Aug 18 11:57:58.976: INFO: Running AfterSuite actions on all nodes {"msg":"PASSED [k8s.io] Container Lifecycle Hook when create a pod with lifecycle hook should execute poststart exec hook properly [NodeConformance] [Conformance]","total":-1,"completed":34,"skipped":841,"failed":3,"failures":["[k8s.io] Pods should be submitted and removed [NodeConformance] [Conformance]","[sig-apps] Job should run a job to completion when tasks sometimes fail and are locally restarted [Conformance]","[sig-network] Services should have session affinity work for NodePort service [LinuxOnly] [Conformance]"]} [BeforeEach] [k8s.io] Pods /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:53:12.550: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename pods STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [k8s.io] Pods /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/pods.go:181 [It] should be updated [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: creating the pod STEP: submitting the pod to kubernetes Aug 18 11:58:12.592: FAIL: Unexpected error: <*errors.errorString | 0xc0002f61f0>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*PodClient).CreateSync(0xc002458b40, 0xc001d27000, 0x0) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:103 +0xfe k8s.io/kubernetes/test/e2e/common.glob..func18.4() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/pods.go:369 +0x498 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc0027eb380) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc0027eb380) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc0027eb380, 0x4deb2c0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] Pods /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "pods-1861". STEP: Found 7 events. Aug 18 11:58:12.597: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for pod-update-399ed819-acd4-424c-8e46-fca448681026: { } Scheduled: Successfully assigned pods-1861/pod-update-399ed819-acd4-424c-8e46-fca448681026 to node2 Aug 18 11:58:12.597: INFO: At 2021-08-18 11:53:15 +0000 UTC - event for pod-update-399ed819-acd4-424c-8e46-fca448681026: {multus } AddedInterface: Add eth0 [10.244.3.109/24] Aug 18 11:58:12.597: INFO: At 2021-08-18 11:53:15 +0000 UTC - event for pod-update-399ed819-acd4-424c-8e46-fca448681026: {kubelet node2} Pulling: Pulling image "docker.io/library/nginx:1.14-alpine" Aug 18 11:58:12.597: INFO: At 2021-08-18 11:53:17 +0000 UTC - event for pod-update-399ed819-acd4-424c-8e46-fca448681026: {kubelet node2} Failed: Failed to pull image "docker.io/library/nginx:1.14-alpine": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit Aug 18 11:58:12.597: INFO: At 2021-08-18 11:53:17 +0000 UTC - event for pod-update-399ed819-acd4-424c-8e46-fca448681026: {kubelet node2} Failed: Error: ErrImagePull Aug 18 11:58:12.597: INFO: At 2021-08-18 11:53:17 +0000 UTC - event for pod-update-399ed819-acd4-424c-8e46-fca448681026: {kubelet node2} BackOff: Back-off pulling image "docker.io/library/nginx:1.14-alpine" Aug 18 11:58:12.597: INFO: At 2021-08-18 11:53:17 +0000 UTC - event for pod-update-399ed819-acd4-424c-8e46-fca448681026: {kubelet node2} Failed: Error: ImagePullBackOff Aug 18 11:58:12.599: INFO: POD NODE PHASE GRACE CONDITIONS Aug 18 11:58:12.599: INFO: pod-update-399ed819-acd4-424c-8e46-fca448681026 node2 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:53:12 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:53:12 +0000 UTC ContainersNotReady containers with unready status: [nginx]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:53:12 +0000 UTC ContainersNotReady containers with unready status: [nginx]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:53:12 +0000 UTC }] Aug 18 11:58:12.599: INFO: Aug 18 11:58:12.603: INFO: Logging node info for node master1 Aug 18 11:58:12.606: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 ebb211fa-503f-4cfe-b1ed-c95d27a70e6e 77244 0 2021-08-18 08:20:52 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"3a:82:be:72:b5:15"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:20:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:20:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:25:59 +0000 UTC,LastTransitionTime:2021-08-18 08:25:59 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:58:09 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:58:09 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:58:09 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:58:09 +0000 UTC,LastTransitionTime:2021-08-18 08:25:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:58c3e57359b641ad92fa1959f2fecf5d,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:012cd796-2076-45d6-8b14-d3e0451b1e64,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[@ :],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:58:12.607: INFO: Logging kubelet events for node master1 Aug 18 11:58:12.608: INFO: Logging pods the kubelet thinks is on node master1 Aug 18 11:58:12.616: INFO: kube-apiserver-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:12.617: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:58:12.617: INFO: kube-proxy-vqk4v started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:12.617: INFO: Container kube-proxy ready: true, restart count 1 Aug 18 11:58:12.617: INFO: kube-flannel-q64cq started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:58:12.617: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:58:12.617: INFO: Container kube-flannel ready: true, restart count 3 Aug 18 11:58:12.617: INFO: coredns-7677f9bb54-kn2qg started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:12.617: INFO: Container coredns ready: true, restart count 2 Aug 18 11:58:12.617: INFO: kube-scheduler-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:12.617: INFO: Container kube-scheduler ready: true, restart count 0 Aug 18 11:58:12.617: INFO: kube-controller-manager-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:12.617: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:58:12.617: INFO: kube-multus-ds-amd64-kbcp6 started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:12.617: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:58:12.617: INFO: docker-registry-docker-registry-56cbc7bc58-49kl2 started at 2021-08-18 08:26:23 +0000 UTC (0+2 container statuses recorded) Aug 18 11:58:12.617: INFO: Container docker-registry ready: true, restart count 0 Aug 18 11:58:12.617: INFO: Container nginx ready: true, restart count 0 Aug 18 11:58:12.617: INFO: node-exporter-5hwz9 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:58:12.617: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:58:12.617: INFO: Container node-exporter ready: true, restart count 0 W0818 11:58:12.629836 38 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:58:12.657: INFO: Latency metrics for node master1 Aug 18 11:58:12.657: INFO: Logging node info for node master2 Aug 18 11:58:12.659: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 78946293-3abe-4442-84d4-8ed6b1d15ce0 77226 0 2021-08-18 08:21:31 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"7e:f5:c2:cc:3a:b4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:21:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:21:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-08-18 08:29:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:58:08 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:58:08 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:58:08 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:58:08 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0c44122c7a7248c18d8571e1cc667258,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:0cd329f2-48e0-4c8f-b8b9-fa3ae0ed8406,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:58:12.659: INFO: Logging kubelet events for node master2 Aug 18 11:58:12.662: INFO: Logging pods the kubelet thinks is on node master2 Aug 18 11:58:12.670: INFO: kube-controller-manager-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:12.670: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:58:12.670: INFO: kube-proxy-kh2l9 started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:12.670: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:58:12.670: INFO: kube-flannel-pp56h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:58:12.670: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:58:12.670: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:58:12.670: INFO: kube-apiserver-master2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:12.670: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:58:12.670: INFO: kube-scheduler-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:12.670: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:58:12.670: INFO: kube-multus-ds-amd64-mld8g started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:12.670: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:58:12.670: INFO: dns-autoscaler-5b7b5c9b6f-hh47r started at 2021-08-18 08:23:57 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:12.670: INFO: Container autoscaler ready: true, restart count 2 Aug 18 11:58:12.670: INFO: node-feature-discovery-controller-5bf5c49849-mq57c started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:12.671: INFO: Container nfd-controller ready: true, restart count 0 Aug 18 11:58:12.671: INFO: node-exporter-48nfx started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:58:12.671: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:58:12.671: INFO: Container node-exporter ready: true, restart count 0 W0818 11:58:12.685292 38 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:58:12.709: INFO: Latency metrics for node master2 Aug 18 11:58:12.709: INFO: Logging node info for node master3 Aug 18 11:58:12.711: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 44feac2b-9447-4be2-9fcd-62f836d67c72 77167 0 2021-08-18 08:21:41 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"86:e4:31:99:58:40"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {kubelet Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:58:03 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:58:03 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:58:03 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:58:03 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1fae19ae59884c44899bcd08aa243244,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:5db926c5-6530-4635-a0d5-806974a3b732,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:58:12.712: INFO: Logging kubelet events for node master3 Aug 18 11:58:12.713: INFO: Logging pods the kubelet thinks is on node master3 Aug 18 11:58:12.721: INFO: kube-apiserver-master3 started at 2021-08-18 08:29:12 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:12.722: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:58:12.722: INFO: kube-proxy-sd5lc started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:12.722: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:58:12.722: INFO: kube-flannel-x6tlr started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:58:12.722: INFO: Init container install-cni ready: true, restart count 1 Aug 18 11:58:12.722: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:58:12.722: INFO: kube-multus-ds-amd64-bkw6c started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:12.722: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:58:12.722: INFO: coredns-7677f9bb54-5hxfh started at 2021-08-18 08:23:54 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:12.722: INFO: Container coredns ready: true, restart count 1 Aug 18 11:58:12.722: INFO: node-exporter-vq7d8 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:58:12.722: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:58:12.722: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:58:12.722: INFO: kube-controller-manager-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:12.722: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:58:12.722: INFO: kube-scheduler-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:12.722: INFO: Container kube-scheduler ready: true, restart count 2 W0818 11:58:12.736168 38 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:58:12.759: INFO: Latency metrics for node master3 Aug 18 11:58:12.759: INFO: Logging node info for node node1 Aug 18 11:58:12.762: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 84defabd-6ebf-43ec-a629-44c6713da9c9 77245 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"9a:87:55:36:7b:df"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:13 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:35 +0000 UTC,LastTransitionTime:2021-08-18 08:26:35 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:58:09 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:58:09 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:58:09 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:58:09 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:69946ff2b7bc462fa25eb7adb4703c23,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:736dc52f-f5e3-494e-86ca-01eedbea015c,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:a7cea43d9d2f67c38fbf0407786edbe660ee9072945f7bb272b55fd255e8eaca opnfv/barometer-collectd:stable],SizeBytes:1075746799,},ContainerImage{Names:[@ :],SizeBytes:1003788820,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[aquasec/kube-hunter@sha256:2be6820bc1d7e0f57193a9a27d5a3e16b2fd93c53747b03ce8ca48c6fc323781 aquasec/kube-hunter:0.3.1],SizeBytes:347611549,},ContainerImage{Names:[golang@sha256:db2475a1dbb2149508e5db31d7d77a75e6600d54be645f37681f03f2762169ba golang:alpine3.12],SizeBytes:301186719,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:de25c7fc6c4f3a27c7f0c2dff454e4671823a34d88abd533f210848d527e0fbb alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:58:12.763: INFO: Logging kubelet events for node node1 Aug 18 11:58:12.765: INFO: Logging pods the kubelet thinks is on node node1 Aug 18 11:58:12.782: INFO: simpletest.rc-dhc6q started at 2021-08-18 11:56:50 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:12.782: INFO: Container nginx ready: false, restart count 0 Aug 18 11:58:12.782: INFO: kube-proxy-p6jvp started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:12.782: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:58:12.782: INFO: kubernetes-metrics-scraper-678c97765c-9nsv5 started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:12.783: INFO: Container kubernetes-metrics-scraper ready: true, restart count 2 Aug 18 11:58:12.783: INFO: cmk-d8r27 started at 2021-08-18 08:32:52 +0000 UTC (0+2 container statuses recorded) Aug 18 11:58:12.783: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:58:12.783: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:58:12.783: INFO: nginx-proxy-node1 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:12.783: INFO: Container nginx-proxy ready: true, restart count 2 Aug 18 11:58:12.783: INFO: foo-xpsfd started at 2021-08-18 11:53:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:12.783: INFO: Container c ready: false, restart count 0 Aug 18 11:58:12.783: INFO: server-envvars-dcc91a28-e119-476f-ad7b-86dc853ddeb4 started at 2021-08-18 11:52:28 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:12.783: INFO: Container srv ready: true, restart count 0 Aug 18 11:58:12.783: INFO: externalname-service-mlvh7 started at 2021-08-18 11:56:20 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:12.783: INFO: Container externalname-service ready: true, restart count 0 Aug 18 11:58:12.783: INFO: simpletest.rc-l2xlg started at 2021-08-18 11:56:50 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:12.783: INFO: Container nginx ready: false, restart count 0 Aug 18 11:58:12.783: INFO: kube-multus-ds-amd64-rrvmb started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:12.783: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:58:12.783: INFO: node-feature-discovery-worker-pflgw started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:12.783: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:58:12.783: INFO: node-exporter-kcwvn started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:58:12.783: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:58:12.783: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:58:12.783: INFO: webserver-deployment-dd94f59b7-dqt7r started at 2021-08-18 11:56:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:12.783: INFO: Container httpd ready: false, restart count 0 Aug 18 11:58:12.783: INFO: webserver-deployment-dd94f59b7-x65jh started at 2021-08-18 11:56:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:12.783: INFO: Container httpd ready: false, restart count 0 Aug 18 11:58:12.783: INFO: simpletest.deployment-7f7555f8bc-cxqff started at 2021-08-18 11:57:46 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:12.783: INFO: Container nginx ready: false, restart count 0 Aug 18 11:58:12.783: INFO: cmk-init-discover-node1-bxznx started at 2021-08-18 08:32:10 +0000 UTC (0+3 container statuses recorded) Aug 18 11:58:12.783: INFO: Container discover ready: false, restart count 0 Aug 18 11:58:12.783: INFO: Container init ready: false, restart count 0 Aug 18 11:58:12.783: INFO: Container install ready: false, restart count 0 Aug 18 11:58:12.783: INFO: collectd-xdprr started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:58:12.783: INFO: Container collectd ready: true, restart count 0 Aug 18 11:58:12.783: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:58:12.783: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:58:12.783: INFO: webserver-deployment-dd94f59b7-dbsxb started at 2021-08-18 11:56:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:12.783: INFO: Container httpd ready: false, restart count 0 Aug 18 11:58:12.783: INFO: simpletest.rc-pkcsq started at 2021-08-18 11:56:50 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:12.783: INFO: Container nginx ready: false, restart count 0 Aug 18 11:58:12.783: INFO: webserver-deployment-dd94f59b7-h8pvd started at 2021-08-18 11:56:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:12.783: INFO: Container httpd ready: false, restart count 0 Aug 18 11:58:12.783: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-vsxvg started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:12.783: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:58:12.783: INFO: downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c started at 2021-08-18 11:55:49 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:12.783: INFO: Container dapi-container ready: false, restart count 0 Aug 18 11:58:12.783: INFO: kube-flannel-q78nd started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:58:12.783: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:58:12.783: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:58:12.783: INFO: prometheus-k8s-0 started at 2021-08-18 08:34:03 +0000 UTC (0+5 container statuses recorded) Aug 18 11:58:12.783: INFO: Container custom-metrics-apiserver ready: true, restart count 0 Aug 18 11:58:12.783: INFO: Container grafana ready: true, restart count 0 Aug 18 11:58:12.783: INFO: Container prometheus ready: true, restart count 1 Aug 18 11:58:12.783: INFO: Container prometheus-config-reloader ready: true, restart count 0 Aug 18 11:58:12.783: INFO: Container rules-configmap-reloader ready: true, restart count 0 Aug 18 11:58:12.783: INFO: simpletest.rc-6vlbj started at 2021-08-18 11:56:50 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:12.783: INFO: Container nginx ready: false, restart count 0 Aug 18 11:58:12.783: INFO: webserver-deployment-dd94f59b7-rws9q started at 2021-08-18 11:56:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:12.783: INFO: Container httpd ready: false, restart count 0 Aug 18 11:58:12.783: INFO: simpletest.rc-v7qrv started at 2021-08-18 11:56:50 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:12.783: INFO: Container nginx ready: false, restart count 0 W0818 11:58:12.797206 38 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:58:12.831: INFO: Latency metrics for node node1 Aug 18 11:58:12.831: INFO: Logging node info for node node2 Aug 18 11:58:12.833: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 1d01177e-3dbb-48a1-a0bc-d18af27ab7f8 77264 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:d1:47:f8:1d:22"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:36 +0000 UTC,LastTransitionTime:2021-08-18 08:26:36 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:58:12 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:58:12 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:58:12 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:58:12 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:dc1f286135c145349b8a016880b65a2f,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:037e7e2d-94e9-42f4-a719-896e5005ac70,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:58:12.834: INFO: Logging kubelet events for node node2 Aug 18 11:58:12.836: INFO: Logging pods the kubelet thinks is on node node2 Aug 18 11:58:12.852: INFO: kube-flannel-h7t5h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:58:12.852: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:58:12.852: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:58:12.852: INFO: node-exporter-lrrf2 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:58:12.852: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:58:12.852: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:58:12.852: INFO: simpletest.rc-qrd85 started at 2021-08-18 11:56:50 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:12.852: INFO: Container nginx ready: false, restart count 0 Aug 18 11:58:12.852: INFO: webserver-deployment-dd94f59b7-g45zh started at 2021-08-18 11:56:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:12.852: INFO: Container httpd ready: false, restart count 0 Aug 18 11:58:12.852: INFO: foo-mcmfh started at 2021-08-18 11:53:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:12.852: INFO: Container c ready: false, restart count 0 Aug 18 11:58:12.852: INFO: nginx-proxy-node2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:12.852: INFO: Container nginx-proxy ready: true, restart count 1 Aug 18 11:58:12.852: INFO: cmk-init-discover-node2-6b2kz started at 2021-08-18 08:32:30 +0000 UTC (0+3 container statuses recorded) Aug 18 11:58:12.852: INFO: Container discover ready: false, restart count 0 Aug 18 11:58:12.852: INFO: Container init ready: false, restart count 0 Aug 18 11:58:12.852: INFO: Container install ready: false, restart count 0 Aug 18 11:58:12.852: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-7rn45 started at 2021-08-18 08:36:42 +0000 UTC (0+2 container statuses recorded) Aug 18 11:58:12.852: INFO: Container tas-controller ready: true, restart count 0 Aug 18 11:58:12.852: INFO: Container tas-extender ready: true, restart count 0 Aug 18 11:58:12.852: INFO: pod-update-399ed819-acd4-424c-8e46-fca448681026 started at 2021-08-18 11:53:12 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:12.852: INFO: Container nginx ready: false, restart count 0 Aug 18 11:58:12.852: INFO: simpletest.rc-6zlz2 started at 2021-08-18 11:56:50 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:12.852: INFO: Container nginx ready: false, restart count 0 Aug 18 11:58:12.852: INFO: webserver-deployment-dd94f59b7-ttks8 started at 2021-08-18 11:56:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:12.852: INFO: Container httpd ready: false, restart count 0 Aug 18 11:58:12.852: INFO: kubernetes-dashboard-86c6f9df5b-qrtdk started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:12.852: INFO: Container kubernetes-dashboard ready: true, restart count 2 Aug 18 11:58:12.852: INFO: webserver-deployment-dd94f59b7-4pbnc started at 2021-08-18 11:56:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:12.852: INFO: Container httpd ready: false, restart count 0 Aug 18 11:58:12.852: INFO: webserver-deployment-dd94f59b7-qmb69 started at 2021-08-18 11:56:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:12.852: INFO: Container httpd ready: false, restart count 0 Aug 18 11:58:12.852: INFO: webserver-deployment-dd94f59b7-bvwxs started at 2021-08-18 11:56:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:12.852: INFO: Container httpd ready: false, restart count 0 Aug 18 11:58:12.852: INFO: simpletest.deployment-7f7555f8bc-klkkf started at 2021-08-18 11:57:45 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:12.852: INFO: Container nginx ready: false, restart count 0 Aug 18 11:58:12.852: INFO: cmk-748rz started at 2021-08-18 08:32:53 +0000 UTC (0+2 container statuses recorded) Aug 18 11:58:12.852: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:58:12.852: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:58:12.852: INFO: externalname-service-9x22f started at 2021-08-18 11:56:20 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:12.852: INFO: Container externalname-service ready: true, restart count 0 Aug 18 11:58:12.852: INFO: execpodxr7sj started at 2021-08-18 11:56:26 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:12.852: INFO: Container agnhost-container ready: true, restart count 0 Aug 18 11:58:12.852: INFO: kube-proxy-qkj9c started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:12.852: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:58:12.852: INFO: node-feature-discovery-worker-hzpf5 started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:12.852: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:58:12.852: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-c82pt started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:12.852: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:58:12.852: INFO: prometheus-operator-5bb8cb9d8f-k97ws started at 2021-08-18 08:33:38 +0000 UTC (0+2 container statuses recorded) Aug 18 11:58:12.852: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:58:12.852: INFO: Container prometheus-operator ready: true, restart count 0 Aug 18 11:58:12.852: INFO: simpletest.rc-cwkg7 started at 2021-08-18 11:56:50 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:12.852: INFO: Container nginx ready: false, restart count 0 Aug 18 11:58:12.852: INFO: kube-multus-ds-amd64-rvzsg started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:12.852: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:58:12.852: INFO: collectd-67ntq started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:58:12.852: INFO: Container collectd ready: true, restart count 0 Aug 18 11:58:12.852: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:58:12.852: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:58:12.852: INFO: simpletest.rc-rgnt2 started at 2021-08-18 11:56:50 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:12.852: INFO: Container nginx ready: false, restart count 0 Aug 18 11:58:12.852: INFO: simpletest.rc-zqlmq started at 2021-08-18 11:56:50 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:12.852: INFO: Container nginx ready: false, restart count 0 Aug 18 11:58:12.852: INFO: cmk-webhook-6c9d5f8578-7cxjr started at 2021-08-18 08:32:53 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:12.852: INFO: Container cmk-webhook ready: true, restart count 0 Aug 18 11:58:12.852: INFO: client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419 started at 2021-08-18 11:57:37 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:12.852: INFO: Container env3cont ready: false, restart count 0 W0818 11:58:12.865949 38 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:58:12.897: INFO: Latency metrics for node node2 Aug 18 11:58:12.897: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "pods-1861" for this suite. • Failure [300.354 seconds] [k8s.io] Pods /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 should be updated [NodeConformance] [Conformance] [It] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:58:12.592: Unexpected error: <*errors.errorString | 0xc0002f61f0>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:103 ------------------------------ {"msg":"FAILED [k8s.io] Pods should be updated [NodeConformance] [Conformance]","total":-1,"completed":34,"skipped":841,"failed":4,"failures":["[k8s.io] Pods should be submitted and removed [NodeConformance] [Conformance]","[sig-apps] Job should run a job to completion when tasks sometimes fail and are locally restarted [Conformance]","[sig-network] Services should have session affinity work for NodePort service [LinuxOnly] [Conformance]","[k8s.io] Pods should be updated [NodeConformance] [Conformance]"]} Aug 18 11:58:12.911: INFO: Running AfterSuite actions on all nodes [BeforeEach] [sig-api-machinery] Garbage collector /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:56:49.997: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename gc STEP: Waiting for a default service account to be provisioned in namespace [It] should orphan pods created by rc if delete options say so [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: create the rc STEP: delete the rc STEP: wait for the rc to be deleted STEP: wait for 30 seconds to see if the garbage collector mistakenly deletes the pods STEP: Gathering metrics W0818 11:57:30.053799 30 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:58:32.074: INFO: MetricsGrabber failed grab metrics. Skipping metrics gathering. Aug 18 11:58:32.074: INFO: Deleting pod "simpletest.rc-6vlbj" in namespace "gc-7458" Aug 18 11:58:32.082: INFO: Deleting pod "simpletest.rc-6zlz2" in namespace "gc-7458" Aug 18 11:58:32.088: INFO: Deleting pod "simpletest.rc-cwkg7" in namespace "gc-7458" Aug 18 11:58:32.094: INFO: Deleting pod "simpletest.rc-dhc6q" in namespace "gc-7458" Aug 18 11:58:32.100: INFO: Deleting pod "simpletest.rc-l2xlg" in namespace "gc-7458" Aug 18 11:58:32.106: INFO: Deleting pod "simpletest.rc-pkcsq" in namespace "gc-7458" Aug 18 11:58:32.113: INFO: Deleting pod "simpletest.rc-qrd85" in namespace "gc-7458" Aug 18 11:58:32.120: INFO: Deleting pod "simpletest.rc-rgnt2" in namespace "gc-7458" Aug 18 11:58:32.125: INFO: Deleting pod "simpletest.rc-v7qrv" in namespace "gc-7458" Aug 18 11:58:32.132: INFO: Deleting pod "simpletest.rc-zqlmq" in namespace "gc-7458" [AfterEach] [sig-api-machinery] Garbage collector /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:58:32.139: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "gc-7458" for this suite. • [SLOW TEST:102.149 seconds] [sig-api-machinery] Garbage collector /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23 should orphan pods created by rc if delete options say so [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ {"msg":"PASSED [sig-api-machinery] Garbage collector should orphan pods created by rc if delete options say so [Conformance]","total":-1,"completed":36,"skipped":742,"failed":5,"failures":["[sig-apps] Deployment RollingUpdateDeployment should delete old pods and create new ones [Conformance]","[sig-storage] ConfigMap binary data should be reflected in volume [NodeConformance] [Conformance]","[k8s.io] Kubelet when scheduling a busybox command in a pod should print the output to logs [NodeConformance] [Conformance]","[k8s.io] Pods should support remote command execution over websockets [NodeConformance] [Conformance]","[k8s.io] Container Runtime blackbox test on terminated container should report termination message [LinuxOnly] from file when pod succeeds and TerminationMessagePolicy FallbackToLogsOnError is set [NodeConformance] [Conformance]"]} Aug 18 11:58:32.149: INFO: Running AfterSuite actions on all nodes [BeforeEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:56:20.143: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename services STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:782 [It] should be able to change the type from ExternalName to NodePort [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: creating a service externalname-service with the type=ExternalName in namespace services-4485 STEP: changing the ExternalName service to type=NodePort STEP: creating replication controller externalname-service in namespace services-4485 I0818 11:56:20.187346 31 runners.go:190] Created replication controller with name: externalname-service, namespace: services-4485, replica count: 2 I0818 11:56:23.238036 31 runners.go:190] externalname-service Pods: 2 out of 2 created, 1 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0818 11:56:26.238401 31 runners.go:190] externalname-service Pods: 2 out of 2 created, 2 running, 0 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady Aug 18 11:56:26.238: INFO: Creating new exec pod Aug 18 11:56:31.265: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 externalname-service 80' Aug 18 11:56:31.521: INFO: stderr: "+ nc -zv -t -w 2 externalname-service 80\nConnection to externalname-service 80 port [tcp/http] succeeded!\n" Aug 18 11:56:31.521: INFO: stdout: "" Aug 18 11:56:31.522: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.233.45.116 80' Aug 18 11:56:31.791: INFO: stderr: "+ nc -zv -t -w 2 10.233.45.116 80\nConnection to 10.233.45.116 80 port [tcp/http] succeeded!\n" Aug 18 11:56:31.791: INFO: stdout: "" Aug 18 11:56:31.791: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:56:32.066: INFO: rc: 1 Aug 18 11:56:32.066: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:56:33.067: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:56:33.322: INFO: rc: 1 Aug 18 11:56:33.322: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:56:34.066: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:56:34.339: INFO: rc: 1 Aug 18 11:56:34.339: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:56:35.067: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:56:35.520: INFO: rc: 1 Aug 18 11:56:35.520: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:56:36.067: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:56:36.347: INFO: rc: 1 Aug 18 11:56:36.347: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:56:37.067: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:56:37.341: INFO: rc: 1 Aug 18 11:56:37.341: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:56:38.067: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:56:38.315: INFO: rc: 1 Aug 18 11:56:38.315: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:56:39.067: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:56:39.326: INFO: rc: 1 Aug 18 11:56:39.326: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:56:40.067: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:56:40.316: INFO: rc: 1 Aug 18 11:56:40.316: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:56:41.067: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:56:41.343: INFO: rc: 1 Aug 18 11:56:41.343: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:56:42.068: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:56:42.303: INFO: rc: 1 Aug 18 11:56:42.303: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:56:43.067: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:56:43.312: INFO: rc: 1 Aug 18 11:56:43.312: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:56:44.066: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:56:44.734: INFO: rc: 1 Aug 18 11:56:44.734: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:56:45.067: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:56:45.850: INFO: rc: 1 Aug 18 11:56:45.850: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:56:46.067: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:56:46.339: INFO: rc: 1 Aug 18 11:56:46.340: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:56:47.066: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:56:47.331: INFO: rc: 1 Aug 18 11:56:47.331: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:56:48.067: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:56:48.360: INFO: rc: 1 Aug 18 11:56:48.360: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:56:49.067: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:56:49.330: INFO: rc: 1 Aug 18 11:56:49.330: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:56:50.067: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:56:50.427: INFO: rc: 1 Aug 18 11:56:50.427: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:56:51.067: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:56:51.571: INFO: rc: 1 Aug 18 11:56:51.571: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:56:52.067: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:56:53.196: INFO: rc: 1 Aug 18 11:56:53.196: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:56:54.066: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:56:54.638: INFO: rc: 1 Aug 18 11:56:54.638: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:56:55.066: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:56:56.172: INFO: rc: 1 Aug 18 11:56:56.172: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:56:57.066: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:56:57.479: INFO: rc: 1 Aug 18 11:56:57.479: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:56:58.066: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:56:58.668: INFO: rc: 1 Aug 18 11:56:58.668: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:56:59.066: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:56:59.329: INFO: rc: 1 Aug 18 11:56:59.329: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:57:00.066: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:57:00.327: INFO: rc: 1 Aug 18 11:57:00.327: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:57:01.066: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:57:01.325: INFO: rc: 1 Aug 18 11:57:01.325: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:57:02.066: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:57:02.336: INFO: rc: 1 Aug 18 11:57:02.336: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:57:03.066: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:57:03.332: INFO: rc: 1 Aug 18 11:57:03.332: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:57:04.066: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:57:04.345: INFO: rc: 1 Aug 18 11:57:04.345: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:57:05.066: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:57:05.327: INFO: rc: 1 Aug 18 11:57:05.327: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:57:06.066: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:57:06.313: INFO: rc: 1 Aug 18 11:57:06.314: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:57:07.066: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:57:07.339: INFO: rc: 1 Aug 18 11:57:07.339: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:57:08.066: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:57:08.346: INFO: rc: 1 Aug 18 11:57:08.346: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:57:09.066: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:57:09.349: INFO: rc: 1 Aug 18 11:57:09.349: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:57:10.066: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:57:10.321: INFO: rc: 1 Aug 18 11:57:10.322: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:57:11.066: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:57:11.322: INFO: rc: 1 Aug 18 11:57:11.322: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:57:12.066: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:57:12.326: INFO: rc: 1 Aug 18 11:57:12.326: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:57:13.066: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:57:13.325: INFO: rc: 1 Aug 18 11:57:13.325: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:57:14.066: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:57:14.319: INFO: rc: 1 Aug 18 11:57:14.319: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:57:15.066: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:57:15.342: INFO: rc: 1 Aug 18 11:57:15.342: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:57:16.066: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:57:16.333: INFO: rc: 1 Aug 18 11:57:16.333: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:57:17.066: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:57:17.361: INFO: rc: 1 Aug 18 11:57:17.361: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:57:18.067: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:57:18.605: INFO: rc: 1 Aug 18 11:57:18.605: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:57:19.067: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:57:19.338: INFO: rc: 1 Aug 18 11:57:19.338: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:57:20.068: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:57:20.343: INFO: rc: 1 Aug 18 11:57:20.343: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:57:21.068: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:57:21.358: INFO: rc: 1 Aug 18 11:57:21.358: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:57:22.067: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:57:22.791: INFO: rc: 1 Aug 18 11:57:22.791: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:57:23.067: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:57:23.329: INFO: rc: 1 Aug 18 11:57:23.329: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:57:24.066: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:57:24.349: INFO: rc: 1 Aug 18 11:57:24.349: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:57:25.067: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:57:25.330: INFO: rc: 1 Aug 18 11:57:25.330: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:57:26.067: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:57:26.307: INFO: rc: 1 Aug 18 11:57:26.307: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:57:27.067: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:57:27.319: INFO: rc: 1 Aug 18 11:57:27.319: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:57:28.067: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:57:28.333: INFO: rc: 1 Aug 18 11:57:28.333: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:57:29.066: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:57:29.332: INFO: rc: 1 Aug 18 11:57:29.332: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:57:30.066: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:57:30.323: INFO: rc: 1 Aug 18 11:57:30.323: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:57:31.067: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:57:31.318: INFO: rc: 1 Aug 18 11:57:31.318: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:57:32.066: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:57:32.315: INFO: rc: 1 Aug 18 11:57:32.315: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:57:33.067: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:57:33.318: INFO: rc: 1 Aug 18 11:57:33.318: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:57:34.067: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:57:34.349: INFO: rc: 1 Aug 18 11:57:34.349: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:57:35.067: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:57:35.320: INFO: rc: 1 Aug 18 11:57:35.320: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:57:36.068: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:57:36.322: INFO: rc: 1 Aug 18 11:57:36.322: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:57:37.068: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:57:37.326: INFO: rc: 1 Aug 18 11:57:37.326: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:57:38.068: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:57:38.357: INFO: rc: 1 Aug 18 11:57:38.357: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:57:39.067: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:57:39.332: INFO: rc: 1 Aug 18 11:57:39.332: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:57:40.067: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:57:40.348: INFO: rc: 1 Aug 18 11:57:40.348: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:57:41.068: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:57:41.354: INFO: rc: 1 Aug 18 11:57:41.354: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:57:42.068: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:57:42.338: INFO: rc: 1 Aug 18 11:57:42.338: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:57:43.068: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:57:44.106: INFO: rc: 1 Aug 18 11:57:44.106: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:57:45.069: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:57:45.356: INFO: rc: 1 Aug 18 11:57:45.356: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:57:46.068: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:57:46.384: INFO: rc: 1 Aug 18 11:57:46.385: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:57:47.068: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:57:47.338: INFO: rc: 1 Aug 18 11:57:47.338: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:57:48.068: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:57:48.340: INFO: rc: 1 Aug 18 11:57:48.340: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:57:49.067: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:57:49.359: INFO: rc: 1 Aug 18 11:57:49.359: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:57:50.066: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:57:50.373: INFO: rc: 1 Aug 18 11:57:50.373: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:57:51.068: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:57:51.341: INFO: rc: 1 Aug 18 11:57:51.341: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:57:52.068: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:57:52.344: INFO: rc: 1 Aug 18 11:57:52.344: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:57:53.068: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:57:53.316: INFO: rc: 1 Aug 18 11:57:53.316: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:57:54.066: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:57:54.310: INFO: rc: 1 Aug 18 11:57:54.311: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:57:55.068: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:57:55.490: INFO: rc: 1 Aug 18 11:57:55.490: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:57:56.067: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:57:56.302: INFO: rc: 1 Aug 18 11:57:56.302: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:57:57.067: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:57:57.361: INFO: rc: 1 Aug 18 11:57:57.361: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:57:58.068: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:57:58.342: INFO: rc: 1 Aug 18 11:57:58.342: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:57:59.067: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:57:59.361: INFO: rc: 1 Aug 18 11:57:59.361: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:58:00.067: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:58:00.329: INFO: rc: 1 Aug 18 11:58:00.329: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:58:01.067: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:58:01.328: INFO: rc: 1 Aug 18 11:58:01.328: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:58:02.068: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:58:02.314: INFO: rc: 1 Aug 18 11:58:02.314: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:58:03.067: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:58:03.332: INFO: rc: 1 Aug 18 11:58:03.332: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:58:04.066: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:58:04.335: INFO: rc: 1 Aug 18 11:58:04.335: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:58:05.068: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:58:05.330: INFO: rc: 1 Aug 18 11:58:05.331: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:58:06.068: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:58:06.333: INFO: rc: 1 Aug 18 11:58:06.334: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:58:07.067: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:58:07.319: INFO: rc: 1 Aug 18 11:58:07.319: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:58:08.067: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:58:08.335: INFO: rc: 1 Aug 18 11:58:08.335: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:58:09.067: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:58:09.332: INFO: rc: 1 Aug 18 11:58:09.333: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:58:10.068: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:58:10.326: INFO: rc: 1 Aug 18 11:58:10.326: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:58:11.067: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:58:11.329: INFO: rc: 1 Aug 18 11:58:11.329: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:58:12.068: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:58:12.336: INFO: rc: 1 Aug 18 11:58:12.336: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:58:13.067: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:58:13.337: INFO: rc: 1 Aug 18 11:58:13.338: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:58:14.066: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:58:14.628: INFO: rc: 1 Aug 18 11:58:14.628: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:58:15.068: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:58:15.334: INFO: rc: 1 Aug 18 11:58:15.334: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:58:16.068: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:58:16.339: INFO: rc: 1 Aug 18 11:58:16.339: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:58:17.068: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:58:17.339: INFO: rc: 1 Aug 18 11:58:17.339: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:58:18.068: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:58:18.365: INFO: rc: 1 Aug 18 11:58:18.365: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:58:19.067: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:58:19.368: INFO: rc: 1 Aug 18 11:58:19.368: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:58:20.068: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:58:20.357: INFO: rc: 1 Aug 18 11:58:20.357: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:58:21.068: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:58:21.329: INFO: rc: 1 Aug 18 11:58:21.329: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:58:22.068: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:58:22.326: INFO: rc: 1 Aug 18 11:58:22.326: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:58:23.068: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:58:23.343: INFO: rc: 1 Aug 18 11:58:23.344: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:58:24.068: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:58:24.306: INFO: rc: 1 Aug 18 11:58:24.307: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:58:25.068: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:58:25.327: INFO: rc: 1 Aug 18 11:58:25.327: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:58:26.067: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:58:26.318: INFO: rc: 1 Aug 18 11:58:26.318: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:58:27.067: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:58:27.306: INFO: rc: 1 Aug 18 11:58:27.306: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:58:28.067: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:58:28.317: INFO: rc: 1 Aug 18 11:58:28.317: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:58:29.067: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:58:29.332: INFO: rc: 1 Aug 18 11:58:29.332: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:58:30.067: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:58:30.355: INFO: rc: 1 Aug 18 11:58:30.356: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:58:31.067: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:58:31.323: INFO: rc: 1 Aug 18 11:58:31.323: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:58:32.068: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:58:32.815: INFO: rc: 1 Aug 18 11:58:32.815: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:58:32.815: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519' Aug 18 11:58:33.286: INFO: rc: 1 Aug 18 11:58:33.286: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4485 exec execpodxr7sj -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 32519: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 32519 nc: connect to 10.10.190.207 port 32519 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... Aug 18 11:58:33.286: FAIL: Unexpected error: <*errors.errorString | 0xc0042a70d0>: { s: "service is not reachable within 2m0s timeout on endpoint 10.10.190.207:32519 over TCP protocol", } service is not reachable within 2m0s timeout on endpoint 10.10.190.207:32519 over TCP protocol occurred Full Stack Trace k8s.io/kubernetes/test/e2e/network.glob..func24.15() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:1760 +0x358 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc001b28d80) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc001b28d80) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc001b28d80, 0x4deb2c0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 Aug 18 11:58:33.288: INFO: Cleaning up the ExternalName to NodePort test service [AfterEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "services-4485". STEP: Found 20 events. Aug 18 11:58:33.317: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for execpodxr7sj: { } Scheduled: Successfully assigned services-4485/execpodxr7sj to node2 Aug 18 11:58:33.317: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for externalname-service-9x22f: { } Scheduled: Successfully assigned services-4485/externalname-service-9x22f to node2 Aug 18 11:58:33.317: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for externalname-service-mlvh7: { } Scheduled: Successfully assigned services-4485/externalname-service-mlvh7 to node1 Aug 18 11:58:33.317: INFO: At 2021-08-18 11:56:20 +0000 UTC - event for externalname-service: {replication-controller } SuccessfulCreate: Created pod: externalname-service-mlvh7 Aug 18 11:58:33.317: INFO: At 2021-08-18 11:56:20 +0000 UTC - event for externalname-service: {replication-controller } SuccessfulCreate: Created pod: externalname-service-9x22f Aug 18 11:58:33.317: INFO: At 2021-08-18 11:56:21 +0000 UTC - event for externalname-service-9x22f: {multus } AddedInterface: Add eth0 [10.244.3.114/24] Aug 18 11:58:33.317: INFO: At 2021-08-18 11:56:21 +0000 UTC - event for externalname-service-9x22f: {kubelet node2} Pulling: Pulling image "k8s.gcr.io/e2e-test-images/agnhost:2.20" Aug 18 11:58:33.317: INFO: At 2021-08-18 11:56:21 +0000 UTC - event for externalname-service-mlvh7: {multus } AddedInterface: Add eth0 [10.244.4.126/24] Aug 18 11:58:33.317: INFO: At 2021-08-18 11:56:21 +0000 UTC - event for externalname-service-mlvh7: {kubelet node1} Pulling: Pulling image "k8s.gcr.io/e2e-test-images/agnhost:2.20" Aug 18 11:58:33.317: INFO: At 2021-08-18 11:56:22 +0000 UTC - event for externalname-service-9x22f: {kubelet node2} Started: Started container externalname-service Aug 18 11:58:33.317: INFO: At 2021-08-18 11:56:22 +0000 UTC - event for externalname-service-9x22f: {kubelet node2} Created: Created container externalname-service Aug 18 11:58:33.317: INFO: At 2021-08-18 11:56:22 +0000 UTC - event for externalname-service-9x22f: {kubelet node2} Pulled: Successfully pulled image "k8s.gcr.io/e2e-test-images/agnhost:2.20" in 480.43689ms Aug 18 11:58:33.317: INFO: At 2021-08-18 11:56:22 +0000 UTC - event for externalname-service-mlvh7: {kubelet node1} Started: Started container externalname-service Aug 18 11:58:33.317: INFO: At 2021-08-18 11:56:22 +0000 UTC - event for externalname-service-mlvh7: {kubelet node1} Pulled: Successfully pulled image "k8s.gcr.io/e2e-test-images/agnhost:2.20" in 468.646914ms Aug 18 11:58:33.317: INFO: At 2021-08-18 11:56:22 +0000 UTC - event for externalname-service-mlvh7: {kubelet node1} Created: Created container externalname-service Aug 18 11:58:33.317: INFO: At 2021-08-18 11:56:27 +0000 UTC - event for execpodxr7sj: {kubelet node2} Pulling: Pulling image "k8s.gcr.io/e2e-test-images/agnhost:2.20" Aug 18 11:58:33.317: INFO: At 2021-08-18 11:56:27 +0000 UTC - event for execpodxr7sj: {multus } AddedInterface: Add eth0 [10.244.3.115/24] Aug 18 11:58:33.317: INFO: At 2021-08-18 11:56:28 +0000 UTC - event for execpodxr7sj: {kubelet node2} Pulled: Successfully pulled image "k8s.gcr.io/e2e-test-images/agnhost:2.20" in 498.396943ms Aug 18 11:58:33.317: INFO: At 2021-08-18 11:56:28 +0000 UTC - event for execpodxr7sj: {kubelet node2} Created: Created container agnhost-container Aug 18 11:58:33.317: INFO: At 2021-08-18 11:56:28 +0000 UTC - event for execpodxr7sj: {kubelet node2} Started: Started container agnhost-container Aug 18 11:58:33.320: INFO: POD NODE PHASE GRACE CONDITIONS Aug 18 11:58:33.320: INFO: execpodxr7sj node2 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:56:26 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:56:29 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:56:29 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:56:26 +0000 UTC }] Aug 18 11:58:33.320: INFO: externalname-service-9x22f node2 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:56:20 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:56:23 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:56:23 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:56:20 +0000 UTC }] Aug 18 11:58:33.320: INFO: externalname-service-mlvh7 node1 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:56:20 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:56:23 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:56:23 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:56:20 +0000 UTC }] Aug 18 11:58:33.320: INFO: Aug 18 11:58:33.324: INFO: Logging node info for node master1 Aug 18 11:58:33.327: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 ebb211fa-503f-4cfe-b1ed-c95d27a70e6e 77420 0 2021-08-18 08:20:52 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"3a:82:be:72:b5:15"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:20:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:20:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:25:59 +0000 UTC,LastTransitionTime:2021-08-18 08:25:59 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:58:29 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:58:29 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:58:29 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:58:29 +0000 UTC,LastTransitionTime:2021-08-18 08:25:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:58c3e57359b641ad92fa1959f2fecf5d,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:012cd796-2076-45d6-8b14-d3e0451b1e64,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[@ :],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:58:33.327: INFO: Logging kubelet events for node master1 Aug 18 11:58:33.330: INFO: Logging pods the kubelet thinks is on node master1 Aug 18 11:58:33.340: INFO: kube-apiserver-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:33.340: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:58:33.340: INFO: kube-proxy-vqk4v started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:33.340: INFO: Container kube-proxy ready: true, restart count 1 Aug 18 11:58:33.340: INFO: kube-flannel-q64cq started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:58:33.340: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:58:33.340: INFO: Container kube-flannel ready: true, restart count 3 Aug 18 11:58:33.340: INFO: coredns-7677f9bb54-kn2qg started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:33.340: INFO: Container coredns ready: true, restart count 2 Aug 18 11:58:33.340: INFO: kube-scheduler-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:33.340: INFO: Container kube-scheduler ready: true, restart count 0 Aug 18 11:58:33.340: INFO: kube-controller-manager-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:33.340: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:58:33.340: INFO: kube-multus-ds-amd64-kbcp6 started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:33.340: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:58:33.340: INFO: docker-registry-docker-registry-56cbc7bc58-49kl2 started at 2021-08-18 08:26:23 +0000 UTC (0+2 container statuses recorded) Aug 18 11:58:33.340: INFO: Container docker-registry ready: true, restart count 0 Aug 18 11:58:33.340: INFO: Container nginx ready: true, restart count 0 Aug 18 11:58:33.340: INFO: node-exporter-5hwz9 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:58:33.340: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:58:33.340: INFO: Container node-exporter ready: true, restart count 0 W0818 11:58:33.353234 31 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:58:33.385: INFO: Latency metrics for node master1 Aug 18 11:58:33.385: INFO: Logging node info for node master2 Aug 18 11:58:33.387: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 78946293-3abe-4442-84d4-8ed6b1d15ce0 77406 0 2021-08-18 08:21:31 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"7e:f5:c2:cc:3a:b4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:21:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:21:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-08-18 08:29:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:58:28 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:58:28 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:58:28 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:58:28 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0c44122c7a7248c18d8571e1cc667258,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:0cd329f2-48e0-4c8f-b8b9-fa3ae0ed8406,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:58:33.388: INFO: Logging kubelet events for node master2 Aug 18 11:58:33.390: INFO: Logging pods the kubelet thinks is on node master2 Aug 18 11:58:33.398: INFO: kube-controller-manager-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:33.398: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 11:58:33.398: INFO: kube-proxy-kh2l9 started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:33.398: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:58:33.398: INFO: kube-flannel-pp56h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:58:33.398: INFO: Init container install-cni ready: true, restart count 0 Aug 18 11:58:33.398: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:58:33.398: INFO: node-feature-discovery-controller-5bf5c49849-mq57c started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:33.398: INFO: Container nfd-controller ready: true, restart count 0 Aug 18 11:58:33.398: INFO: node-exporter-48nfx started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:58:33.398: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:58:33.398: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:58:33.398: INFO: kube-apiserver-master2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:33.398: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:58:33.398: INFO: kube-scheduler-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:33.398: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:58:33.398: INFO: kube-multus-ds-amd64-mld8g started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:33.398: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:58:33.398: INFO: dns-autoscaler-5b7b5c9b6f-hh47r started at 2021-08-18 08:23:57 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:33.398: INFO: Container autoscaler ready: true, restart count 2 W0818 11:58:33.411232 31 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:58:33.440: INFO: Latency metrics for node master2 Aug 18 11:58:33.440: INFO: Logging node info for node master3 Aug 18 11:58:33.442: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 44feac2b-9447-4be2-9fcd-62f836d67c72 77371 0 2021-08-18 08:21:41 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"86:e4:31:99:58:40"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {kubelet Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:58:23 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:58:23 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:58:23 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:58:23 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1fae19ae59884c44899bcd08aa243244,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:5db926c5-6530-4635-a0d5-806974a3b732,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:58:33.443: INFO: Logging kubelet events for node master3 Aug 18 11:58:33.445: INFO: Logging pods the kubelet thinks is on node master3 Aug 18 11:58:33.454: INFO: kube-scheduler-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:33.454: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 11:58:33.454: INFO: kube-apiserver-master3 started at 2021-08-18 08:29:12 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:33.454: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 11:58:33.454: INFO: kube-proxy-sd5lc started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:33.454: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:58:33.454: INFO: kube-flannel-x6tlr started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:58:33.454: INFO: Init container install-cni ready: true, restart count 1 Aug 18 11:58:33.454: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:58:33.454: INFO: kube-multus-ds-amd64-bkw6c started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:33.454: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:58:33.454: INFO: coredns-7677f9bb54-5hxfh started at 2021-08-18 08:23:54 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:33.454: INFO: Container coredns ready: true, restart count 1 Aug 18 11:58:33.454: INFO: node-exporter-vq7d8 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:58:33.454: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:58:33.454: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:58:33.454: INFO: kube-controller-manager-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:33.454: INFO: Container kube-controller-manager ready: true, restart count 2 W0818 11:58:33.468386 31 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:58:33.501: INFO: Latency metrics for node master3 Aug 18 11:58:33.501: INFO: Logging node info for node node1 Aug 18 11:58:33.505: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 84defabd-6ebf-43ec-a629-44c6713da9c9 77421 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"9a:87:55:36:7b:df"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:13 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:35 +0000 UTC,LastTransitionTime:2021-08-18 08:26:35 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:58:29 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:58:29 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:58:29 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:58:29 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:69946ff2b7bc462fa25eb7adb4703c23,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:736dc52f-f5e3-494e-86ca-01eedbea015c,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:a7cea43d9d2f67c38fbf0407786edbe660ee9072945f7bb272b55fd255e8eaca opnfv/barometer-collectd:stable],SizeBytes:1075746799,},ContainerImage{Names:[@ :],SizeBytes:1003788820,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[aquasec/kube-hunter@sha256:2be6820bc1d7e0f57193a9a27d5a3e16b2fd93c53747b03ce8ca48c6fc323781 aquasec/kube-hunter:0.3.1],SizeBytes:347611549,},ContainerImage{Names:[golang@sha256:db2475a1dbb2149508e5db31d7d77a75e6600d54be645f37681f03f2762169ba golang:alpine3.12],SizeBytes:301186719,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:de25c7fc6c4f3a27c7f0c2dff454e4671823a34d88abd533f210848d527e0fbb alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:58:33.506: INFO: Logging kubelet events for node node1 Aug 18 11:58:33.508: INFO: Logging pods the kubelet thinks is on node node1 Aug 18 11:58:33.525: INFO: node-feature-discovery-worker-pflgw started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:33.525: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:58:33.525: INFO: node-exporter-kcwvn started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:58:33.525: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:58:33.525: INFO: Container node-exporter ready: true, restart count 0 Aug 18 11:58:33.525: INFO: foo-xpsfd started at 2021-08-18 11:53:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:33.525: INFO: Container c ready: false, restart count 0 Aug 18 11:58:33.525: INFO: server-envvars-dcc91a28-e119-476f-ad7b-86dc853ddeb4 started at 2021-08-18 11:52:28 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:33.525: INFO: Container srv ready: true, restart count 0 Aug 18 11:58:33.525: INFO: externalname-service-mlvh7 started at 2021-08-18 11:56:20 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:33.525: INFO: Container externalname-service ready: true, restart count 0 Aug 18 11:58:33.525: INFO: kube-multus-ds-amd64-rrvmb started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:33.525: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:58:33.525: INFO: collectd-xdprr started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:58:33.525: INFO: Container collectd ready: true, restart count 0 Aug 18 11:58:33.525: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:58:33.525: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:58:33.525: INFO: webserver-deployment-dd94f59b7-dbsxb started at 2021-08-18 11:56:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:33.525: INFO: Container httpd ready: false, restart count 0 Aug 18 11:58:33.525: INFO: webserver-deployment-dd94f59b7-dqt7r started at 2021-08-18 11:56:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:33.525: INFO: Container httpd ready: false, restart count 0 Aug 18 11:58:33.525: INFO: webserver-deployment-dd94f59b7-x65jh started at 2021-08-18 11:56:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:33.525: INFO: Container httpd ready: false, restart count 0 Aug 18 11:58:33.525: INFO: simpletest.deployment-7f7555f8bc-cxqff started at 2021-08-18 11:57:46 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:33.525: INFO: Container nginx ready: false, restart count 0 Aug 18 11:58:33.525: INFO: cmk-init-discover-node1-bxznx started at 2021-08-18 08:32:10 +0000 UTC (0+3 container statuses recorded) Aug 18 11:58:33.525: INFO: Container discover ready: false, restart count 0 Aug 18 11:58:33.525: INFO: Container init ready: false, restart count 0 Aug 18 11:58:33.525: INFO: Container install ready: false, restart count 0 Aug 18 11:58:33.525: INFO: downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c started at 2021-08-18 11:55:49 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:33.525: INFO: Container dapi-container ready: false, restart count 0 Aug 18 11:58:33.525: INFO: webserver-deployment-dd94f59b7-h8pvd started at 2021-08-18 11:56:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:33.525: INFO: Container httpd ready: false, restart count 0 Aug 18 11:58:33.525: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-vsxvg started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:33.525: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:58:33.525: INFO: prometheus-k8s-0 started at 2021-08-18 08:34:03 +0000 UTC (0+5 container statuses recorded) Aug 18 11:58:33.525: INFO: Container custom-metrics-apiserver ready: true, restart count 0 Aug 18 11:58:33.525: INFO: Container grafana ready: true, restart count 0 Aug 18 11:58:33.525: INFO: Container prometheus ready: true, restart count 1 Aug 18 11:58:33.525: INFO: Container prometheus-config-reloader ready: true, restart count 0 Aug 18 11:58:33.525: INFO: Container rules-configmap-reloader ready: true, restart count 0 Aug 18 11:58:33.525: INFO: kube-flannel-q78nd started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:58:33.525: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:58:33.525: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:58:33.525: INFO: webserver-deployment-dd94f59b7-rws9q started at 2021-08-18 11:56:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:33.525: INFO: Container httpd ready: false, restart count 0 Aug 18 11:58:33.525: INFO: kubernetes-metrics-scraper-678c97765c-9nsv5 started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:33.525: INFO: Container kubernetes-metrics-scraper ready: true, restart count 2 Aug 18 11:58:33.525: INFO: cmk-d8r27 started at 2021-08-18 08:32:52 +0000 UTC (0+2 container statuses recorded) Aug 18 11:58:33.525: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:58:33.525: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:58:33.525: INFO: kube-proxy-p6jvp started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:33.525: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:58:33.525: INFO: nginx-proxy-node1 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:33.525: INFO: Container nginx-proxy ready: true, restart count 2 W0818 11:58:33.538876 31 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:58:33.703: INFO: Latency metrics for node node1 Aug 18 11:58:33.703: INFO: Logging node info for node node2 Aug 18 11:58:33.706: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 1d01177e-3dbb-48a1-a0bc-d18af27ab7f8 77475 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:d1:47:f8:1d:22"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:36 +0000 UTC,LastTransitionTime:2021-08-18 08:26:36 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 11:58:33 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 11:58:33 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 11:58:33 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 11:58:33 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:dc1f286135c145349b8a016880b65a2f,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:037e7e2d-94e9-42f4-a719-896e5005ac70,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 11:58:33.707: INFO: Logging kubelet events for node node2 Aug 18 11:58:33.710: INFO: Logging pods the kubelet thinks is on node node2 Aug 18 11:58:33.724: INFO: webserver-deployment-dd94f59b7-ttks8 started at 2021-08-18 11:56:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:33.724: INFO: Container httpd ready: false, restart count 0 Aug 18 11:58:33.724: INFO: nginx-proxy-node2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:33.724: INFO: Container nginx-proxy ready: true, restart count 1 Aug 18 11:58:33.724: INFO: cmk-init-discover-node2-6b2kz started at 2021-08-18 08:32:30 +0000 UTC (0+3 container statuses recorded) Aug 18 11:58:33.724: INFO: Container discover ready: false, restart count 0 Aug 18 11:58:33.724: INFO: Container init ready: false, restart count 0 Aug 18 11:58:33.724: INFO: Container install ready: false, restart count 0 Aug 18 11:58:33.724: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-7rn45 started at 2021-08-18 08:36:42 +0000 UTC (0+2 container statuses recorded) Aug 18 11:58:33.724: INFO: Container tas-controller ready: true, restart count 0 Aug 18 11:58:33.724: INFO: Container tas-extender ready: true, restart count 0 Aug 18 11:58:33.724: INFO: webserver-deployment-dd94f59b7-qmb69 started at 2021-08-18 11:56:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:33.725: INFO: Container httpd ready: false, restart count 0 Aug 18 11:58:33.725: INFO: webserver-deployment-dd94f59b7-bvwxs started at 2021-08-18 11:56:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:33.725: INFO: Container httpd ready: false, restart count 0 Aug 18 11:58:33.725: INFO: simpletest.deployment-7f7555f8bc-klkkf started at 2021-08-18 11:57:45 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:33.725: INFO: Container nginx ready: false, restart count 0 Aug 18 11:58:33.725: INFO: kubernetes-dashboard-86c6f9df5b-qrtdk started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:33.725: INFO: Container kubernetes-dashboard ready: true, restart count 2 Aug 18 11:58:33.725: INFO: webserver-deployment-dd94f59b7-4pbnc started at 2021-08-18 11:56:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:33.725: INFO: Container httpd ready: false, restart count 0 Aug 18 11:58:33.725: INFO: cmk-748rz started at 2021-08-18 08:32:53 +0000 UTC (0+2 container statuses recorded) Aug 18 11:58:33.725: INFO: Container nodereport ready: true, restart count 0 Aug 18 11:58:33.725: INFO: Container reconcile ready: true, restart count 0 Aug 18 11:58:33.725: INFO: externalname-service-9x22f started at 2021-08-18 11:56:20 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:33.725: INFO: Container externalname-service ready: true, restart count 0 Aug 18 11:58:33.725: INFO: execpodxr7sj started at 2021-08-18 11:56:26 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:33.725: INFO: Container agnhost-container ready: true, restart count 0 Aug 18 11:58:33.725: INFO: prometheus-operator-5bb8cb9d8f-k97ws started at 2021-08-18 08:33:38 +0000 UTC (0+2 container statuses recorded) Aug 18 11:58:33.725: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:58:33.725: INFO: Container prometheus-operator ready: true, restart count 0 Aug 18 11:58:33.725: INFO: kube-proxy-qkj9c started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:33.725: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 11:58:33.725: INFO: node-feature-discovery-worker-hzpf5 started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:33.725: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 11:58:33.725: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-c82pt started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:33.725: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 11:58:33.725: INFO: kube-multus-ds-amd64-rvzsg started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:33.725: INFO: Container kube-multus ready: true, restart count 1 Aug 18 11:58:33.725: INFO: collectd-67ntq started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 11:58:33.725: INFO: Container collectd ready: true, restart count 0 Aug 18 11:58:33.725: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 11:58:33.725: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 11:58:33.725: INFO: cmk-webhook-6c9d5f8578-7cxjr started at 2021-08-18 08:32:53 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:33.725: INFO: Container cmk-webhook ready: true, restart count 0 Aug 18 11:58:33.725: INFO: client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419 started at 2021-08-18 11:57:37 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:33.725: INFO: Container env3cont ready: false, restart count 0 Aug 18 11:58:33.725: INFO: webserver-deployment-dd94f59b7-g45zh started at 2021-08-18 11:56:51 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:33.725: INFO: Container httpd ready: false, restart count 0 Aug 18 11:58:33.725: INFO: foo-mcmfh started at 2021-08-18 11:53:08 +0000 UTC (0+1 container statuses recorded) Aug 18 11:58:33.725: INFO: Container c ready: false, restart count 0 Aug 18 11:58:33.725: INFO: kube-flannel-h7t5h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 11:58:33.725: INFO: Init container install-cni ready: true, restart count 2 Aug 18 11:58:33.725: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 11:58:33.725: INFO: node-exporter-lrrf2 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 11:58:33.725: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 11:58:33.725: INFO: Container node-exporter ready: true, restart count 0 W0818 11:58:33.740270 31 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:58:33.771: INFO: Latency metrics for node node2 Aug 18 11:58:33.771: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "services-4485" for this suite. [AfterEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:786 • Failure [133.636 seconds] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/framework.go:23 should be able to change the type from ExternalName to NodePort [Conformance] [It] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:58:33.287: Unexpected error: <*errors.errorString | 0xc0042a70d0>: { s: "service is not reachable within 2m0s timeout on endpoint 10.10.190.207:32519 over TCP protocol", } service is not reachable within 2m0s timeout on endpoint 10.10.190.207:32519 over TCP protocol occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:1760 ------------------------------ {"msg":"FAILED [sig-network] Services should be able to change the type from ExternalName to NodePort [Conformance]","total":-1,"completed":12,"skipped":302,"failed":5,"failures":["[sig-apps] StatefulSet [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] should perform rolling updates and roll backs of template modifications [Conformance]","[k8s.io] Probing container should be restarted with a exec \"cat /tmp/health\" liveness probe [NodeConformance] [Conformance]","[k8s.io] Container Runtime blackbox test on terminated container should report termination message [LinuxOnly] from log output if TerminationMessagePolicy FallbackToLogsOnError is set [NodeConformance] [Conformance]","[k8s.io] Kubelet when scheduling a busybox command that always fails in a pod should have an terminated reason [NodeConformance] [Conformance]","[sig-network] Services should be able to change the type from ExternalName to NodePort [Conformance]"]} Aug 18 11:58:33.801: INFO: Running AfterSuite actions on all nodes [BeforeEach] [sig-api-machinery] Garbage collector /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:57:45.281: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename gc STEP: Waiting for a default service account to be provisioned in namespace [It] should orphan RS created by deployment when deleteOptions.PropagationPolicy is Orphan [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: create the deployment STEP: Wait for the Deployment to create new ReplicaSet STEP: delete the deployment STEP: wait for deployment deletion to see if the garbage collector mistakenly deletes the rs STEP: Gathering metrics W0818 11:57:46.349209 23 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 11:58:48.368: INFO: MetricsGrabber failed grab metrics. Skipping metrics gathering. [AfterEach] [sig-api-machinery] Garbage collector /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 Aug 18 11:58:48.368: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "gc-3953" for this suite. • [SLOW TEST:63.096 seconds] [sig-api-machinery] Garbage collector /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23 should orphan RS created by deployment when deleteOptions.PropagationPolicy is Orphan [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 ------------------------------ [BeforeEach] [sig-node] Downward API /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:55:49.030: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename downward-api STEP: Waiting for a default service account to be provisioned in namespace [It] should provide pod name, namespace and IP address as env vars [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating a pod to test downward api env vars Aug 18 11:55:49.063: INFO: Waiting up to 5m0s for pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c" in namespace "downward-api-718" to be "Succeeded or Failed" Aug 18 11:55:49.066: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 3.185782ms Aug 18 11:55:51.071: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 2.007848043s Aug 18 11:55:53.075: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 4.011701984s Aug 18 11:55:55.080: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 6.016934278s Aug 18 11:55:57.086: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 8.022381392s Aug 18 11:55:59.089: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 10.025958483s Aug 18 11:56:01.093: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 12.029692071s Aug 18 11:56:03.098: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 14.03511933s Aug 18 11:56:05.104: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 16.041174464s Aug 18 11:56:07.109: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 18.046091541s Aug 18 11:56:09.113: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 20.049790149s Aug 18 11:56:11.120: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 22.057037145s Aug 18 11:56:13.123: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 24.059925727s Aug 18 11:56:15.126: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 26.063173004s Aug 18 11:56:17.131: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 28.067502789s Aug 18 11:56:19.134: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 30.070832265s Aug 18 11:56:21.139: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 32.076119799s Aug 18 11:56:23.143: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 34.079871473s Aug 18 11:56:25.150: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 36.086537133s Aug 18 11:56:27.155: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 38.091589253s Aug 18 11:56:29.158: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 40.094660204s Aug 18 11:56:31.162: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 42.098687745s Aug 18 11:56:33.165: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 44.101992656s Aug 18 11:56:35.168: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 46.105091655s Aug 18 11:56:37.172: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 48.108190134s Aug 18 11:56:39.174: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 50.111005956s Aug 18 11:56:41.178: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 52.114536489s Aug 18 11:56:43.181: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 54.117526092s Aug 18 11:56:45.184: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 56.120223941s Aug 18 11:56:47.187: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 58.123570322s Aug 18 11:56:49.190: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.126213514s Aug 18 11:56:51.195: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.131687958s Aug 18 11:56:53.198: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.134792206s Aug 18 11:56:55.201: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.137836863s Aug 18 11:56:57.204: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.140197597s Aug 18 11:56:59.207: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.143248143s Aug 18 11:57:01.209: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.145970331s Aug 18 11:57:03.213: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.149933702s Aug 18 11:57:05.216: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.15238331s Aug 18 11:57:07.220: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.156963926s Aug 18 11:57:09.224: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.161114157s Aug 18 11:57:11.230: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.167057185s Aug 18 11:57:13.234: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.17068013s Aug 18 11:57:15.237: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.1739668s Aug 18 11:57:17.242: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.178223131s Aug 18 11:57:19.245: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.181600121s Aug 18 11:57:21.249: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.185368856s Aug 18 11:57:23.252: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.188828268s Aug 18 11:57:25.255: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.191486005s Aug 18 11:57:27.258: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.194711279s Aug 18 11:57:29.261: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.197322088s Aug 18 11:57:31.264: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.200308271s Aug 18 11:57:33.266: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.20293591s Aug 18 11:57:35.270: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.206699358s Aug 18 11:57:37.273: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.20952286s Aug 18 11:57:39.276: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.212434385s Aug 18 11:57:41.280: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.2170097s Aug 18 11:57:43.283: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.219581882s Aug 18 11:57:45.287: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.223297757s Aug 18 11:57:47.290: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.226604245s Aug 18 11:57:49.293: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.230166501s Aug 18 11:57:51.299: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.235275039s Aug 18 11:57:53.304: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.240545086s Aug 18 11:57:55.308: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.244371086s Aug 18 11:57:57.311: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.24761703s Aug 18 11:57:59.314: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.25041503s Aug 18 11:58:01.318: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.254195497s Aug 18 11:58:03.322: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.258393284s Aug 18 11:58:05.325: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.261942069s Aug 18 11:58:07.330: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.266263347s Aug 18 11:58:09.333: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.269665596s Aug 18 11:58:11.336: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.27225584s Aug 18 11:58:13.339: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.276020884s Aug 18 11:58:15.343: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.280164952s Aug 18 11:58:17.347: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.28361135s Aug 18 11:58:19.350: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.28710447s Aug 18 11:58:21.353: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.289910702s Aug 18 11:58:23.356: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.292819765s Aug 18 11:58:25.359: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.295652594s Aug 18 11:58:27.365: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.301355557s Aug 18 11:58:29.368: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.304574178s Aug 18 11:58:31.371: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.307889306s Aug 18 11:58:33.374: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.310879258s Aug 18 11:58:35.379: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.315231363s Aug 18 11:58:37.382: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.319072179s Aug 18 11:58:39.385: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.322134579s Aug 18 11:58:41.390: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.326418773s Aug 18 11:58:43.394: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.330631867s Aug 18 11:58:45.398: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.334873684s Aug 18 11:58:47.403: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.339348633s Aug 18 11:58:49.407: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.343196148s Aug 18 11:58:51.410: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.346680757s Aug 18 11:58:53.413: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.350103371s Aug 18 11:58:55.418: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.354873485s Aug 18 11:58:57.423: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.359515484s Aug 18 11:58:59.428: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.364424118s Aug 18 11:59:01.431: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.367259417s Aug 18 11:59:03.435: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.371482094s Aug 18 11:59:05.438: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.374577322s Aug 18 11:59:07.442: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.37850954s Aug 18 11:59:09.444: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.381181027s Aug 18 11:59:11.451: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.387580031s Aug 18 11:59:13.455: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.391444208s Aug 18 11:59:15.460: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.39645485s Aug 18 11:59:17.477: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.413318148s Aug 18 11:59:19.480: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.416192834s Aug 18 11:59:21.483: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.419644429s Aug 18 11:59:23.487: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.423198167s Aug 18 11:59:25.490: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.426351089s Aug 18 11:59:27.493: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.430000671s Aug 18 11:59:29.496: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.432980081s Aug 18 11:59:31.501: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.437253963s Aug 18 11:59:33.504: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.441183675s Aug 18 11:59:35.510: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.446314147s Aug 18 11:59:37.514: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.450672281s Aug 18 11:59:39.518: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.45451032s Aug 18 11:59:41.521: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.45800343s Aug 18 11:59:43.526: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.46221988s Aug 18 11:59:45.530: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.46630414s Aug 18 11:59:47.534: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.470193464s Aug 18 11:59:49.537: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.473683418s Aug 18 11:59:51.542: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.478219001s Aug 18 11:59:53.545: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.481250456s Aug 18 11:59:55.549: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.485255644s Aug 18 11:59:57.552: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.488635546s Aug 18 11:59:59.556: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.492919842s Aug 18 12:00:01.559: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.496136973s Aug 18 12:00:03.563: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.499301568s Aug 18 12:00:05.566: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.503083829s Aug 18 12:00:07.569: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.505478787s Aug 18 12:00:09.573: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.509392399s Aug 18 12:00:11.578: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.514921598s Aug 18 12:00:13.582: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.518234697s Aug 18 12:00:15.586: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.522258736s Aug 18 12:00:17.589: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.525820247s Aug 18 12:00:19.592: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.52903613s Aug 18 12:00:21.596: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.532303369s Aug 18 12:00:23.598: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.535121757s Aug 18 12:00:25.603: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.539263756s Aug 18 12:00:27.606: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.542494477s Aug 18 12:00:29.609: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.545657555s Aug 18 12:00:31.614: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.550204303s Aug 18 12:00:33.617: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.55361547s Aug 18 12:00:35.621: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.557678846s Aug 18 12:00:37.624: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.560495305s Aug 18 12:00:39.628: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.564934457s Aug 18 12:00:41.632: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.568208002s Aug 18 12:00:43.635: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.571973391s Aug 18 12:00:45.639: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.575267565s Aug 18 12:00:47.642: INFO: Pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.579056515s Aug 18 12:00:49.656: INFO: Failed to get logs from node "node1" pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c" container "dapi-container": the server rejected our request for an unknown reason (get pods downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c) STEP: delete the pod Aug 18 12:00:49.662: INFO: Waiting for pod downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c to disappear Aug 18 12:00:49.664: INFO: Pod downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c still exists Aug 18 12:00:51.665: INFO: Waiting for pod downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c to disappear Aug 18 12:00:51.669: INFO: Pod downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c still exists Aug 18 12:00:53.665: INFO: Waiting for pod downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c to disappear Aug 18 12:00:53.668: INFO: Pod downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c no longer exists Aug 18 12:00:53.669: FAIL: Unexpected error: <*errors.errorString | 0xc004544f30>: { s: "expected pod \"downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c\" success: Gave up after waiting 5m0s for pod \"downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c\" to be \"Succeeded or Failed\"", } expected pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c" success: Gave up after waiting 5m0s for pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c" to be "Succeeded or Failed" occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).testContainerOutputMatcher(0xc00042c580, 0x4c3168b, 0x15, 0xc001053800, 0x0, 0xc0080391a8, 0x3, 0x3, 0x4deefb0) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 +0x1ee k8s.io/kubernetes/test/e2e/framework.(*Framework).TestContainerOutputRegexp(...) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:532 k8s.io/kubernetes/test/e2e/common.testDownwardAPIUsingPod(...) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/downward_api.go:425 k8s.io/kubernetes/test/e2e/common.testDownwardAPI(0xc00042c580, 0xc003f2f0c0, 0x31, 0xc00077a580, 0x3, 0x3, 0xc0080391a8, 0x3, 0x3) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/downward_api.go:391 +0x75c k8s.io/kubernetes/test/e2e/common.glob..func5.1() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/downward_api.go:80 +0x4e8 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc001880c00) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc001880c00) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc001880c00, 0x4deb2c0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [sig-node] Downward API /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "downward-api-718". STEP: Found 9 events. Aug 18 12:00:53.674: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c: { } Scheduled: Successfully assigned downward-api-718/downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c to node1 Aug 18 12:00:53.674: INFO: At 2021-08-18 11:55:50 +0000 UTC - event for downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c: {multus } AddedInterface: Add eth0 [10.244.4.123/24] Aug 18 12:00:53.674: INFO: At 2021-08-18 11:55:50 +0000 UTC - event for downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c: {kubelet node1} Pulling: Pulling image "docker.io/library/busybox:1.29" Aug 18 12:00:53.674: INFO: At 2021-08-18 11:55:51 +0000 UTC - event for downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c: {kubelet node1} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit Aug 18 12:00:53.674: INFO: At 2021-08-18 11:55:51 +0000 UTC - event for downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c: {kubelet node1} Failed: Error: ErrImagePull Aug 18 12:00:53.674: INFO: At 2021-08-18 11:55:51 +0000 UTC - event for downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c: {kubelet node1} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Aug 18 12:00:53.674: INFO: At 2021-08-18 11:55:53 +0000 UTC - event for downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c: {multus } AddedInterface: Add eth0 [10.244.4.124/24] Aug 18 12:00:53.674: INFO: At 2021-08-18 11:55:53 +0000 UTC - event for downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c: {kubelet node1} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" Aug 18 12:00:53.674: INFO: At 2021-08-18 11:55:53 +0000 UTC - event for downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c: {kubelet node1} Failed: Error: ImagePullBackOff Aug 18 12:00:53.675: INFO: POD NODE PHASE GRACE CONDITIONS Aug 18 12:00:53.676: INFO: Aug 18 12:00:53.680: INFO: Logging node info for node master1 Aug 18 12:00:53.682: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 ebb211fa-503f-4cfe-b1ed-c95d27a70e6e 78225 0 2021-08-18 08:20:52 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"3a:82:be:72:b5:15"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:20:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:20:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:25:59 +0000 UTC,LastTransitionTime:2021-08-18 08:25:59 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 12:00:49 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 12:00:49 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 12:00:49 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 12:00:49 +0000 UTC,LastTransitionTime:2021-08-18 08:25:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:58c3e57359b641ad92fa1959f2fecf5d,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:012cd796-2076-45d6-8b14-d3e0451b1e64,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[@ :],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 12:00:53.683: INFO: Logging kubelet events for node master1 Aug 18 12:00:53.684: INFO: Logging pods the kubelet thinks is on node master1 Aug 18 12:00:53.697: INFO: kube-apiserver-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 12:00:53.697: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 12:00:53.697: INFO: kube-proxy-vqk4v started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 12:00:53.697: INFO: Container kube-proxy ready: true, restart count 1 Aug 18 12:00:53.697: INFO: kube-flannel-q64cq started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 12:00:53.697: INFO: Init container install-cni ready: true, restart count 0 Aug 18 12:00:53.697: INFO: Container kube-flannel ready: true, restart count 3 Aug 18 12:00:53.697: INFO: coredns-7677f9bb54-kn2qg started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 12:00:53.697: INFO: Container coredns ready: true, restart count 2 Aug 18 12:00:53.697: INFO: kube-scheduler-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 12:00:53.697: INFO: Container kube-scheduler ready: true, restart count 0 Aug 18 12:00:53.697: INFO: kube-controller-manager-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 12:00:53.697: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 12:00:53.697: INFO: kube-multus-ds-amd64-kbcp6 started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 12:00:53.697: INFO: Container kube-multus ready: true, restart count 1 Aug 18 12:00:53.697: INFO: docker-registry-docker-registry-56cbc7bc58-49kl2 started at 2021-08-18 08:26:23 +0000 UTC (0+2 container statuses recorded) Aug 18 12:00:53.697: INFO: Container docker-registry ready: true, restart count 0 Aug 18 12:00:53.697: INFO: Container nginx ready: true, restart count 0 Aug 18 12:00:53.697: INFO: node-exporter-5hwz9 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 12:00:53.697: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 12:00:53.697: INFO: Container node-exporter ready: true, restart count 0 W0818 12:00:53.709266 26 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 12:00:53.740: INFO: Latency metrics for node master1 Aug 18 12:00:53.740: INFO: Logging node info for node master2 Aug 18 12:00:53.744: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 78946293-3abe-4442-84d4-8ed6b1d15ce0 78219 0 2021-08-18 08:21:31 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"7e:f5:c2:cc:3a:b4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:21:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:21:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-08-18 08:29:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 12:00:48 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 12:00:48 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 12:00:48 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 12:00:48 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0c44122c7a7248c18d8571e1cc667258,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:0cd329f2-48e0-4c8f-b8b9-fa3ae0ed8406,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 12:00:53.744: INFO: Logging kubelet events for node master2 Aug 18 12:00:53.746: INFO: Logging pods the kubelet thinks is on node master2 Aug 18 12:00:53.760: INFO: kube-controller-manager-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 12:00:53.760: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 12:00:53.760: INFO: kube-proxy-kh2l9 started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 12:00:53.760: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 12:00:53.760: INFO: kube-flannel-pp56h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 12:00:53.760: INFO: Init container install-cni ready: true, restart count 0 Aug 18 12:00:53.760: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 12:00:53.760: INFO: kube-apiserver-master2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 12:00:53.760: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 12:00:53.760: INFO: kube-scheduler-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 12:00:53.760: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 12:00:53.760: INFO: kube-multus-ds-amd64-mld8g started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 12:00:53.760: INFO: Container kube-multus ready: true, restart count 1 Aug 18 12:00:53.760: INFO: dns-autoscaler-5b7b5c9b6f-hh47r started at 2021-08-18 08:23:57 +0000 UTC (0+1 container statuses recorded) Aug 18 12:00:53.760: INFO: Container autoscaler ready: true, restart count 2 Aug 18 12:00:53.760: INFO: node-feature-discovery-controller-5bf5c49849-mq57c started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 12:00:53.760: INFO: Container nfd-controller ready: true, restart count 0 Aug 18 12:00:53.760: INFO: node-exporter-48nfx started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 12:00:53.760: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 12:00:53.760: INFO: Container node-exporter ready: true, restart count 0 W0818 12:00:53.774441 26 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 12:00:53.800: INFO: Latency metrics for node master2 Aug 18 12:00:53.800: INFO: Logging node info for node master3 Aug 18 12:00:53.802: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 44feac2b-9447-4be2-9fcd-62f836d67c72 78202 0 2021-08-18 08:21:41 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"86:e4:31:99:58:40"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {kubelet Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 12:00:43 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 12:00:43 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 12:00:43 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 12:00:43 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1fae19ae59884c44899bcd08aa243244,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:5db926c5-6530-4635-a0d5-806974a3b732,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 12:00:53.803: INFO: Logging kubelet events for node master3 Aug 18 12:00:53.805: INFO: Logging pods the kubelet thinks is on node master3 Aug 18 12:00:53.820: INFO: kube-proxy-sd5lc started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 12:00:53.820: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 12:00:53.820: INFO: kube-flannel-x6tlr started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 12:00:53.820: INFO: Init container install-cni ready: true, restart count 1 Aug 18 12:00:53.820: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 12:00:53.820: INFO: kube-multus-ds-amd64-bkw6c started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 12:00:53.820: INFO: Container kube-multus ready: true, restart count 1 Aug 18 12:00:53.820: INFO: coredns-7677f9bb54-5hxfh started at 2021-08-18 08:23:54 +0000 UTC (0+1 container statuses recorded) Aug 18 12:00:53.820: INFO: Container coredns ready: true, restart count 1 Aug 18 12:00:53.820: INFO: node-exporter-vq7d8 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 12:00:53.820: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 12:00:53.820: INFO: Container node-exporter ready: true, restart count 0 Aug 18 12:00:53.820: INFO: kube-controller-manager-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 12:00:53.820: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 12:00:53.820: INFO: kube-scheduler-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 12:00:53.820: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 12:00:53.820: INFO: kube-apiserver-master3 started at 2021-08-18 08:29:12 +0000 UTC (0+1 container statuses recorded) Aug 18 12:00:53.820: INFO: Container kube-apiserver ready: true, restart count 0 W0818 12:00:53.834060 26 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 12:00:53.864: INFO: Latency metrics for node master3 Aug 18 12:00:53.864: INFO: Logging node info for node node1 Aug 18 12:00:53.867: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 84defabd-6ebf-43ec-a629-44c6713da9c9 78204 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"9a:87:55:36:7b:df"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:13 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:35 +0000 UTC,LastTransitionTime:2021-08-18 08:26:35 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 12:00:44 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 12:00:44 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 12:00:44 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 12:00:44 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:69946ff2b7bc462fa25eb7adb4703c23,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:736dc52f-f5e3-494e-86ca-01eedbea015c,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:a7cea43d9d2f67c38fbf0407786edbe660ee9072945f7bb272b55fd255e8eaca opnfv/barometer-collectd:stable],SizeBytes:1075746799,},ContainerImage{Names:[@ :],SizeBytes:1003788820,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[aquasec/kube-hunter@sha256:2be6820bc1d7e0f57193a9a27d5a3e16b2fd93c53747b03ce8ca48c6fc323781 aquasec/kube-hunter:0.3.1],SizeBytes:347611549,},ContainerImage{Names:[golang@sha256:db2475a1dbb2149508e5db31d7d77a75e6600d54be645f37681f03f2762169ba golang:alpine3.12],SizeBytes:301186719,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:de25c7fc6c4f3a27c7f0c2dff454e4671823a34d88abd533f210848d527e0fbb alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 12:00:53.868: INFO: Logging kubelet events for node node1 Aug 18 12:00:53.869: INFO: Logging pods the kubelet thinks is on node node1 Aug 18 12:00:53.885: INFO: nginx-proxy-node1 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 12:00:53.885: INFO: Container nginx-proxy ready: true, restart count 2 Aug 18 12:00:53.885: INFO: kube-multus-ds-amd64-rrvmb started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 12:00:53.885: INFO: Container kube-multus ready: true, restart count 1 Aug 18 12:00:53.885: INFO: node-feature-discovery-worker-pflgw started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 12:00:53.885: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 12:00:53.885: INFO: node-exporter-kcwvn started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 12:00:53.885: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 12:00:53.885: INFO: Container node-exporter ready: true, restart count 0 Aug 18 12:00:53.885: INFO: foo-xpsfd started at 2021-08-18 11:53:08 +0000 UTC (0+1 container statuses recorded) Aug 18 12:00:53.885: INFO: Container c ready: false, restart count 0 Aug 18 12:00:53.885: INFO: server-envvars-dcc91a28-e119-476f-ad7b-86dc853ddeb4 started at 2021-08-18 11:52:28 +0000 UTC (0+1 container statuses recorded) Aug 18 12:00:53.885: INFO: Container srv ready: true, restart count 0 Aug 18 12:00:53.885: INFO: cmk-init-discover-node1-bxznx started at 2021-08-18 08:32:10 +0000 UTC (0+3 container statuses recorded) Aug 18 12:00:53.885: INFO: Container discover ready: false, restart count 0 Aug 18 12:00:53.885: INFO: Container init ready: false, restart count 0 Aug 18 12:00:53.885: INFO: Container install ready: false, restart count 0 Aug 18 12:00:53.885: INFO: collectd-xdprr started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 12:00:53.885: INFO: Container collectd ready: true, restart count 0 Aug 18 12:00:53.885: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 12:00:53.885: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 12:00:53.885: INFO: webserver-deployment-dd94f59b7-dbsxb started at 2021-08-18 11:56:51 +0000 UTC (0+1 container statuses recorded) Aug 18 12:00:53.885: INFO: Container httpd ready: false, restart count 0 Aug 18 12:00:53.885: INFO: webserver-deployment-dd94f59b7-dqt7r started at 2021-08-18 11:56:51 +0000 UTC (0+1 container statuses recorded) Aug 18 12:00:53.885: INFO: Container httpd ready: false, restart count 0 Aug 18 12:00:53.885: INFO: webserver-deployment-dd94f59b7-x65jh started at 2021-08-18 11:56:51 +0000 UTC (0+1 container statuses recorded) Aug 18 12:00:53.885: INFO: Container httpd ready: false, restart count 0 Aug 18 12:00:53.885: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-vsxvg started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 12:00:53.885: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 12:00:53.885: INFO: webserver-deployment-dd94f59b7-h8pvd started at 2021-08-18 11:56:51 +0000 UTC (0+1 container statuses recorded) Aug 18 12:00:53.885: INFO: Container httpd ready: false, restart count 0 Aug 18 12:00:53.885: INFO: kube-flannel-q78nd started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 12:00:53.885: INFO: Init container install-cni ready: true, restart count 2 Aug 18 12:00:53.885: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 12:00:53.885: INFO: prometheus-k8s-0 started at 2021-08-18 08:34:03 +0000 UTC (0+5 container statuses recorded) Aug 18 12:00:53.885: INFO: Container custom-metrics-apiserver ready: true, restart count 0 Aug 18 12:00:53.885: INFO: Container grafana ready: true, restart count 0 Aug 18 12:00:53.885: INFO: Container prometheus ready: true, restart count 1 Aug 18 12:00:53.885: INFO: Container prometheus-config-reloader ready: true, restart count 0 Aug 18 12:00:53.885: INFO: Container rules-configmap-reloader ready: true, restart count 0 Aug 18 12:00:53.885: INFO: webserver-deployment-dd94f59b7-rws9q started at 2021-08-18 11:56:51 +0000 UTC (0+1 container statuses recorded) Aug 18 12:00:53.885: INFO: Container httpd ready: false, restart count 0 Aug 18 12:00:53.885: INFO: kube-proxy-p6jvp started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 12:00:53.885: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 12:00:53.885: INFO: kubernetes-metrics-scraper-678c97765c-9nsv5 started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 12:00:53.885: INFO: Container kubernetes-metrics-scraper ready: true, restart count 2 Aug 18 12:00:53.885: INFO: cmk-d8r27 started at 2021-08-18 08:32:52 +0000 UTC (0+2 container statuses recorded) Aug 18 12:00:53.885: INFO: Container nodereport ready: true, restart count 0 Aug 18 12:00:53.885: INFO: Container reconcile ready: true, restart count 0 W0818 12:00:53.898174 26 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 12:00:53.938: INFO: Latency metrics for node node1 Aug 18 12:00:53.938: INFO: Logging node info for node node2 Aug 18 12:00:53.941: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 1d01177e-3dbb-48a1-a0bc-d18af27ab7f8 78206 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:d1:47:f8:1d:22"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:36 +0000 UTC,LastTransitionTime:2021-08-18 08:26:36 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 12:00:45 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 12:00:45 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 12:00:45 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 12:00:45 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:dc1f286135c145349b8a016880b65a2f,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:037e7e2d-94e9-42f4-a719-896e5005ac70,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 12:00:53.941: INFO: Logging kubelet events for node node2 Aug 18 12:00:53.943: INFO: Logging pods the kubelet thinks is on node node2 Aug 18 12:00:53.962: INFO: collectd-67ntq started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 12:00:53.962: INFO: Container collectd ready: true, restart count 0 Aug 18 12:00:53.962: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 12:00:53.962: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 12:00:53.962: INFO: kube-multus-ds-amd64-rvzsg started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 12:00:53.962: INFO: Container kube-multus ready: true, restart count 1 Aug 18 12:00:53.962: INFO: client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419 started at 2021-08-18 11:57:37 +0000 UTC (0+1 container statuses recorded) Aug 18 12:00:53.962: INFO: Container env3cont ready: false, restart count 0 Aug 18 12:00:53.962: INFO: cmk-webhook-6c9d5f8578-7cxjr started at 2021-08-18 08:32:53 +0000 UTC (0+1 container statuses recorded) Aug 18 12:00:53.962: INFO: Container cmk-webhook ready: true, restart count 0 Aug 18 12:00:53.962: INFO: node-exporter-lrrf2 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 12:00:53.962: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 12:00:53.962: INFO: Container node-exporter ready: true, restart count 0 Aug 18 12:00:53.962: INFO: webserver-deployment-dd94f59b7-g45zh started at 2021-08-18 11:56:51 +0000 UTC (0+1 container statuses recorded) Aug 18 12:00:53.962: INFO: Container httpd ready: false, restart count 0 Aug 18 12:00:53.962: INFO: foo-mcmfh started at 2021-08-18 11:53:08 +0000 UTC (0+1 container statuses recorded) Aug 18 12:00:53.962: INFO: Container c ready: false, restart count 0 Aug 18 12:00:53.962: INFO: kube-flannel-h7t5h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 12:00:53.962: INFO: Init container install-cni ready: true, restart count 2 Aug 18 12:00:53.962: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 12:00:53.962: INFO: cmk-init-discover-node2-6b2kz started at 2021-08-18 08:32:30 +0000 UTC (0+3 container statuses recorded) Aug 18 12:00:53.962: INFO: Container discover ready: false, restart count 0 Aug 18 12:00:53.962: INFO: Container init ready: false, restart count 0 Aug 18 12:00:53.962: INFO: Container install ready: false, restart count 0 Aug 18 12:00:53.962: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-7rn45 started at 2021-08-18 08:36:42 +0000 UTC (0+2 container statuses recorded) Aug 18 12:00:53.962: INFO: Container tas-controller ready: true, restart count 0 Aug 18 12:00:53.962: INFO: Container tas-extender ready: true, restart count 0 Aug 18 12:00:53.962: INFO: webserver-deployment-dd94f59b7-ttks8 started at 2021-08-18 11:56:51 +0000 UTC (0+1 container statuses recorded) Aug 18 12:00:53.962: INFO: Container httpd ready: false, restart count 0 Aug 18 12:00:53.962: INFO: nginx-proxy-node2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 12:00:53.962: INFO: Container nginx-proxy ready: true, restart count 1 Aug 18 12:00:53.962: INFO: webserver-deployment-dd94f59b7-4pbnc started at 2021-08-18 11:56:51 +0000 UTC (0+1 container statuses recorded) Aug 18 12:00:53.962: INFO: Container httpd ready: false, restart count 0 Aug 18 12:00:53.962: INFO: webserver-deployment-dd94f59b7-qmb69 started at 2021-08-18 11:56:51 +0000 UTC (0+1 container statuses recorded) Aug 18 12:00:53.962: INFO: Container httpd ready: false, restart count 0 Aug 18 12:00:53.962: INFO: webserver-deployment-dd94f59b7-bvwxs started at 2021-08-18 11:56:51 +0000 UTC (0+1 container statuses recorded) Aug 18 12:00:53.962: INFO: Container httpd ready: false, restart count 0 Aug 18 12:00:53.962: INFO: kubernetes-dashboard-86c6f9df5b-qrtdk started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 12:00:53.962: INFO: Container kubernetes-dashboard ready: true, restart count 2 Aug 18 12:00:53.962: INFO: cmk-748rz started at 2021-08-18 08:32:53 +0000 UTC (0+2 container statuses recorded) Aug 18 12:00:53.962: INFO: Container nodereport ready: true, restart count 0 Aug 18 12:00:53.962: INFO: Container reconcile ready: true, restart count 0 Aug 18 12:00:53.962: INFO: node-feature-discovery-worker-hzpf5 started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 12:00:53.962: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 12:00:53.962: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-c82pt started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 12:00:53.962: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 12:00:53.962: INFO: prometheus-operator-5bb8cb9d8f-k97ws started at 2021-08-18 08:33:38 +0000 UTC (0+2 container statuses recorded) Aug 18 12:00:53.962: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 12:00:53.962: INFO: Container prometheus-operator ready: true, restart count 0 Aug 18 12:00:53.962: INFO: kube-proxy-qkj9c started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 12:00:53.962: INFO: Container kube-proxy ready: true, restart count 2 W0818 12:00:53.974162 26 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 12:00:54.005: INFO: Latency metrics for node node2 Aug 18 12:00:54.005: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "downward-api-718" for this suite. • Failure [304.982 seconds] [sig-node] Downward API /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/downward_api.go:34 should provide pod name, namespace and IP address as env vars [NodeConformance] [Conformance] [It] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 12:00:53.669: Unexpected error: <*errors.errorString | 0xc004544f30>: { s: "expected pod \"downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c\" success: Gave up after waiting 5m0s for pod \"downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c\" to be \"Succeeded or Failed\"", } expected pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c" success: Gave up after waiting 5m0s for pod "downward-api-7916fac5-7b92-4094-81c7-87f20923ce8c" to be "Succeeded or Failed" occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 ------------------------------ {"msg":"FAILED [sig-node] Downward API should provide pod name, namespace and IP address as env vars [NodeConformance] [Conformance]","total":-1,"completed":18,"skipped":280,"failed":6,"failures":["[sig-apps] Deployment deployment should support rollover [Conformance]","[sig-network] Services should be able to switch session affinity for NodePort service [LinuxOnly] [Conformance]","[sig-node] Downward API should provide container's limits.cpu/memory and requests.cpu/memory as env vars [NodeConformance] [Conformance]","[k8s.io] [sig-node] PreStop should call prestop when killing a pod [Conformance]","[k8s.io] Container Runtime blackbox test when starting a container that exits should run with the expected status [NodeConformance] [Conformance]","[sig-node] Downward API should provide pod name, namespace and IP address as env vars [NodeConformance] [Conformance]"]} Aug 18 12:00:54.019: INFO: Running AfterSuite actions on all nodes [BeforeEach] [sig-apps] Deployment /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:56:51.143: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename deployment STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-apps] Deployment /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/deployment.go:78 [It] deployment should support proportional scaling [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:56:51.163: INFO: Creating deployment "webserver-deployment" Aug 18 11:56:51.167: INFO: Waiting for observed generation 1 Aug 18 11:56:53.172: INFO: Waiting for all required pods to come up Aug 18 11:56:53.175: INFO: Pod name httpd: Found 10 pods out of 10 STEP: ensuring each pod is running Aug 18 12:01:53.186: FAIL: error in waiting for pods to come up: failed to wait for pods running: [timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition] Unexpected error: <*errors.errorString | 0xc000683280>: { s: "failed to wait for pods running: [timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition]", } failed to wait for pods running: [timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition] occurred Full Stack Trace k8s.io/kubernetes/test/e2e/apps.testProportionalScalingDeployment(0xc000401e40) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/deployment.go:736 +0x7ef k8s.io/kubernetes/test/e2e/apps.glob..func4.10() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/deployment.go:135 +0x2a k8s.io/kubernetes/test/e2e.RunE2ETests(0xc00393c780) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc00393c780) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc00393c780, 0x4deb2c0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [sig-apps] Deployment /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/deployment.go:72 Aug 18 12:01:53.191: INFO: Deployment "webserver-deployment": &Deployment{ObjectMeta:{webserver-deployment deployment-1685 /apis/apps/v1/namespaces/deployment-1685/deployments/webserver-deployment bea9e6e1-aba8-4b32-9ddf-6ae31ec3cb52 76066 1 2021-08-18 11:56:51 +0000 UTC map[name:httpd] map[deployment.kubernetes.io/revision:1] [] [] [{e2e.test Update apps/v1 2021-08-18 11:56:51 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{".":{},"f:name":{}}},"f:spec":{"f:progressDeadlineSeconds":{},"f:replicas":{},"f:revisionHistoryLimit":{},"f:selector":{"f:matchLabels":{".":{},"f:name":{}}},"f:strategy":{"f:rollingUpdate":{".":{},"f:maxSurge":{},"f:maxUnavailable":{}},"f:type":{}},"f:template":{"f:metadata":{"f:labels":{".":{},"f:name":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"httpd\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}}}} {kube-controller-manager Update apps/v1 2021-08-18 11:56:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:deployment.kubernetes.io/revision":{}}},"f:status":{"f:conditions":{".":{},"k:{\"type\":\"Available\"}":{".":{},"f:lastTransitionTime":{},"f:lastUpdateTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Progressing\"}":{".":{},"f:lastTransitionTime":{},"f:lastUpdateTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:observedGeneration":{},"f:replicas":{},"f:unavailableReplicas":{},"f:updatedReplicas":{}}}}]},Spec:DeploymentSpec{Replicas:*10,Selector:&v1.LabelSelector{MatchLabels:map[string]string{name: httpd,},MatchExpressions:[]LabelSelectorRequirement{},},Template:{{ 0 0001-01-01 00:00:00 +0000 UTC map[name:httpd] map[] [] [] []} {[] [] [{httpd docker.io/library/httpd:2.4.38-alpine [] [] [] [] [] {map[] map[]} [] [] nil nil nil nil /dev/termination-log File IfNotPresent SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,} false false false}] [] Always 0xc000e36b88 ClusterFirst map[] false false false &PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,} [] nil default-scheduler [] [] nil [] map[] [] }},Strategy:DeploymentStrategy{Type:RollingUpdate,RollingUpdate:&RollingUpdateDeployment{MaxUnavailable:2,MaxSurge:3,},},MinReadySeconds:0,RevisionHistoryLimit:*10,Paused:false,ProgressDeadlineSeconds:*600,},Status:DeploymentStatus{ObservedGeneration:1,Replicas:10,UpdatedReplicas:10,AvailableReplicas:0,UnavailableReplicas:10,Conditions:[]DeploymentCondition{DeploymentCondition{Type:Available,Status:False,Reason:MinimumReplicasUnavailable,Message:Deployment does not have minimum availability.,LastUpdateTime:2021-08-18 11:56:51 +0000 UTC,LastTransitionTime:2021-08-18 11:56:51 +0000 UTC,},DeploymentCondition{Type:Progressing,Status:True,Reason:ReplicaSetUpdated,Message:ReplicaSet "webserver-deployment-dd94f59b7" is progressing.,LastUpdateTime:2021-08-18 11:56:51 +0000 UTC,LastTransitionTime:2021-08-18 11:56:51 +0000 UTC,},},ReadyReplicas:0,CollisionCount:nil,},} Aug 18 12:01:53.194: INFO: New ReplicaSet "webserver-deployment-dd94f59b7" of Deployment "webserver-deployment": &ReplicaSet{ObjectMeta:{webserver-deployment-dd94f59b7 deployment-1685 /apis/apps/v1/namespaces/deployment-1685/replicasets/webserver-deployment-dd94f59b7 bb798d44-15e5-4fe8-8f9a-ad4091ac1738 76065 1 2021-08-18 11:56:51 +0000 UTC map[name:httpd pod-template-hash:dd94f59b7] map[deployment.kubernetes.io/desired-replicas:10 deployment.kubernetes.io/max-replicas:13 deployment.kubernetes.io/revision:1] [{apps/v1 Deployment webserver-deployment bea9e6e1-aba8-4b32-9ddf-6ae31ec3cb52 0xc000e37ef7 0xc000e37ef8}] [] [{kube-controller-manager Update apps/v1 2021-08-18 11:56:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:deployment.kubernetes.io/desired-replicas":{},"f:deployment.kubernetes.io/max-replicas":{},"f:deployment.kubernetes.io/revision":{}},"f:labels":{".":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"bea9e6e1-aba8-4b32-9ddf-6ae31ec3cb52\"}":{".":{},"f:apiVersion":{},"f:blockOwnerDeletion":{},"f:controller":{},"f:kind":{},"f:name":{},"f:uid":{}}}},"f:spec":{"f:replicas":{},"f:selector":{"f:matchLabels":{".":{},"f:name":{},"f:pod-template-hash":{}}},"f:template":{"f:metadata":{"f:labels":{".":{},"f:name":{},"f:pod-template-hash":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"httpd\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}},"f:status":{"f:fullyLabeledReplicas":{},"f:observedGeneration":{},"f:replicas":{}}}}]},Spec:ReplicaSetSpec{Replicas:*10,Selector:&v1.LabelSelector{MatchLabels:map[string]string{name: httpd,pod-template-hash: dd94f59b7,},MatchExpressions:[]LabelSelectorRequirement{},},Template:{{ 0 0001-01-01 00:00:00 +0000 UTC map[name:httpd pod-template-hash:dd94f59b7] map[] [] [] []} {[] [] [{httpd docker.io/library/httpd:2.4.38-alpine [] [] [] [] [] {map[] map[]} [] [] nil nil nil nil /dev/termination-log File IfNotPresent SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,} false false false}] [] Always 0xc000e37f78 ClusterFirst map[] false false false &PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,} [] nil default-scheduler [] [] nil [] map[] [] }},MinReadySeconds:0,},Status:ReplicaSetStatus{Replicas:10,FullyLabeledReplicas:10,ObservedGeneration:1,ReadyReplicas:0,AvailableReplicas:0,Conditions:[]ReplicaSetCondition{},},} Aug 18 12:01:53.199: INFO: Pod "webserver-deployment-dd94f59b7-4pbnc" is not available: &Pod{ObjectMeta:{webserver-deployment-dd94f59b7-4pbnc webserver-deployment-dd94f59b7- deployment-1685 /api/v1/namespaces/deployment-1685/pods/webserver-deployment-dd94f59b7-4pbnc d46412d0-bffa-492d-880d-544605b3e86d 78140 0 2021-08-18 11:56:51 +0000 UTC map[name:httpd pod-template-hash:dd94f59b7] map[k8s.v1.cni.cncf.io/network-status:[{ "name": "default-cni-network", "interface": "eth0", "ips": [ "10.244.3.123" ], "mac": "02:1e:cd:53:3b:66", "default": true, "dns": {} }] k8s.v1.cni.cncf.io/networks-status:[{ "name": "default-cni-network", "interface": "eth0", "ips": [ "10.244.3.123" ], "mac": "02:1e:cd:53:3b:66", "default": true, "dns": {} }] kubernetes.io/psp:collectd] [{apps/v1 ReplicaSet webserver-deployment-dd94f59b7 bb798d44-15e5-4fe8-8f9a-ad4091ac1738 0xc00796a04f 0xc00796a060}] [] [{kube-controller-manager Update v1 2021-08-18 11:56:51 +0000 UTC FieldsV1 {"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"bb798d44-15e5-4fe8-8f9a-ad4091ac1738\"}":{".":{},"f:apiVersion":{},"f:blockOwnerDeletion":{},"f:controller":{},"f:kind":{},"f:name":{},"f:uid":{}}}},"f:spec":{"f:containers":{"k:{\"name\":\"httpd\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}} {multus Update v1 2021-08-18 11:56:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:k8s.v1.cni.cncf.io/network-status":{},"f:k8s.v1.cni.cncf.io/networks-status":{}}}}} {kubelet Update v1 2021-08-18 11:57:00 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:podIP":{},"f:podIPs":{".":{},"k:{\"ip\":\"10.244.3.123\"}":{".":{},"f:ip":{}}},"f:startTime":{}}}}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:default-token-mf6bc,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:&SecretVolumeSource{SecretName:default-token-mf6bc,Items:[]KeyToPath{},DefaultMode:*420,Optional:nil,},NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:httpd,Image:docker.io/library/httpd:2.4.38-alpine,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:default-token-mf6bc,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:Always,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*0,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:node2,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,},Status:PodStatus{Phase:Pending,Conditions:[]PodCondition{PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-08-18 11:56:51 +0000 UTC,Reason:,Message:,},PodCondition{Type:Ready,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-08-18 11:56:51 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:ContainersReady,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-08-18 11:56:51 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-08-18 11:56:51 +0000 UTC,Reason:,Message:,},},Message:,Reason:,HostIP:10.10.190.208,PodIP:10.244.3.123,StartTime:2021-08-18 11:56:51 +0000 UTC,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:httpd,State:ContainerState{Waiting:&ContainerStateWaiting{Reason:ImagePullBackOff,Message:Back-off pulling image "docker.io/library/httpd:2.4.38-alpine",},Running:nil,Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:false,RestartCount:0,Image:docker.io/library/httpd:2.4.38-alpine,ImageID:,ContainerID:,Started:*false,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{PodIP{IP:10.244.3.123,},},EphemeralContainerStatuses:[]ContainerStatus{},},} Aug 18 12:01:53.199: INFO: Pod "webserver-deployment-dd94f59b7-bvwxs" is not available: &Pod{ObjectMeta:{webserver-deployment-dd94f59b7-bvwxs webserver-deployment-dd94f59b7- deployment-1685 /api/v1/namespaces/deployment-1685/pods/webserver-deployment-dd94f59b7-bvwxs a10d51c1-4d72-4841-b13a-8c0064e45615 78157 0 2021-08-18 11:56:51 +0000 UTC map[name:httpd pod-template-hash:dd94f59b7] map[k8s.v1.cni.cncf.io/network-status:[{ "name": "default-cni-network", "interface": "eth0", "ips": [ "10.244.3.126" ], "mac": "82:ee:25:52:f0:2d", "default": true, "dns": {} }] k8s.v1.cni.cncf.io/networks-status:[{ "name": "default-cni-network", "interface": "eth0", "ips": [ "10.244.3.126" ], "mac": "82:ee:25:52:f0:2d", "default": true, "dns": {} }] kubernetes.io/psp:collectd] [{apps/v1 ReplicaSet webserver-deployment-dd94f59b7 bb798d44-15e5-4fe8-8f9a-ad4091ac1738 0xc00796a63f 0xc00796a650}] [] [{kube-controller-manager Update v1 2021-08-18 11:56:51 +0000 UTC FieldsV1 {"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"bb798d44-15e5-4fe8-8f9a-ad4091ac1738\"}":{".":{},"f:apiVersion":{},"f:blockOwnerDeletion":{},"f:controller":{},"f:kind":{},"f:name":{},"f:uid":{}}}},"f:spec":{"f:containers":{"k:{\"name\":\"httpd\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}} {multus Update v1 2021-08-18 11:56:59 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:k8s.v1.cni.cncf.io/network-status":{},"f:k8s.v1.cni.cncf.io/networks-status":{}}}}} {kubelet Update v1 2021-08-18 11:57:03 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:podIP":{},"f:podIPs":{".":{},"k:{\"ip\":\"10.244.3.126\"}":{".":{},"f:ip":{}}},"f:startTime":{}}}}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:default-token-mf6bc,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:&SecretVolumeSource{SecretName:default-token-mf6bc,Items:[]KeyToPath{},DefaultMode:*420,Optional:nil,},NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:httpd,Image:docker.io/library/httpd:2.4.38-alpine,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:default-token-mf6bc,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:Always,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*0,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:node2,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,},Status:PodStatus{Phase:Pending,Conditions:[]PodCondition{PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-08-18 11:56:51 +0000 UTC,Reason:,Message:,},PodCondition{Type:Ready,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-08-18 11:56:51 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:ContainersReady,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-08-18 11:56:51 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-08-18 11:56:51 +0000 UTC,Reason:,Message:,},},Message:,Reason:,HostIP:10.10.190.208,PodIP:10.244.3.126,StartTime:2021-08-18 11:56:51 +0000 UTC,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:httpd,State:ContainerState{Waiting:&ContainerStateWaiting{Reason:ImagePullBackOff,Message:Back-off pulling image "docker.io/library/httpd:2.4.38-alpine",},Running:nil,Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:false,RestartCount:0,Image:docker.io/library/httpd:2.4.38-alpine,ImageID:,ContainerID:,Started:*false,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{PodIP{IP:10.244.3.126,},},EphemeralContainerStatuses:[]ContainerStatus{},},} Aug 18 12:01:53.199: INFO: Pod "webserver-deployment-dd94f59b7-dbsxb" is not available: &Pod{ObjectMeta:{webserver-deployment-dd94f59b7-dbsxb webserver-deployment-dd94f59b7- deployment-1685 /api/v1/namespaces/deployment-1685/pods/webserver-deployment-dd94f59b7-dbsxb f5a50395-936c-4765-a5ab-114edf51af91 78154 0 2021-08-18 11:56:51 +0000 UTC map[name:httpd pod-template-hash:dd94f59b7] map[k8s.v1.cni.cncf.io/network-status:[{ "name": "default-cni-network", "interface": "eth0", "ips": [ "10.244.4.134" ], "mac": "06:4a:ef:4f:26:b4", "default": true, "dns": {} }] k8s.v1.cni.cncf.io/networks-status:[{ "name": "default-cni-network", "interface": "eth0", "ips": [ "10.244.4.134" ], "mac": "06:4a:ef:4f:26:b4", "default": true, "dns": {} }] kubernetes.io/psp:collectd] [{apps/v1 ReplicaSet webserver-deployment-dd94f59b7 bb798d44-15e5-4fe8-8f9a-ad4091ac1738 0xc00796a9bf 0xc00796a9d0}] [] [{kube-controller-manager Update v1 2021-08-18 11:56:51 +0000 UTC FieldsV1 {"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"bb798d44-15e5-4fe8-8f9a-ad4091ac1738\"}":{".":{},"f:apiVersion":{},"f:blockOwnerDeletion":{},"f:controller":{},"f:kind":{},"f:name":{},"f:uid":{}}}},"f:spec":{"f:containers":{"k:{\"name\":\"httpd\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}} {multus Update v1 2021-08-18 11:56:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:k8s.v1.cni.cncf.io/network-status":{},"f:k8s.v1.cni.cncf.io/networks-status":{}}}}} {kubelet Update v1 2021-08-18 11:57:05 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:podIP":{},"f:podIPs":{".":{},"k:{\"ip\":\"10.244.4.134\"}":{".":{},"f:ip":{}}},"f:startTime":{}}}}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:default-token-mf6bc,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:&SecretVolumeSource{SecretName:default-token-mf6bc,Items:[]KeyToPath{},DefaultMode:*420,Optional:nil,},NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:httpd,Image:docker.io/library/httpd:2.4.38-alpine,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:default-token-mf6bc,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:Always,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*0,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:node1,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,},Status:PodStatus{Phase:Pending,Conditions:[]PodCondition{PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-08-18 11:56:51 +0000 UTC,Reason:,Message:,},PodCondition{Type:Ready,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-08-18 11:56:51 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:ContainersReady,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-08-18 11:56:51 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-08-18 11:56:51 +0000 UTC,Reason:,Message:,},},Message:,Reason:,HostIP:10.10.190.207,PodIP:10.244.4.134,StartTime:2021-08-18 11:56:51 +0000 UTC,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:httpd,State:ContainerState{Waiting:&ContainerStateWaiting{Reason:ImagePullBackOff,Message:Back-off pulling image "docker.io/library/httpd:2.4.38-alpine",},Running:nil,Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:false,RestartCount:0,Image:docker.io/library/httpd:2.4.38-alpine,ImageID:,ContainerID:,Started:*false,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{PodIP{IP:10.244.4.134,},},EphemeralContainerStatuses:[]ContainerStatus{},},} Aug 18 12:01:53.200: INFO: Pod "webserver-deployment-dd94f59b7-dqt7r" is not available: &Pod{ObjectMeta:{webserver-deployment-dd94f59b7-dqt7r webserver-deployment-dd94f59b7- deployment-1685 /api/v1/namespaces/deployment-1685/pods/webserver-deployment-dd94f59b7-dqt7r 27ff6eed-83ee-4259-b413-41ca606641be 78164 0 2021-08-18 11:56:51 +0000 UTC map[name:httpd pod-template-hash:dd94f59b7] map[k8s.v1.cni.cncf.io/network-status:[{ "name": "default-cni-network", "interface": "eth0", "ips": [ "10.244.4.144" ], "mac": "1e:0f:eb:35:be:b7", "default": true, "dns": {} }] k8s.v1.cni.cncf.io/networks-status:[{ "name": "default-cni-network", "interface": "eth0", "ips": [ "10.244.4.144" ], "mac": "1e:0f:eb:35:be:b7", "default": true, "dns": {} }] kubernetes.io/psp:collectd] [{apps/v1 ReplicaSet webserver-deployment-dd94f59b7 bb798d44-15e5-4fe8-8f9a-ad4091ac1738 0xc00796adbf 0xc00796add0}] [] [{kube-controller-manager Update v1 2021-08-18 11:56:51 +0000 UTC FieldsV1 {"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"bb798d44-15e5-4fe8-8f9a-ad4091ac1738\"}":{".":{},"f:apiVersion":{},"f:blockOwnerDeletion":{},"f:controller":{},"f:kind":{},"f:name":{},"f:uid":{}}}},"f:spec":{"f:containers":{"k:{\"name\":\"httpd\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}} {kubelet Update v1 2021-08-18 11:57:08 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:podIP":{},"f:podIPs":{".":{},"k:{\"ip\":\"10.244.4.144\"}":{".":{},"f:ip":{}}},"f:startTime":{}}}} {multus Update v1 2021-08-18 11:57:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:k8s.v1.cni.cncf.io/network-status":{},"f:k8s.v1.cni.cncf.io/networks-status":{}}}}}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:default-token-mf6bc,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:&SecretVolumeSource{SecretName:default-token-mf6bc,Items:[]KeyToPath{},DefaultMode:*420,Optional:nil,},NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:httpd,Image:docker.io/library/httpd:2.4.38-alpine,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:default-token-mf6bc,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:Always,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*0,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:node1,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,},Status:PodStatus{Phase:Pending,Conditions:[]PodCondition{PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-08-18 11:56:51 +0000 UTC,Reason:,Message:,},PodCondition{Type:Ready,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-08-18 11:56:51 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:ContainersReady,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-08-18 11:56:51 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-08-18 11:56:51 +0000 UTC,Reason:,Message:,},},Message:,Reason:,HostIP:10.10.190.207,PodIP:10.244.4.144,StartTime:2021-08-18 11:56:51 +0000 UTC,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:httpd,State:ContainerState{Waiting:&ContainerStateWaiting{Reason:ImagePullBackOff,Message:Back-off pulling image "docker.io/library/httpd:2.4.38-alpine",},Running:nil,Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:false,RestartCount:0,Image:docker.io/library/httpd:2.4.38-alpine,ImageID:,ContainerID:,Started:*false,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{PodIP{IP:10.244.4.144,},},EphemeralContainerStatuses:[]ContainerStatus{},},} Aug 18 12:01:53.200: INFO: Pod "webserver-deployment-dd94f59b7-g45zh" is not available: &Pod{ObjectMeta:{webserver-deployment-dd94f59b7-g45zh webserver-deployment-dd94f59b7- deployment-1685 /api/v1/namespaces/deployment-1685/pods/webserver-deployment-dd94f59b7-g45zh 168fa189-4839-4e52-9b1f-167f45e43c7d 78127 0 2021-08-18 11:56:51 +0000 UTC map[name:httpd pod-template-hash:dd94f59b7] map[k8s.v1.cni.cncf.io/network-status:[{ "name": "default-cni-network", "interface": "eth0", "ips": [ "10.244.3.122" ], "mac": "82:44:55:d3:2d:ac", "default": true, "dns": {} }] k8s.v1.cni.cncf.io/networks-status:[{ "name": "default-cni-network", "interface": "eth0", "ips": [ "10.244.3.122" ], "mac": "82:44:55:d3:2d:ac", "default": true, "dns": {} }] kubernetes.io/psp:collectd] [{apps/v1 ReplicaSet webserver-deployment-dd94f59b7 bb798d44-15e5-4fe8-8f9a-ad4091ac1738 0xc00796af8f 0xc00796b090}] [] [{kube-controller-manager Update v1 2021-08-18 11:56:51 +0000 UTC FieldsV1 {"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"bb798d44-15e5-4fe8-8f9a-ad4091ac1738\"}":{".":{},"f:apiVersion":{},"f:blockOwnerDeletion":{},"f:controller":{},"f:kind":{},"f:name":{},"f:uid":{}}}},"f:spec":{"f:containers":{"k:{\"name\":\"httpd\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}} {multus Update v1 2021-08-18 11:56:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:k8s.v1.cni.cncf.io/network-status":{},"f:k8s.v1.cni.cncf.io/networks-status":{}}}}} {kubelet Update v1 2021-08-18 11:56:59 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:podIP":{},"f:podIPs":{".":{},"k:{\"ip\":\"10.244.3.122\"}":{".":{},"f:ip":{}}},"f:startTime":{}}}}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:default-token-mf6bc,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:&SecretVolumeSource{SecretName:default-token-mf6bc,Items:[]KeyToPath{},DefaultMode:*420,Optional:nil,},NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:httpd,Image:docker.io/library/httpd:2.4.38-alpine,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:default-token-mf6bc,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:Always,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*0,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:node2,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,},Status:PodStatus{Phase:Pending,Conditions:[]PodCondition{PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-08-18 11:56:51 +0000 UTC,Reason:,Message:,},PodCondition{Type:Ready,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-08-18 11:56:51 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:ContainersReady,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-08-18 11:56:51 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-08-18 11:56:51 +0000 UTC,Reason:,Message:,},},Message:,Reason:,HostIP:10.10.190.208,PodIP:10.244.3.122,StartTime:2021-08-18 11:56:51 +0000 UTC,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:httpd,State:ContainerState{Waiting:&ContainerStateWaiting{Reason:ImagePullBackOff,Message:Back-off pulling image "docker.io/library/httpd:2.4.38-alpine",},Running:nil,Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:false,RestartCount:0,Image:docker.io/library/httpd:2.4.38-alpine,ImageID:,ContainerID:,Started:*false,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{PodIP{IP:10.244.3.122,},},EphemeralContainerStatuses:[]ContainerStatus{},},} Aug 18 12:01:53.200: INFO: Pod "webserver-deployment-dd94f59b7-h8pvd" is not available: &Pod{ObjectMeta:{webserver-deployment-dd94f59b7-h8pvd webserver-deployment-dd94f59b7- deployment-1685 /api/v1/namespaces/deployment-1685/pods/webserver-deployment-dd94f59b7-h8pvd 8463d969-c1e4-4aff-aac0-48e8adfd1ebf 78177 0 2021-08-18 11:56:51 +0000 UTC map[name:httpd pod-template-hash:dd94f59b7] map[k8s.v1.cni.cncf.io/network-status:[{ "name": "default-cni-network", "interface": "eth0", "ips": [ "10.244.4.137" ], "mac": "7e:15:11:4f:b9:68", "default": true, "dns": {} }] k8s.v1.cni.cncf.io/networks-status:[{ "name": "default-cni-network", "interface": "eth0", "ips": [ "10.244.4.137" ], "mac": "7e:15:11:4f:b9:68", "default": true, "dns": {} }] kubernetes.io/psp:collectd] [{apps/v1 ReplicaSet webserver-deployment-dd94f59b7 bb798d44-15e5-4fe8-8f9a-ad4091ac1738 0xc00796b4df 0xc00796b4f0}] [] [{kube-controller-manager Update v1 2021-08-18 11:56:51 +0000 UTC FieldsV1 {"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"bb798d44-15e5-4fe8-8f9a-ad4091ac1738\"}":{".":{},"f:apiVersion":{},"f:blockOwnerDeletion":{},"f:controller":{},"f:kind":{},"f:name":{},"f:uid":{}}}},"f:spec":{"f:containers":{"k:{\"name\":\"httpd\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}} {multus Update v1 2021-08-18 11:56:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:k8s.v1.cni.cncf.io/network-status":{},"f:k8s.v1.cni.cncf.io/networks-status":{}}}}} {kubelet Update v1 2021-08-18 11:57:06 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:podIP":{},"f:podIPs":{".":{},"k:{\"ip\":\"10.244.4.137\"}":{".":{},"f:ip":{}}},"f:startTime":{}}}}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:default-token-mf6bc,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:&SecretVolumeSource{SecretName:default-token-mf6bc,Items:[]KeyToPath{},DefaultMode:*420,Optional:nil,},NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:httpd,Image:docker.io/library/httpd:2.4.38-alpine,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:default-token-mf6bc,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:Always,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*0,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:node1,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,},Status:PodStatus{Phase:Pending,Conditions:[]PodCondition{PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-08-18 11:56:51 +0000 UTC,Reason:,Message:,},PodCondition{Type:Ready,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-08-18 11:56:51 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:ContainersReady,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-08-18 11:56:51 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-08-18 11:56:51 +0000 UTC,Reason:,Message:,},},Message:,Reason:,HostIP:10.10.190.207,PodIP:10.244.4.137,StartTime:2021-08-18 11:56:51 +0000 UTC,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:httpd,State:ContainerState{Waiting:&ContainerStateWaiting{Reason:ImagePullBackOff,Message:Back-off pulling image "docker.io/library/httpd:2.4.38-alpine",},Running:nil,Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:false,RestartCount:0,Image:docker.io/library/httpd:2.4.38-alpine,ImageID:,ContainerID:,Started:*false,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{PodIP{IP:10.244.4.137,},},EphemeralContainerStatuses:[]ContainerStatus{},},} Aug 18 12:01:53.201: INFO: Pod "webserver-deployment-dd94f59b7-qmb69" is not available: &Pod{ObjectMeta:{webserver-deployment-dd94f59b7-qmb69 webserver-deployment-dd94f59b7- deployment-1685 /api/v1/namespaces/deployment-1685/pods/webserver-deployment-dd94f59b7-qmb69 c659ba38-d60c-47ac-ab14-be6fd1327d55 78174 0 2021-08-18 11:56:51 +0000 UTC map[name:httpd pod-template-hash:dd94f59b7] map[k8s.v1.cni.cncf.io/network-status:[{ "name": "default-cni-network", "interface": "eth0", "ips": [ "10.244.3.124" ], "mac": "4a:74:da:0b:b8:63", "default": true, "dns": {} }] k8s.v1.cni.cncf.io/networks-status:[{ "name": "default-cni-network", "interface": "eth0", "ips": [ "10.244.3.124" ], "mac": "4a:74:da:0b:b8:63", "default": true, "dns": {} }] kubernetes.io/psp:collectd] [{apps/v1 ReplicaSet webserver-deployment-dd94f59b7 bb798d44-15e5-4fe8-8f9a-ad4091ac1738 0xc00796b6ef 0xc00796b700}] [] [{kube-controller-manager Update v1 2021-08-18 11:56:51 +0000 UTC FieldsV1 {"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"bb798d44-15e5-4fe8-8f9a-ad4091ac1738\"}":{".":{},"f:apiVersion":{},"f:blockOwnerDeletion":{},"f:controller":{},"f:kind":{},"f:name":{},"f:uid":{}}}},"f:spec":{"f:containers":{"k:{\"name\":\"httpd\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}} {multus Update v1 2021-08-18 11:56:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:k8s.v1.cni.cncf.io/network-status":{},"f:k8s.v1.cni.cncf.io/networks-status":{}}}}} {kubelet Update v1 2021-08-18 11:57:02 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:podIP":{},"f:podIPs":{".":{},"k:{\"ip\":\"10.244.3.124\"}":{".":{},"f:ip":{}}},"f:startTime":{}}}}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:default-token-mf6bc,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:&SecretVolumeSource{SecretName:default-token-mf6bc,Items:[]KeyToPath{},DefaultMode:*420,Optional:nil,},NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:httpd,Image:docker.io/library/httpd:2.4.38-alpine,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:default-token-mf6bc,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:Always,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*0,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:node2,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,},Status:PodStatus{Phase:Pending,Conditions:[]PodCondition{PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-08-18 11:56:51 +0000 UTC,Reason:,Message:,},PodCondition{Type:Ready,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-08-18 11:56:51 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:ContainersReady,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-08-18 11:56:51 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-08-18 11:56:51 +0000 UTC,Reason:,Message:,},},Message:,Reason:,HostIP:10.10.190.208,PodIP:10.244.3.124,StartTime:2021-08-18 11:56:51 +0000 UTC,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:httpd,State:ContainerState{Waiting:&ContainerStateWaiting{Reason:ImagePullBackOff,Message:Back-off pulling image "docker.io/library/httpd:2.4.38-alpine",},Running:nil,Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:false,RestartCount:0,Image:docker.io/library/httpd:2.4.38-alpine,ImageID:,ContainerID:,Started:*false,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{PodIP{IP:10.244.3.124,},},EphemeralContainerStatuses:[]ContainerStatus{},},} Aug 18 12:01:53.201: INFO: Pod "webserver-deployment-dd94f59b7-rws9q" is not available: &Pod{ObjectMeta:{webserver-deployment-dd94f59b7-rws9q webserver-deployment-dd94f59b7- deployment-1685 /api/v1/namespaces/deployment-1685/pods/webserver-deployment-dd94f59b7-rws9q 71110beb-9e2c-42d9-b8a0-b51a282e503d 78084 0 2021-08-18 11:56:51 +0000 UTC map[name:httpd pod-template-hash:dd94f59b7] map[k8s.v1.cni.cncf.io/network-status:[{ "name": "default-cni-network", "interface": "eth0", "ips": [ "10.244.4.135" ], "mac": "c6:0a:ac:9f:47:9e", "default": true, "dns": {} }] k8s.v1.cni.cncf.io/networks-status:[{ "name": "default-cni-network", "interface": "eth0", "ips": [ "10.244.4.135" ], "mac": "c6:0a:ac:9f:47:9e", "default": true, "dns": {} }] kubernetes.io/psp:collectd] [{apps/v1 ReplicaSet webserver-deployment-dd94f59b7 bb798d44-15e5-4fe8-8f9a-ad4091ac1738 0xc00796b8cf 0xc00796b8e0}] [] [{kube-controller-manager Update v1 2021-08-18 11:56:51 +0000 UTC FieldsV1 {"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"bb798d44-15e5-4fe8-8f9a-ad4091ac1738\"}":{".":{},"f:apiVersion":{},"f:blockOwnerDeletion":{},"f:controller":{},"f:kind":{},"f:name":{},"f:uid":{}}}},"f:spec":{"f:containers":{"k:{\"name\":\"httpd\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}} {multus Update v1 2021-08-18 11:56:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:k8s.v1.cni.cncf.io/network-status":{},"f:k8s.v1.cni.cncf.io/networks-status":{}}}}} {kubelet Update v1 2021-08-18 11:57:02 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:podIP":{},"f:podIPs":{".":{},"k:{\"ip\":\"10.244.4.135\"}":{".":{},"f:ip":{}}},"f:startTime":{}}}}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:default-token-mf6bc,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:&SecretVolumeSource{SecretName:default-token-mf6bc,Items:[]KeyToPath{},DefaultMode:*420,Optional:nil,},NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:httpd,Image:docker.io/library/httpd:2.4.38-alpine,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:default-token-mf6bc,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:Always,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*0,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:node1,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,},Status:PodStatus{Phase:Pending,Conditions:[]PodCondition{PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-08-18 11:56:51 +0000 UTC,Reason:,Message:,},PodCondition{Type:Ready,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-08-18 11:56:51 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:ContainersReady,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-08-18 11:56:51 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-08-18 11:56:51 +0000 UTC,Reason:,Message:,},},Message:,Reason:,HostIP:10.10.190.207,PodIP:10.244.4.135,StartTime:2021-08-18 11:56:51 +0000 UTC,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:httpd,State:ContainerState{Waiting:&ContainerStateWaiting{Reason:ImagePullBackOff,Message:Back-off pulling image "docker.io/library/httpd:2.4.38-alpine",},Running:nil,Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:false,RestartCount:0,Image:docker.io/library/httpd:2.4.38-alpine,ImageID:,ContainerID:,Started:*false,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{PodIP{IP:10.244.4.135,},},EphemeralContainerStatuses:[]ContainerStatus{},},} Aug 18 12:01:53.201: INFO: Pod "webserver-deployment-dd94f59b7-ttks8" is not available: &Pod{ObjectMeta:{webserver-deployment-dd94f59b7-ttks8 webserver-deployment-dd94f59b7- deployment-1685 /api/v1/namespaces/deployment-1685/pods/webserver-deployment-dd94f59b7-ttks8 e17f792d-fbc1-4557-9bd3-8266db8b2ce1 78184 0 2021-08-18 11:56:51 +0000 UTC map[name:httpd pod-template-hash:dd94f59b7] map[k8s.v1.cni.cncf.io/network-status:[{ "name": "default-cni-network", "interface": "eth0", "ips": [ "10.244.3.125" ], "mac": "7a:49:26:9c:1c:5c", "default": true, "dns": {} }] k8s.v1.cni.cncf.io/networks-status:[{ "name": "default-cni-network", "interface": "eth0", "ips": [ "10.244.3.125" ], "mac": "7a:49:26:9c:1c:5c", "default": true, "dns": {} }] kubernetes.io/psp:collectd] [{apps/v1 ReplicaSet webserver-deployment-dd94f59b7 bb798d44-15e5-4fe8-8f9a-ad4091ac1738 0xc00796ba9f 0xc00796bab0}] [] [{kube-controller-manager Update v1 2021-08-18 11:56:51 +0000 UTC FieldsV1 {"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"bb798d44-15e5-4fe8-8f9a-ad4091ac1738\"}":{".":{},"f:apiVersion":{},"f:blockOwnerDeletion":{},"f:controller":{},"f:kind":{},"f:name":{},"f:uid":{}}}},"f:spec":{"f:containers":{"k:{\"name\":\"httpd\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}} {multus Update v1 2021-08-18 11:56:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:k8s.v1.cni.cncf.io/network-status":{},"f:k8s.v1.cni.cncf.io/networks-status":{}}}}} {kubelet Update v1 2021-08-18 11:57:02 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:podIP":{},"f:podIPs":{".":{},"k:{\"ip\":\"10.244.3.125\"}":{".":{},"f:ip":{}}},"f:startTime":{}}}}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:default-token-mf6bc,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:&SecretVolumeSource{SecretName:default-token-mf6bc,Items:[]KeyToPath{},DefaultMode:*420,Optional:nil,},NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:httpd,Image:docker.io/library/httpd:2.4.38-alpine,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:default-token-mf6bc,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:Always,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*0,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:node2,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,},Status:PodStatus{Phase:Pending,Conditions:[]PodCondition{PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-08-18 11:56:51 +0000 UTC,Reason:,Message:,},PodCondition{Type:Ready,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-08-18 11:56:51 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:ContainersReady,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-08-18 11:56:51 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-08-18 11:56:51 +0000 UTC,Reason:,Message:,},},Message:,Reason:,HostIP:10.10.190.208,PodIP:10.244.3.125,StartTime:2021-08-18 11:56:51 +0000 UTC,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:httpd,State:ContainerState{Waiting:&ContainerStateWaiting{Reason:ImagePullBackOff,Message:Back-off pulling image "docker.io/library/httpd:2.4.38-alpine",},Running:nil,Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:false,RestartCount:0,Image:docker.io/library/httpd:2.4.38-alpine,ImageID:,ContainerID:,Started:*false,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{PodIP{IP:10.244.3.125,},},EphemeralContainerStatuses:[]ContainerStatus{},},} Aug 18 12:01:53.202: INFO: Pod "webserver-deployment-dd94f59b7-x65jh" is not available: &Pod{ObjectMeta:{webserver-deployment-dd94f59b7-x65jh webserver-deployment-dd94f59b7- deployment-1685 /api/v1/namespaces/deployment-1685/pods/webserver-deployment-dd94f59b7-x65jh 9f83cd1b-6093-4853-b40d-1f81eb0025b6 78156 0 2021-08-18 11:56:51 +0000 UTC map[name:httpd pod-template-hash:dd94f59b7] map[k8s.v1.cni.cncf.io/network-status:[{ "name": "default-cni-network", "interface": "eth0", "ips": [ "10.244.4.136" ], "mac": "2e:3e:e9:e4:b1:74", "default": true, "dns": {} }] k8s.v1.cni.cncf.io/networks-status:[{ "name": "default-cni-network", "interface": "eth0", "ips": [ "10.244.4.136" ], "mac": "2e:3e:e9:e4:b1:74", "default": true, "dns": {} }] kubernetes.io/psp:collectd] [{apps/v1 ReplicaSet webserver-deployment-dd94f59b7 bb798d44-15e5-4fe8-8f9a-ad4091ac1738 0xc00796bc7f 0xc00796bc90}] [] [{kube-controller-manager Update v1 2021-08-18 11:56:51 +0000 UTC FieldsV1 {"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"bb798d44-15e5-4fe8-8f9a-ad4091ac1738\"}":{".":{},"f:apiVersion":{},"f:blockOwnerDeletion":{},"f:controller":{},"f:kind":{},"f:name":{},"f:uid":{}}}},"f:spec":{"f:containers":{"k:{\"name\":\"httpd\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}} {multus Update v1 2021-08-18 11:56:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:k8s.v1.cni.cncf.io/network-status":{},"f:k8s.v1.cni.cncf.io/networks-status":{}}}}} {kubelet Update v1 2021-08-18 11:57:05 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:podIP":{},"f:podIPs":{".":{},"k:{\"ip\":\"10.244.4.136\"}":{".":{},"f:ip":{}}},"f:startTime":{}}}}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:default-token-mf6bc,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:&SecretVolumeSource{SecretName:default-token-mf6bc,Items:[]KeyToPath{},DefaultMode:*420,Optional:nil,},NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:httpd,Image:docker.io/library/httpd:2.4.38-alpine,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:default-token-mf6bc,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:Always,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*0,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:node1,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,},Status:PodStatus{Phase:Pending,Conditions:[]PodCondition{PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-08-18 11:56:51 +0000 UTC,Reason:,Message:,},PodCondition{Type:Ready,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-08-18 11:56:51 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:ContainersReady,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-08-18 11:56:51 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2021-08-18 11:56:51 +0000 UTC,Reason:,Message:,},},Message:,Reason:,HostIP:10.10.190.207,PodIP:10.244.4.136,StartTime:2021-08-18 11:56:51 +0000 UTC,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:httpd,State:ContainerState{Waiting:&ContainerStateWaiting{Reason:ImagePullBackOff,Message:Back-off pulling image "docker.io/library/httpd:2.4.38-alpine",},Running:nil,Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:false,RestartCount:0,Image:docker.io/library/httpd:2.4.38-alpine,ImageID:,ContainerID:,Started:*false,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{PodIP{IP:10.244.4.136,},},EphemeralContainerStatuses:[]ContainerStatus{},},} [AfterEach] [sig-apps] Deployment /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "deployment-1685". STEP: Found 83 events. Aug 18 12:01:53.207: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for webserver-deployment-dd94f59b7-4pbnc: { } Scheduled: Successfully assigned deployment-1685/webserver-deployment-dd94f59b7-4pbnc to node2 Aug 18 12:01:53.207: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for webserver-deployment-dd94f59b7-bvwxs: { } Scheduled: Successfully assigned deployment-1685/webserver-deployment-dd94f59b7-bvwxs to node2 Aug 18 12:01:53.207: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for webserver-deployment-dd94f59b7-dbsxb: { } Scheduled: Successfully assigned deployment-1685/webserver-deployment-dd94f59b7-dbsxb to node1 Aug 18 12:01:53.207: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for webserver-deployment-dd94f59b7-dqt7r: { } Scheduled: Successfully assigned deployment-1685/webserver-deployment-dd94f59b7-dqt7r to node1 Aug 18 12:01:53.207: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for webserver-deployment-dd94f59b7-g45zh: { } Scheduled: Successfully assigned deployment-1685/webserver-deployment-dd94f59b7-g45zh to node2 Aug 18 12:01:53.207: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for webserver-deployment-dd94f59b7-h8pvd: { } Scheduled: Successfully assigned deployment-1685/webserver-deployment-dd94f59b7-h8pvd to node1 Aug 18 12:01:53.207: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for webserver-deployment-dd94f59b7-qmb69: { } Scheduled: Successfully assigned deployment-1685/webserver-deployment-dd94f59b7-qmb69 to node2 Aug 18 12:01:53.207: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for webserver-deployment-dd94f59b7-rws9q: { } Scheduled: Successfully assigned deployment-1685/webserver-deployment-dd94f59b7-rws9q to node1 Aug 18 12:01:53.207: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for webserver-deployment-dd94f59b7-ttks8: { } Scheduled: Successfully assigned deployment-1685/webserver-deployment-dd94f59b7-ttks8 to node2 Aug 18 12:01:53.207: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for webserver-deployment-dd94f59b7-x65jh: { } Scheduled: Successfully assigned deployment-1685/webserver-deployment-dd94f59b7-x65jh to node1 Aug 18 12:01:53.207: INFO: At 2021-08-18 11:56:51 +0000 UTC - event for webserver-deployment: {deployment-controller } ScalingReplicaSet: Scaled up replica set webserver-deployment-dd94f59b7 to 10 Aug 18 12:01:53.207: INFO: At 2021-08-18 11:56:51 +0000 UTC - event for webserver-deployment-dd94f59b7: {replicaset-controller } SuccessfulCreate: Created pod: webserver-deployment-dd94f59b7-dqt7r Aug 18 12:01:53.207: INFO: At 2021-08-18 11:56:51 +0000 UTC - event for webserver-deployment-dd94f59b7: {replicaset-controller } SuccessfulCreate: Created pod: webserver-deployment-dd94f59b7-bvwxs Aug 18 12:01:53.207: INFO: At 2021-08-18 11:56:51 +0000 UTC - event for webserver-deployment-dd94f59b7: {replicaset-controller } SuccessfulCreate: Created pod: webserver-deployment-dd94f59b7-qmb69 Aug 18 12:01:53.207: INFO: At 2021-08-18 11:56:51 +0000 UTC - event for webserver-deployment-dd94f59b7: {replicaset-controller } SuccessfulCreate: (combined from similar events): Created pod: webserver-deployment-dd94f59b7-x65jh Aug 18 12:01:53.207: INFO: At 2021-08-18 11:56:51 +0000 UTC - event for webserver-deployment-dd94f59b7: {replicaset-controller } SuccessfulCreate: Created pod: webserver-deployment-dd94f59b7-g45zh Aug 18 12:01:53.207: INFO: At 2021-08-18 11:56:51 +0000 UTC - event for webserver-deployment-dd94f59b7: {replicaset-controller } SuccessfulCreate: Created pod: webserver-deployment-dd94f59b7-dbsxb Aug 18 12:01:53.207: INFO: At 2021-08-18 11:56:51 +0000 UTC - event for webserver-deployment-dd94f59b7: {replicaset-controller } SuccessfulCreate: Created pod: webserver-deployment-dd94f59b7-4pbnc Aug 18 12:01:53.207: INFO: At 2021-08-18 11:56:51 +0000 UTC - event for webserver-deployment-dd94f59b7: {replicaset-controller } SuccessfulCreate: Created pod: webserver-deployment-dd94f59b7-h8pvd Aug 18 12:01:53.207: INFO: At 2021-08-18 11:56:51 +0000 UTC - event for webserver-deployment-dd94f59b7: {replicaset-controller } SuccessfulCreate: Created pod: webserver-deployment-dd94f59b7-ttks8 Aug 18 12:01:53.207: INFO: At 2021-08-18 11:56:51 +0000 UTC - event for webserver-deployment-dd94f59b7: {replicaset-controller } SuccessfulCreate: Created pod: webserver-deployment-dd94f59b7-rws9q Aug 18 12:01:53.207: INFO: At 2021-08-18 11:56:56 +0000 UTC - event for webserver-deployment-dd94f59b7-g45zh: {kubelet node2} Pulling: Pulling image "docker.io/library/httpd:2.4.38-alpine" Aug 18 12:01:53.207: INFO: At 2021-08-18 11:56:56 +0000 UTC - event for webserver-deployment-dd94f59b7-g45zh: {multus } AddedInterface: Add eth0 [10.244.3.122/24] Aug 18 12:01:53.207: INFO: At 2021-08-18 11:56:57 +0000 UTC - event for webserver-deployment-dd94f59b7-4pbnc: {multus } AddedInterface: Add eth0 [10.244.3.123/24] Aug 18 12:01:53.207: INFO: At 2021-08-18 11:56:57 +0000 UTC - event for webserver-deployment-dd94f59b7-4pbnc: {kubelet node2} Pulling: Pulling image "docker.io/library/httpd:2.4.38-alpine" Aug 18 12:01:53.207: INFO: At 2021-08-18 11:56:58 +0000 UTC - event for webserver-deployment-dd94f59b7-dbsxb: {kubelet node1} Pulling: Pulling image "docker.io/library/httpd:2.4.38-alpine" Aug 18 12:01:53.207: INFO: At 2021-08-18 11:56:58 +0000 UTC - event for webserver-deployment-dd94f59b7-dbsxb: {multus } AddedInterface: Add eth0 [10.244.4.134/24] Aug 18 12:01:53.207: INFO: At 2021-08-18 11:56:58 +0000 UTC - event for webserver-deployment-dd94f59b7-h8pvd: {multus } AddedInterface: Add eth0 [10.244.4.137/24] Aug 18 12:01:53.207: INFO: At 2021-08-18 11:56:58 +0000 UTC - event for webserver-deployment-dd94f59b7-qmb69: {kubelet node2} Pulling: Pulling image "docker.io/library/httpd:2.4.38-alpine" Aug 18 12:01:53.207: INFO: At 2021-08-18 11:56:58 +0000 UTC - event for webserver-deployment-dd94f59b7-qmb69: {multus } AddedInterface: Add eth0 [10.244.3.124/24] Aug 18 12:01:53.207: INFO: At 2021-08-18 11:56:58 +0000 UTC - event for webserver-deployment-dd94f59b7-rws9q: {multus } AddedInterface: Add eth0 [10.244.4.135/24] Aug 18 12:01:53.207: INFO: At 2021-08-18 11:56:58 +0000 UTC - event for webserver-deployment-dd94f59b7-rws9q: {kubelet node1} Pulling: Pulling image "docker.io/library/httpd:2.4.38-alpine" Aug 18 12:01:53.207: INFO: At 2021-08-18 11:56:58 +0000 UTC - event for webserver-deployment-dd94f59b7-ttks8: {multus } AddedInterface: Add eth0 [10.244.3.125/24] Aug 18 12:01:53.207: INFO: At 2021-08-18 11:56:58 +0000 UTC - event for webserver-deployment-dd94f59b7-x65jh: {kubelet node1} Pulling: Pulling image "docker.io/library/httpd:2.4.38-alpine" Aug 18 12:01:53.207: INFO: At 2021-08-18 11:56:58 +0000 UTC - event for webserver-deployment-dd94f59b7-x65jh: {multus } AddedInterface: Add eth0 [10.244.4.136/24] Aug 18 12:01:53.207: INFO: At 2021-08-18 11:56:59 +0000 UTC - event for webserver-deployment-dd94f59b7-bvwxs: {multus } AddedInterface: Add eth0 [10.244.3.126/24] Aug 18 12:01:53.207: INFO: At 2021-08-18 11:56:59 +0000 UTC - event for webserver-deployment-dd94f59b7-bvwxs: {kubelet node2} Pulling: Pulling image "docker.io/library/httpd:2.4.38-alpine" Aug 18 12:01:53.207: INFO: At 2021-08-18 11:56:59 +0000 UTC - event for webserver-deployment-dd94f59b7-dqt7r: {multus } AddedInterface: Add eth0 [10.244.4.138/24] Aug 18 12:01:53.207: INFO: At 2021-08-18 11:56:59 +0000 UTC - event for webserver-deployment-dd94f59b7-dqt7r: {kubelet node1} Pulling: Pulling image "docker.io/library/httpd:2.4.38-alpine" Aug 18 12:01:53.207: INFO: At 2021-08-18 11:56:59 +0000 UTC - event for webserver-deployment-dd94f59b7-g45zh: {kubelet node2} Failed: Error: ImagePullBackOff Aug 18 12:01:53.207: INFO: At 2021-08-18 11:56:59 +0000 UTC - event for webserver-deployment-dd94f59b7-g45zh: {kubelet node2} BackOff: Back-off pulling image "docker.io/library/httpd:2.4.38-alpine" Aug 18 12:01:53.207: INFO: At 2021-08-18 11:56:59 +0000 UTC - event for webserver-deployment-dd94f59b7-g45zh: {kubelet node2} Failed: Error: ErrImagePull Aug 18 12:01:53.208: INFO: At 2021-08-18 11:56:59 +0000 UTC - event for webserver-deployment-dd94f59b7-g45zh: {kubelet node2} Failed: Failed to pull image "docker.io/library/httpd:2.4.38-alpine": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit Aug 18 12:01:53.208: INFO: At 2021-08-18 11:56:59 +0000 UTC - event for webserver-deployment-dd94f59b7-h8pvd: {kubelet node1} Pulling: Pulling image "docker.io/library/httpd:2.4.38-alpine" Aug 18 12:01:53.208: INFO: At 2021-08-18 11:56:59 +0000 UTC - event for webserver-deployment-dd94f59b7-ttks8: {kubelet node2} Pulling: Pulling image "docker.io/library/httpd:2.4.38-alpine" Aug 18 12:01:53.208: INFO: At 2021-08-18 11:57:00 +0000 UTC - event for webserver-deployment-dd94f59b7-4pbnc: {kubelet node2} BackOff: Back-off pulling image "docker.io/library/httpd:2.4.38-alpine" Aug 18 12:01:53.208: INFO: At 2021-08-18 11:57:00 +0000 UTC - event for webserver-deployment-dd94f59b7-4pbnc: {kubelet node2} Failed: Failed to pull image "docker.io/library/httpd:2.4.38-alpine": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit Aug 18 12:01:53.208: INFO: At 2021-08-18 11:57:00 +0000 UTC - event for webserver-deployment-dd94f59b7-4pbnc: {kubelet node2} Failed: Error: ImagePullBackOff Aug 18 12:01:53.208: INFO: At 2021-08-18 11:57:00 +0000 UTC - event for webserver-deployment-dd94f59b7-4pbnc: {kubelet node2} Failed: Error: ErrImagePull Aug 18 12:01:53.208: INFO: At 2021-08-18 11:57:01 +0000 UTC - event for webserver-deployment-dd94f59b7-qmb69: {kubelet node2} Failed: Failed to pull image "docker.io/library/httpd:2.4.38-alpine": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit Aug 18 12:01:53.208: INFO: At 2021-08-18 11:57:01 +0000 UTC - event for webserver-deployment-dd94f59b7-qmb69: {kubelet node2} Failed: Error: ErrImagePull Aug 18 12:01:53.208: INFO: At 2021-08-18 11:57:01 +0000 UTC - event for webserver-deployment-dd94f59b7-qmb69: {kubelet node2} Failed: Error: ImagePullBackOff Aug 18 12:01:53.208: INFO: At 2021-08-18 11:57:01 +0000 UTC - event for webserver-deployment-dd94f59b7-qmb69: {kubelet node2} BackOff: Back-off pulling image "docker.io/library/httpd:2.4.38-alpine" Aug 18 12:01:53.208: INFO: At 2021-08-18 11:57:01 +0000 UTC - event for webserver-deployment-dd94f59b7-rws9q: {kubelet node1} Failed: Failed to pull image "docker.io/library/httpd:2.4.38-alpine": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit Aug 18 12:01:53.208: INFO: At 2021-08-18 11:57:01 +0000 UTC - event for webserver-deployment-dd94f59b7-rws9q: {kubelet node1} Failed: Error: ErrImagePull Aug 18 12:01:53.208: INFO: At 2021-08-18 11:57:02 +0000 UTC - event for webserver-deployment-dd94f59b7-rws9q: {kubelet node1} BackOff: Back-off pulling image "docker.io/library/httpd:2.4.38-alpine" Aug 18 12:01:53.208: INFO: At 2021-08-18 11:57:02 +0000 UTC - event for webserver-deployment-dd94f59b7-rws9q: {kubelet node1} Failed: Error: ImagePullBackOff Aug 18 12:01:53.208: INFO: At 2021-08-18 11:57:02 +0000 UTC - event for webserver-deployment-dd94f59b7-ttks8: {kubelet node2} BackOff: Back-off pulling image "docker.io/library/httpd:2.4.38-alpine" Aug 18 12:01:53.208: INFO: At 2021-08-18 11:57:02 +0000 UTC - event for webserver-deployment-dd94f59b7-ttks8: {kubelet node2} Failed: Error: ErrImagePull Aug 18 12:01:53.208: INFO: At 2021-08-18 11:57:02 +0000 UTC - event for webserver-deployment-dd94f59b7-ttks8: {kubelet node2} Failed: Error: ImagePullBackOff Aug 18 12:01:53.208: INFO: At 2021-08-18 11:57:02 +0000 UTC - event for webserver-deployment-dd94f59b7-ttks8: {kubelet node2} Failed: Failed to pull image "docker.io/library/httpd:2.4.38-alpine": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit Aug 18 12:01:53.208: INFO: At 2021-08-18 11:57:02 +0000 UTC - event for webserver-deployment-dd94f59b7-x65jh: {kubelet node1} Failed: Failed to pull image "docker.io/library/httpd:2.4.38-alpine": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit Aug 18 12:01:53.208: INFO: At 2021-08-18 11:57:02 +0000 UTC - event for webserver-deployment-dd94f59b7-x65jh: {kubelet node1} Failed: Error: ErrImagePull Aug 18 12:01:53.208: INFO: At 2021-08-18 11:57:03 +0000 UTC - event for webserver-deployment-dd94f59b7-bvwxs: {kubelet node2} Failed: Failed to pull image "docker.io/library/httpd:2.4.38-alpine": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit Aug 18 12:01:53.208: INFO: At 2021-08-18 11:57:03 +0000 UTC - event for webserver-deployment-dd94f59b7-bvwxs: {kubelet node2} Failed: Error: ErrImagePull Aug 18 12:01:53.208: INFO: At 2021-08-18 11:57:03 +0000 UTC - event for webserver-deployment-dd94f59b7-bvwxs: {kubelet node2} Failed: Error: ImagePullBackOff Aug 18 12:01:53.208: INFO: At 2021-08-18 11:57:03 +0000 UTC - event for webserver-deployment-dd94f59b7-bvwxs: {kubelet node2} BackOff: Back-off pulling image "docker.io/library/httpd:2.4.38-alpine" Aug 18 12:01:53.208: INFO: At 2021-08-18 11:57:03 +0000 UTC - event for webserver-deployment-dd94f59b7-dbsxb: {kubelet node1} Failed: Failed to pull image "docker.io/library/httpd:2.4.38-alpine": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit Aug 18 12:01:53.208: INFO: At 2021-08-18 11:57:03 +0000 UTC - event for webserver-deployment-dd94f59b7-dbsxb: {kubelet node1} Failed: Error: ErrImagePull Aug 18 12:01:53.208: INFO: At 2021-08-18 11:57:04 +0000 UTC - event for webserver-deployment-dd94f59b7-h8pvd: {kubelet node1} Failed: Failed to pull image "docker.io/library/httpd:2.4.38-alpine": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit Aug 18 12:01:53.208: INFO: At 2021-08-18 11:57:04 +0000 UTC - event for webserver-deployment-dd94f59b7-h8pvd: {kubelet node1} Failed: Error: ErrImagePull Aug 18 12:01:53.208: INFO: At 2021-08-18 11:57:05 +0000 UTC - event for webserver-deployment-dd94f59b7-dbsxb: {kubelet node1} BackOff: Back-off pulling image "docker.io/library/httpd:2.4.38-alpine" Aug 18 12:01:53.208: INFO: At 2021-08-18 11:57:05 +0000 UTC - event for webserver-deployment-dd94f59b7-dbsxb: {kubelet node1} Failed: Error: ImagePullBackOff Aug 18 12:01:53.208: INFO: At 2021-08-18 11:57:05 +0000 UTC - event for webserver-deployment-dd94f59b7-dqt7r: {kubelet node1} Failed: Failed to pull image "docker.io/library/httpd:2.4.38-alpine": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit Aug 18 12:01:53.208: INFO: At 2021-08-18 11:57:05 +0000 UTC - event for webserver-deployment-dd94f59b7-dqt7r: {kubelet node1} Failed: Error: ErrImagePull Aug 18 12:01:53.208: INFO: At 2021-08-18 11:57:05 +0000 UTC - event for webserver-deployment-dd94f59b7-x65jh: {kubelet node1} Failed: Error: ImagePullBackOff Aug 18 12:01:53.208: INFO: At 2021-08-18 11:57:05 +0000 UTC - event for webserver-deployment-dd94f59b7-x65jh: {kubelet node1} BackOff: Back-off pulling image "docker.io/library/httpd:2.4.38-alpine" Aug 18 12:01:53.208: INFO: At 2021-08-18 11:57:06 +0000 UTC - event for webserver-deployment-dd94f59b7-dqt7r: {kubelet node1} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Aug 18 12:01:53.208: INFO: At 2021-08-18 11:57:06 +0000 UTC - event for webserver-deployment-dd94f59b7-h8pvd: {kubelet node1} BackOff: Back-off pulling image "docker.io/library/httpd:2.4.38-alpine" Aug 18 12:01:53.208: INFO: At 2021-08-18 11:57:06 +0000 UTC - event for webserver-deployment-dd94f59b7-h8pvd: {kubelet node1} Failed: Error: ImagePullBackOff Aug 18 12:01:53.208: INFO: At 2021-08-18 11:57:08 +0000 UTC - event for webserver-deployment-dd94f59b7-dqt7r: {multus } AddedInterface: Add eth0 [10.244.4.144/24] Aug 18 12:01:53.208: INFO: At 2021-08-18 11:57:08 +0000 UTC - event for webserver-deployment-dd94f59b7-dqt7r: {kubelet node1} Failed: Error: ImagePullBackOff Aug 18 12:01:53.208: INFO: At 2021-08-18 11:57:08 +0000 UTC - event for webserver-deployment-dd94f59b7-dqt7r: {kubelet node1} BackOff: Back-off pulling image "docker.io/library/httpd:2.4.38-alpine" Aug 18 12:01:53.211: INFO: POD NODE PHASE GRACE CONDITIONS Aug 18 12:01:53.211: INFO: webserver-deployment-dd94f59b7-4pbnc node2 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:56:51 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:56:51 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:56:51 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:56:51 +0000 UTC }] Aug 18 12:01:53.211: INFO: webserver-deployment-dd94f59b7-bvwxs node2 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:56:51 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:56:51 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:56:51 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:56:51 +0000 UTC }] Aug 18 12:01:53.211: INFO: webserver-deployment-dd94f59b7-dbsxb node1 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:56:51 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:56:51 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:56:51 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:56:51 +0000 UTC }] Aug 18 12:01:53.211: INFO: webserver-deployment-dd94f59b7-dqt7r node1 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:56:51 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:56:51 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:56:51 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:56:51 +0000 UTC }] Aug 18 12:01:53.211: INFO: webserver-deployment-dd94f59b7-g45zh node2 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:56:51 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:56:51 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:56:51 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:56:51 +0000 UTC }] Aug 18 12:01:53.211: INFO: webserver-deployment-dd94f59b7-h8pvd node1 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:56:51 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:56:51 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:56:51 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:56:51 +0000 UTC }] Aug 18 12:01:53.211: INFO: webserver-deployment-dd94f59b7-qmb69 node2 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:56:51 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:56:51 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:56:51 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:56:51 +0000 UTC }] Aug 18 12:01:53.211: INFO: webserver-deployment-dd94f59b7-rws9q node1 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:56:51 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:56:51 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:56:51 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:56:51 +0000 UTC }] Aug 18 12:01:53.211: INFO: webserver-deployment-dd94f59b7-ttks8 node2 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:56:51 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:56:51 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:56:51 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:56:51 +0000 UTC }] Aug 18 12:01:53.211: INFO: webserver-deployment-dd94f59b7-x65jh node1 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:56:51 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:56:51 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:56:51 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:56:51 +0000 UTC }] Aug 18 12:01:53.212: INFO: Aug 18 12:01:53.216: INFO: Logging node info for node master1 Aug 18 12:01:53.219: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 ebb211fa-503f-4cfe-b1ed-c95d27a70e6e 78454 0 2021-08-18 08:20:52 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"3a:82:be:72:b5:15"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:20:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:20:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:25:59 +0000 UTC,LastTransitionTime:2021-08-18 08:25:59 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 12:01:50 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 12:01:50 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 12:01:50 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 12:01:50 +0000 UTC,LastTransitionTime:2021-08-18 08:25:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:58c3e57359b641ad92fa1959f2fecf5d,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:012cd796-2076-45d6-8b14-d3e0451b1e64,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[@ :],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 12:01:53.220: INFO: Logging kubelet events for node master1 Aug 18 12:01:53.222: INFO: Logging pods the kubelet thinks is on node master1 Aug 18 12:01:53.233: INFO: kube-proxy-vqk4v started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 12:01:53.233: INFO: Container kube-proxy ready: true, restart count 1 Aug 18 12:01:53.233: INFO: kube-flannel-q64cq started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 12:01:53.233: INFO: Init container install-cni ready: true, restart count 0 Aug 18 12:01:53.233: INFO: Container kube-flannel ready: true, restart count 3 Aug 18 12:01:53.233: INFO: coredns-7677f9bb54-kn2qg started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 12:01:53.233: INFO: Container coredns ready: true, restart count 2 Aug 18 12:01:53.233: INFO: kube-scheduler-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 12:01:53.233: INFO: Container kube-scheduler ready: true, restart count 0 Aug 18 12:01:53.233: INFO: kube-apiserver-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 12:01:53.233: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 12:01:53.233: INFO: kube-multus-ds-amd64-kbcp6 started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 12:01:53.233: INFO: Container kube-multus ready: true, restart count 1 Aug 18 12:01:53.233: INFO: docker-registry-docker-registry-56cbc7bc58-49kl2 started at 2021-08-18 08:26:23 +0000 UTC (0+2 container statuses recorded) Aug 18 12:01:53.233: INFO: Container docker-registry ready: true, restart count 0 Aug 18 12:01:53.233: INFO: Container nginx ready: true, restart count 0 Aug 18 12:01:53.233: INFO: node-exporter-5hwz9 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 12:01:53.233: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 12:01:53.233: INFO: Container node-exporter ready: true, restart count 0 Aug 18 12:01:53.233: INFO: kube-controller-manager-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 12:01:53.233: INFO: Container kube-controller-manager ready: true, restart count 2 W0818 12:01:53.247587 29 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 12:01:53.279: INFO: Latency metrics for node master1 Aug 18 12:01:53.279: INFO: Logging node info for node master2 Aug 18 12:01:53.282: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 78946293-3abe-4442-84d4-8ed6b1d15ce0 78449 0 2021-08-18 08:21:31 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"7e:f5:c2:cc:3a:b4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:21:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:21:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-08-18 08:29:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 12:01:48 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 12:01:48 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 12:01:48 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 12:01:48 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0c44122c7a7248c18d8571e1cc667258,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:0cd329f2-48e0-4c8f-b8b9-fa3ae0ed8406,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 12:01:53.283: INFO: Logging kubelet events for node master2 Aug 18 12:01:53.285: INFO: Logging pods the kubelet thinks is on node master2 Aug 18 12:01:53.295: INFO: kube-apiserver-master2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 12:01:53.295: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 12:01:53.295: INFO: kube-scheduler-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 12:01:53.295: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 12:01:53.295: INFO: kube-multus-ds-amd64-mld8g started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 12:01:53.295: INFO: Container kube-multus ready: true, restart count 1 Aug 18 12:01:53.295: INFO: dns-autoscaler-5b7b5c9b6f-hh47r started at 2021-08-18 08:23:57 +0000 UTC (0+1 container statuses recorded) Aug 18 12:01:53.295: INFO: Container autoscaler ready: true, restart count 2 Aug 18 12:01:53.295: INFO: node-feature-discovery-controller-5bf5c49849-mq57c started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 12:01:53.295: INFO: Container nfd-controller ready: true, restart count 0 Aug 18 12:01:53.295: INFO: node-exporter-48nfx started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 12:01:53.295: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 12:01:53.295: INFO: Container node-exporter ready: true, restart count 0 Aug 18 12:01:53.295: INFO: kube-controller-manager-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 12:01:53.295: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 12:01:53.295: INFO: kube-proxy-kh2l9 started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 12:01:53.295: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 12:01:53.295: INFO: kube-flannel-pp56h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 12:01:53.295: INFO: Init container install-cni ready: true, restart count 0 Aug 18 12:01:53.295: INFO: Container kube-flannel ready: true, restart count 1 W0818 12:01:53.311728 29 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 12:01:53.336: INFO: Latency metrics for node master2 Aug 18 12:01:53.337: INFO: Logging node info for node master3 Aug 18 12:01:53.339: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 44feac2b-9447-4be2-9fcd-62f836d67c72 78433 0 2021-08-18 08:21:41 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"86:e4:31:99:58:40"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {kubelet Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 12:01:44 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 12:01:44 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 12:01:44 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 12:01:44 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1fae19ae59884c44899bcd08aa243244,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:5db926c5-6530-4635-a0d5-806974a3b732,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 12:01:53.340: INFO: Logging kubelet events for node master3 Aug 18 12:01:53.341: INFO: Logging pods the kubelet thinks is on node master3 Aug 18 12:01:53.351: INFO: kube-controller-manager-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 12:01:53.351: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 12:01:53.351: INFO: kube-scheduler-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 12:01:53.351: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 12:01:53.351: INFO: kube-apiserver-master3 started at 2021-08-18 08:29:12 +0000 UTC (0+1 container statuses recorded) Aug 18 12:01:53.351: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 12:01:53.351: INFO: kube-proxy-sd5lc started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 12:01:53.351: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 12:01:53.351: INFO: kube-flannel-x6tlr started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 12:01:53.351: INFO: Init container install-cni ready: true, restart count 1 Aug 18 12:01:53.351: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 12:01:53.351: INFO: kube-multus-ds-amd64-bkw6c started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 12:01:53.351: INFO: Container kube-multus ready: true, restart count 1 Aug 18 12:01:53.351: INFO: coredns-7677f9bb54-5hxfh started at 2021-08-18 08:23:54 +0000 UTC (0+1 container statuses recorded) Aug 18 12:01:53.351: INFO: Container coredns ready: true, restart count 1 Aug 18 12:01:53.351: INFO: node-exporter-vq7d8 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 12:01:53.351: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 12:01:53.351: INFO: Container node-exporter ready: true, restart count 0 W0818 12:01:53.363681 29 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 12:01:53.387: INFO: Latency metrics for node master3 Aug 18 12:01:53.387: INFO: Logging node info for node node1 Aug 18 12:01:53.390: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 84defabd-6ebf-43ec-a629-44c6713da9c9 78435 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"9a:87:55:36:7b:df"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:13 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:35 +0000 UTC,LastTransitionTime:2021-08-18 08:26:35 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 12:01:45 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 12:01:45 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 12:01:45 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 12:01:45 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:69946ff2b7bc462fa25eb7adb4703c23,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:736dc52f-f5e3-494e-86ca-01eedbea015c,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:a7cea43d9d2f67c38fbf0407786edbe660ee9072945f7bb272b55fd255e8eaca opnfv/barometer-collectd:stable],SizeBytes:1075746799,},ContainerImage{Names:[@ :],SizeBytes:1003788820,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[aquasec/kube-hunter@sha256:2be6820bc1d7e0f57193a9a27d5a3e16b2fd93c53747b03ce8ca48c6fc323781 aquasec/kube-hunter:0.3.1],SizeBytes:347611549,},ContainerImage{Names:[golang@sha256:db2475a1dbb2149508e5db31d7d77a75e6600d54be645f37681f03f2762169ba golang:alpine3.12],SizeBytes:301186719,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:de25c7fc6c4f3a27c7f0c2dff454e4671823a34d88abd533f210848d527e0fbb alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 12:01:53.391: INFO: Logging kubelet events for node node1 Aug 18 12:01:53.393: INFO: Logging pods the kubelet thinks is on node node1 Aug 18 12:01:53.415: INFO: webserver-deployment-dd94f59b7-rws9q started at 2021-08-18 11:56:51 +0000 UTC (0+1 container statuses recorded) Aug 18 12:01:53.415: INFO: Container httpd ready: false, restart count 0 Aug 18 12:01:53.415: INFO: kube-proxy-p6jvp started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 12:01:53.415: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 12:01:53.415: INFO: kubernetes-metrics-scraper-678c97765c-9nsv5 started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 12:01:53.415: INFO: Container kubernetes-metrics-scraper ready: true, restart count 2 Aug 18 12:01:53.415: INFO: cmk-d8r27 started at 2021-08-18 08:32:52 +0000 UTC (0+2 container statuses recorded) Aug 18 12:01:53.415: INFO: Container nodereport ready: true, restart count 0 Aug 18 12:01:53.415: INFO: Container reconcile ready: true, restart count 0 Aug 18 12:01:53.415: INFO: nginx-proxy-node1 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 12:01:53.415: INFO: Container nginx-proxy ready: true, restart count 2 Aug 18 12:01:53.415: INFO: server-envvars-dcc91a28-e119-476f-ad7b-86dc853ddeb4 started at 2021-08-18 11:52:28 +0000 UTC (0+1 container statuses recorded) Aug 18 12:01:53.415: INFO: Container srv ready: true, restart count 0 Aug 18 12:01:53.415: INFO: kube-multus-ds-amd64-rrvmb started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 12:01:53.415: INFO: Container kube-multus ready: true, restart count 1 Aug 18 12:01:53.415: INFO: node-feature-discovery-worker-pflgw started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 12:01:53.416: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 12:01:53.416: INFO: node-exporter-kcwvn started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 12:01:53.416: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 12:01:53.416: INFO: Container node-exporter ready: true, restart count 0 Aug 18 12:01:53.416: INFO: foo-xpsfd started at 2021-08-18 11:53:08 +0000 UTC (0+1 container statuses recorded) Aug 18 12:01:53.416: INFO: Container c ready: false, restart count 0 Aug 18 12:01:53.416: INFO: cmk-init-discover-node1-bxznx started at 2021-08-18 08:32:10 +0000 UTC (0+3 container statuses recorded) Aug 18 12:01:53.416: INFO: Container discover ready: false, restart count 0 Aug 18 12:01:53.416: INFO: Container init ready: false, restart count 0 Aug 18 12:01:53.416: INFO: Container install ready: false, restart count 0 Aug 18 12:01:53.416: INFO: collectd-xdprr started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 12:01:53.416: INFO: Container collectd ready: true, restart count 0 Aug 18 12:01:53.416: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 12:01:53.416: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 12:01:53.416: INFO: webserver-deployment-dd94f59b7-dbsxb started at 2021-08-18 11:56:51 +0000 UTC (0+1 container statuses recorded) Aug 18 12:01:53.416: INFO: Container httpd ready: false, restart count 0 Aug 18 12:01:53.416: INFO: webserver-deployment-dd94f59b7-dqt7r started at 2021-08-18 11:56:51 +0000 UTC (0+1 container statuses recorded) Aug 18 12:01:53.416: INFO: Container httpd ready: false, restart count 0 Aug 18 12:01:53.416: INFO: webserver-deployment-dd94f59b7-x65jh started at 2021-08-18 11:56:51 +0000 UTC (0+1 container statuses recorded) Aug 18 12:01:53.416: INFO: Container httpd ready: false, restart count 0 Aug 18 12:01:53.416: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-vsxvg started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 12:01:53.416: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 12:01:53.416: INFO: webserver-deployment-dd94f59b7-h8pvd started at 2021-08-18 11:56:51 +0000 UTC (0+1 container statuses recorded) Aug 18 12:01:53.416: INFO: Container httpd ready: false, restart count 0 Aug 18 12:01:53.416: INFO: kube-flannel-q78nd started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 12:01:53.416: INFO: Init container install-cni ready: true, restart count 2 Aug 18 12:01:53.416: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 12:01:53.416: INFO: prometheus-k8s-0 started at 2021-08-18 08:34:03 +0000 UTC (0+5 container statuses recorded) Aug 18 12:01:53.416: INFO: Container custom-metrics-apiserver ready: true, restart count 0 Aug 18 12:01:53.416: INFO: Container grafana ready: true, restart count 0 Aug 18 12:01:53.416: INFO: Container prometheus ready: true, restart count 1 Aug 18 12:01:53.416: INFO: Container prometheus-config-reloader ready: true, restart count 0 Aug 18 12:01:53.416: INFO: Container rules-configmap-reloader ready: true, restart count 0 W0818 12:01:53.429587 29 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 12:01:53.487: INFO: Latency metrics for node node1 Aug 18 12:01:53.487: INFO: Logging node info for node node2 Aug 18 12:01:53.490: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 1d01177e-3dbb-48a1-a0bc-d18af27ab7f8 78436 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:d1:47:f8:1d:22"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:36 +0000 UTC,LastTransitionTime:2021-08-18 08:26:36 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 12:01:45 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 12:01:45 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 12:01:45 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 12:01:45 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:dc1f286135c145349b8a016880b65a2f,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:037e7e2d-94e9-42f4-a719-896e5005ac70,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 12:01:53.491: INFO: Logging kubelet events for node node2 Aug 18 12:01:53.493: INFO: Logging pods the kubelet thinks is on node node2 Aug 18 12:01:53.513: INFO: cmk-webhook-6c9d5f8578-7cxjr started at 2021-08-18 08:32:53 +0000 UTC (0+1 container statuses recorded) Aug 18 12:01:53.513: INFO: Container cmk-webhook ready: true, restart count 0 Aug 18 12:01:53.513: INFO: client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419 started at 2021-08-18 11:57:37 +0000 UTC (0+1 container statuses recorded) Aug 18 12:01:53.513: INFO: Container env3cont ready: false, restart count 0 Aug 18 12:01:53.513: INFO: kube-flannel-h7t5h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 12:01:53.513: INFO: Init container install-cni ready: true, restart count 2 Aug 18 12:01:53.513: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 12:01:53.513: INFO: node-exporter-lrrf2 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 12:01:53.513: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 12:01:53.513: INFO: Container node-exporter ready: true, restart count 0 Aug 18 12:01:53.513: INFO: webserver-deployment-dd94f59b7-g45zh started at 2021-08-18 11:56:51 +0000 UTC (0+1 container statuses recorded) Aug 18 12:01:53.513: INFO: Container httpd ready: false, restart count 0 Aug 18 12:01:53.513: INFO: foo-mcmfh started at 2021-08-18 11:53:08 +0000 UTC (0+1 container statuses recorded) Aug 18 12:01:53.513: INFO: Container c ready: false, restart count 0 Aug 18 12:01:53.513: INFO: webserver-deployment-dd94f59b7-ttks8 started at 2021-08-18 11:56:51 +0000 UTC (0+1 container statuses recorded) Aug 18 12:01:53.513: INFO: Container httpd ready: false, restart count 0 Aug 18 12:01:53.513: INFO: nginx-proxy-node2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 12:01:53.513: INFO: Container nginx-proxy ready: true, restart count 1 Aug 18 12:01:53.513: INFO: cmk-init-discover-node2-6b2kz started at 2021-08-18 08:32:30 +0000 UTC (0+3 container statuses recorded) Aug 18 12:01:53.513: INFO: Container discover ready: false, restart count 0 Aug 18 12:01:53.513: INFO: Container init ready: false, restart count 0 Aug 18 12:01:53.513: INFO: Container install ready: false, restart count 0 Aug 18 12:01:53.513: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-7rn45 started at 2021-08-18 08:36:42 +0000 UTC (0+2 container statuses recorded) Aug 18 12:01:53.513: INFO: Container tas-controller ready: true, restart count 0 Aug 18 12:01:53.513: INFO: Container tas-extender ready: true, restart count 0 Aug 18 12:01:53.513: INFO: kubernetes-dashboard-86c6f9df5b-qrtdk started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 12:01:53.513: INFO: Container kubernetes-dashboard ready: true, restart count 2 Aug 18 12:01:53.513: INFO: webserver-deployment-dd94f59b7-4pbnc started at 2021-08-18 11:56:51 +0000 UTC (0+1 container statuses recorded) Aug 18 12:01:53.513: INFO: Container httpd ready: false, restart count 0 Aug 18 12:01:53.513: INFO: webserver-deployment-dd94f59b7-qmb69 started at 2021-08-18 11:56:51 +0000 UTC (0+1 container statuses recorded) Aug 18 12:01:53.513: INFO: Container httpd ready: false, restart count 0 Aug 18 12:01:53.513: INFO: webserver-deployment-dd94f59b7-bvwxs started at 2021-08-18 11:56:51 +0000 UTC (0+1 container statuses recorded) Aug 18 12:01:53.513: INFO: Container httpd ready: false, restart count 0 Aug 18 12:01:53.513: INFO: cmk-748rz started at 2021-08-18 08:32:53 +0000 UTC (0+2 container statuses recorded) Aug 18 12:01:53.513: INFO: Container nodereport ready: true, restart count 0 Aug 18 12:01:53.513: INFO: Container reconcile ready: true, restart count 0 Aug 18 12:01:53.513: INFO: kube-proxy-qkj9c started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 12:01:53.513: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 12:01:53.513: INFO: node-feature-discovery-worker-hzpf5 started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 12:01:53.513: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 12:01:53.513: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-c82pt started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 12:01:53.513: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 12:01:53.513: INFO: prometheus-operator-5bb8cb9d8f-k97ws started at 2021-08-18 08:33:38 +0000 UTC (0+2 container statuses recorded) Aug 18 12:01:53.513: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 12:01:53.513: INFO: Container prometheus-operator ready: true, restart count 0 Aug 18 12:01:53.513: INFO: kube-multus-ds-amd64-rvzsg started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 12:01:53.513: INFO: Container kube-multus ready: true, restart count 1 Aug 18 12:01:53.513: INFO: collectd-67ntq started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 12:01:53.513: INFO: Container collectd ready: true, restart count 0 Aug 18 12:01:53.513: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 12:01:53.513: INFO: Container rbac-proxy ready: true, restart count 0 W0818 12:01:53.528164 29 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 12:01:53.561: INFO: Latency metrics for node node2 Aug 18 12:01:53.561: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "deployment-1685" for this suite. • Failure [302.440 seconds] [sig-apps] Deployment /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/framework.go:23 deployment should support proportional scaling [Conformance] [It] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 12:01:53.186: error in waiting for pods to come up: failed to wait for pods running: [timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition] Unexpected error: <*errors.errorString | 0xc000683280>: { s: "failed to wait for pods running: [timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition]", } failed to wait for pods running: [timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition timed out waiting for the condition] occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/deployment.go:736 ------------------------------ {"msg":"FAILED [sig-apps] Deployment deployment should support proportional scaling [Conformance]","total":-1,"completed":30,"skipped":714,"failed":5,"failures":["[k8s.io] InitContainer [NodeConformance] should invoke init containers on a RestartAlways pod [Conformance]","[k8s.io] Pods should allow activeDeadlineSeconds to be updated [NodeConformance] [Conformance]","[k8s.io] Variable Expansion should allow substituting values in a container's args [NodeConformance] [Conformance]","[sig-apps] StatefulSet [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] should have a working scale subresource [Conformance]","[sig-apps] Deployment deployment should support proportional scaling [Conformance]"]} Aug 18 12:01:53.593: INFO: Running AfterSuite actions on all nodes [BeforeEach] [k8s.io] Pods /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:52:28.897: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename pods STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [k8s.io] Pods /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/pods.go:181 [It] should contain environment variables for services [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 11:52:32.953: INFO: Waiting up to 5m0s for pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419" in namespace "pods-9046" to be "Succeeded or Failed" Aug 18 11:52:32.955: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1.824036ms Aug 18 11:52:34.958: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2.005414161s Aug 18 11:52:36.961: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4.0085519s Aug 18 11:52:38.966: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 6.012914188s Aug 18 11:52:40.969: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 8.015800467s Aug 18 11:52:42.971: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 10.018715637s Aug 18 11:52:44.974: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 12.021062466s Aug 18 11:52:46.978: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 14.024781071s Aug 18 11:52:48.982: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 16.029051584s Aug 18 11:52:50.985: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 18.032065637s Aug 18 11:52:52.988: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 20.035583196s Aug 18 11:52:54.991: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 22.038440901s Aug 18 11:52:56.994: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 24.041271919s Aug 18 11:52:58.998: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 26.044799044s Aug 18 11:53:01.000: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 28.047678205s Aug 18 11:53:03.004: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 30.050964538s Aug 18 11:53:05.006: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 32.053282449s Aug 18 11:53:07.008: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 34.055663669s Aug 18 11:53:09.011: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 36.058501398s Aug 18 11:53:11.014: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 38.061471193s Aug 18 11:53:13.018: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 40.065535044s Aug 18 11:53:15.021: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 42.067860381s Aug 18 11:53:17.023: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 44.070358501s Aug 18 11:53:19.026: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 46.073742756s Aug 18 11:53:21.031: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 48.077826159s Aug 18 11:53:23.034: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 50.081100265s Aug 18 11:53:25.037: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 52.084168064s Aug 18 11:53:27.040: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 54.087057641s Aug 18 11:53:29.043: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 56.089927006s Aug 18 11:53:31.045: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 58.092766818s Aug 18 11:53:33.050: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.096808626s Aug 18 11:53:35.052: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.099731771s Aug 18 11:53:37.056: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.102834477s Aug 18 11:53:39.060: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.107078223s Aug 18 11:53:41.063: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.110102505s Aug 18 11:53:43.066: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.113124154s Aug 18 11:53:45.069: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.115857291s Aug 18 11:53:47.072: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.119119384s Aug 18 11:53:49.075: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.122250947s Aug 18 11:53:51.078: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.124868315s Aug 18 11:53:53.080: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.127661551s Aug 18 11:53:55.085: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.132096179s Aug 18 11:53:57.088: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.135741348s Aug 18 11:53:59.092: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.139682247s Aug 18 11:54:01.095: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.142693158s Aug 18 11:54:03.098: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.14557555s Aug 18 11:54:05.101: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.148236005s Aug 18 11:54:07.104: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.151276927s Aug 18 11:54:09.107: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.154254314s Aug 18 11:54:11.110: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.157048706s Aug 18 11:54:13.115: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.16183365s Aug 18 11:54:15.117: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.164745482s Aug 18 11:54:17.121: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.167973304s Aug 18 11:54:19.123: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.170591511s Aug 18 11:54:21.126: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.173281124s Aug 18 11:54:23.129: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.175981504s Aug 18 11:54:25.131: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.178695776s Aug 18 11:54:27.135: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.181799555s Aug 18 11:54:29.138: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.18519341s Aug 18 11:54:31.141: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.187902297s Aug 18 11:54:33.144: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.191770917s Aug 18 11:54:35.147: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.194701659s Aug 18 11:54:37.155: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.202056061s Aug 18 11:54:39.158: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.205415506s Aug 18 11:54:41.163: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.210042669s Aug 18 11:54:43.167: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.214061944s Aug 18 11:54:45.170: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.21678148s Aug 18 11:54:47.174: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.221566502s Aug 18 11:54:49.177: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.224383386s Aug 18 11:54:51.180: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.227119444s Aug 18 11:54:53.183: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.230699713s Aug 18 11:54:55.189: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.236142208s Aug 18 11:54:57.198: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.244897398s Aug 18 11:54:59.201: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.248502259s Aug 18 11:55:01.207: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.254217231s Aug 18 11:55:03.210: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.257632638s Aug 18 11:55:05.217: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.263968229s Aug 18 11:55:07.224: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.270924519s Aug 18 11:55:09.227: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.274221133s Aug 18 11:55:11.230: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.277493547s Aug 18 11:55:13.234: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.28099771s Aug 18 11:55:15.236: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.283536458s Aug 18 11:55:17.240: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.28739022s Aug 18 11:55:19.244: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.291540898s Aug 18 11:55:21.247: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.294669611s Aug 18 11:55:23.250: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.297520802s Aug 18 11:55:25.253: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.300114295s Aug 18 11:55:27.255: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.302629348s Aug 18 11:55:29.258: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.305731481s Aug 18 11:55:31.261: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.308591005s Aug 18 11:55:33.265: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.311924986s Aug 18 11:55:35.269: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.315906622s Aug 18 11:55:37.272: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.319598295s Aug 18 11:55:39.276: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.322972711s Aug 18 11:55:41.278: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.325678078s Aug 18 11:55:43.281: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.328492751s Aug 18 11:55:45.284: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.330835315s Aug 18 11:55:47.286: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.333690697s Aug 18 11:55:49.290: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.337211702s Aug 18 11:55:51.293: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.340351201s Aug 18 11:55:53.296: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.343360845s Aug 18 11:55:55.300: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.347712158s Aug 18 11:55:57.303: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.350281836s Aug 18 11:55:59.307: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.35377321s Aug 18 11:56:01.310: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.35757391s Aug 18 11:56:03.313: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.360254828s Aug 18 11:56:05.316: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.363671681s Aug 18 11:56:07.320: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.367059208s Aug 18 11:56:09.323: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.370667905s Aug 18 11:56:11.329: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.376039815s Aug 18 11:56:13.332: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.379571934s Aug 18 11:56:15.338: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.385677319s Aug 18 11:56:17.342: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.389697617s Aug 18 11:56:19.346: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.393286124s Aug 18 11:56:21.351: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.398403427s Aug 18 11:56:23.354: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.401449824s Aug 18 11:56:25.358: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.404850417s Aug 18 11:56:27.362: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.408994943s Aug 18 11:56:29.365: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.41180279s Aug 18 11:56:31.368: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.415658856s Aug 18 11:56:33.371: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.418387154s Aug 18 11:56:35.376: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.423142402s Aug 18 11:56:37.380: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.427082862s Aug 18 11:56:39.384: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.431355551s Aug 18 11:56:41.387: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.434489087s Aug 18 11:56:43.391: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.438054478s Aug 18 11:56:45.393: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.440594741s Aug 18 11:56:47.396: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.443485133s Aug 18 11:56:49.400: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.447470748s Aug 18 11:56:51.405: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.451893978s Aug 18 11:56:53.408: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.455685372s Aug 18 11:56:55.412: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.459213625s Aug 18 11:56:57.414: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.461549513s Aug 18 11:56:59.418: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.465237711s Aug 18 11:57:01.421: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.468044514s Aug 18 11:57:03.425: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.472617183s Aug 18 11:57:05.428: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.475604689s Aug 18 11:57:07.433: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.480042819s Aug 18 11:57:09.436: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.483019004s Aug 18 11:57:11.439: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.486162763s Aug 18 11:57:13.442: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.489676463s Aug 18 11:57:15.446: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.492965866s Aug 18 11:57:17.449: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.496118551s Aug 18 11:57:19.452: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.499710082s Aug 18 11:57:21.457: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.504064547s Aug 18 11:57:23.461: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.508114953s Aug 18 11:57:25.463: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.510756043s Aug 18 11:57:27.466: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.513060535s Aug 18 11:57:29.469: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.516718228s Aug 18 11:57:31.473: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.519866657s Aug 18 11:57:33.481: INFO: Failed to get logs from node "node1" pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419" container "env3cont": the server rejected our request for an unknown reason (get pods client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419) STEP: delete the pod Aug 18 11:57:33.486: INFO: Waiting for pod client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419 to disappear Aug 18 11:57:33.488: INFO: Pod client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419 still exists Aug 18 11:57:35.489: INFO: Waiting for pod client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419 to disappear Aug 18 11:57:35.492: INFO: Pod client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419 still exists Aug 18 11:57:37.489: INFO: Waiting for pod client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419 to disappear Aug 18 11:57:37.491: INFO: Pod client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419 no longer exists Aug 18 11:57:37.491: INFO: (Attempt 1 of 3) Unexpected error occurred: expected pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419" success: Gave up after waiting 5m0s for pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419" to be "Succeeded or Failed" Aug 18 11:57:37.504: INFO: Waiting up to 5m0s for pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419" in namespace "pods-9046" to be "Succeeded or Failed" Aug 18 11:57:37.506: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1.939729ms Aug 18 11:57:39.509: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2.004744706s Aug 18 11:57:41.512: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4.007269106s Aug 18 11:57:43.515: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 6.010301126s Aug 18 11:57:45.518: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 8.013121007s Aug 18 11:57:47.522: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 10.017229764s Aug 18 11:57:49.524: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 12.020038929s Aug 18 11:57:51.527: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 14.022959503s Aug 18 11:57:53.531: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 16.026985287s Aug 18 11:57:55.535: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 18.030295174s Aug 18 11:57:57.537: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 20.03301144s Aug 18 11:57:59.543: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 22.038246148s Aug 18 11:58:01.547: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 24.042977558s Aug 18 11:58:03.550: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 26.045864331s Aug 18 11:58:05.555: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 28.050257587s Aug 18 11:58:07.558: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 30.053848112s Aug 18 11:58:09.562: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 32.057331483s Aug 18 11:58:11.566: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 34.061306629s Aug 18 11:58:13.570: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 36.065293586s Aug 18 11:58:15.574: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 38.069998144s Aug 18 11:58:17.578: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 40.073358255s Aug 18 11:58:19.581: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 42.076505293s Aug 18 11:58:21.585: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 44.080171098s Aug 18 11:58:23.588: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 46.083922733s Aug 18 11:58:25.591: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 48.086784009s Aug 18 11:58:27.594: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 50.090034066s Aug 18 11:58:29.598: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 52.093187485s Aug 18 11:58:31.600: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 54.095834705s Aug 18 11:58:33.603: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 56.098263022s Aug 18 11:58:35.609: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 58.104834289s Aug 18 11:58:37.612: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.1076367s Aug 18 11:58:39.615: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.11075605s Aug 18 11:58:41.619: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.114630756s Aug 18 11:58:43.623: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.118191658s Aug 18 11:58:45.627: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.122534649s Aug 18 11:58:47.631: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.126170958s Aug 18 11:58:49.634: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.129535739s Aug 18 11:58:51.639: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.13414576s Aug 18 11:58:53.641: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.13674288s Aug 18 11:58:55.644: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.139930839s Aug 18 11:58:57.647: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.142918167s Aug 18 11:58:59.650: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.145684188s Aug 18 11:59:01.653: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.148344333s Aug 18 11:59:03.655: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.150941227s Aug 18 11:59:05.659: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.15410039s Aug 18 11:59:07.662: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.157069204s Aug 18 11:59:09.665: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.160627426s Aug 18 11:59:11.669: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.164953222s Aug 18 11:59:13.672: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.167470843s Aug 18 11:59:15.677: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.172506155s Aug 18 11:59:17.681: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.176183588s Aug 18 11:59:19.683: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.17888338s Aug 18 11:59:21.686: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.181518091s Aug 18 11:59:23.689: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.184923432s Aug 18 11:59:25.693: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.188428904s Aug 18 11:59:27.696: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.191824976s Aug 18 11:59:29.700: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.195403407s Aug 18 11:59:31.703: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.198442945s Aug 18 11:59:33.707: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.202811985s Aug 18 11:59:35.711: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.206872557s Aug 18 11:59:37.715: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.210336494s Aug 18 11:59:39.717: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.212959523s Aug 18 11:59:41.722: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.217581565s Aug 18 11:59:43.726: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.221787253s Aug 18 11:59:45.729: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.224865744s Aug 18 11:59:47.733: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.22827654s Aug 18 11:59:49.736: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.23116844s Aug 18 11:59:51.740: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.235674188s Aug 18 11:59:53.743: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.23899502s Aug 18 11:59:55.748: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.243277439s Aug 18 11:59:57.751: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.246408448s Aug 18 11:59:59.754: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.249265518s Aug 18 12:00:01.757: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.252271397s Aug 18 12:00:03.760: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.255560513s Aug 18 12:00:05.763: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.258784498s Aug 18 12:00:07.767: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.262474365s Aug 18 12:00:09.769: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.264923405s Aug 18 12:00:11.773: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.268122832s Aug 18 12:00:13.778: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.273406198s Aug 18 12:00:15.781: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.276479804s Aug 18 12:00:17.784: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.279337998s Aug 18 12:00:19.787: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.282529189s Aug 18 12:00:21.789: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.284941312s Aug 18 12:00:23.792: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.287709776s Aug 18 12:00:25.796: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.291399315s Aug 18 12:00:27.799: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.294875149s Aug 18 12:00:29.802: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.297482372s Aug 18 12:00:31.805: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.300428417s Aug 18 12:00:33.807: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.30300169s Aug 18 12:00:35.811: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.306720854s Aug 18 12:00:37.814: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.309822223s Aug 18 12:00:39.818: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.313209273s Aug 18 12:00:41.821: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.316456943s Aug 18 12:00:43.824: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.319823533s Aug 18 12:00:45.827: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.322954951s Aug 18 12:00:47.831: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.32683669s Aug 18 12:00:49.834: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.329574965s Aug 18 12:00:51.839: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.334161257s Aug 18 12:00:53.842: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.337166775s Aug 18 12:00:55.845: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.340465486s Aug 18 12:00:57.848: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.343233947s Aug 18 12:00:59.851: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.346471404s Aug 18 12:01:01.855: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.350841422s Aug 18 12:01:03.860: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.355271359s Aug 18 12:01:05.863: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.35889394s Aug 18 12:01:07.866: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.36192371s Aug 18 12:01:09.869: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.364349855s Aug 18 12:01:11.872: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.367250244s Aug 18 12:01:13.875: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.370736749s Aug 18 12:01:15.879: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.374239256s Aug 18 12:01:17.882: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.377900638s Aug 18 12:01:19.885: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.381029044s Aug 18 12:01:21.889: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.384447296s Aug 18 12:01:23.891: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.386946194s Aug 18 12:01:25.894: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.390060111s Aug 18 12:01:27.898: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.39312284s Aug 18 12:01:29.901: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.39620017s Aug 18 12:01:31.903: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.398780911s Aug 18 12:01:33.906: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.401976747s Aug 18 12:01:35.909: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.404178724s Aug 18 12:01:37.912: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.407113651s Aug 18 12:01:39.914: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.409998543s Aug 18 12:01:41.919: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.414213014s Aug 18 12:01:43.923: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.418678298s Aug 18 12:01:45.928: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.423550306s Aug 18 12:01:47.931: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.426905946s Aug 18 12:01:49.934: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.429810372s Aug 18 12:01:51.940: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.435479784s Aug 18 12:01:53.943: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.438900558s Aug 18 12:01:55.947: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.442959248s Aug 18 12:01:57.950: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.445922772s Aug 18 12:01:59.953: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.448897678s Aug 18 12:02:01.958: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.453819751s Aug 18 12:02:03.961: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.456835389s Aug 18 12:02:05.965: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.460727047s Aug 18 12:02:07.968: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.463555693s Aug 18 12:02:09.971: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.46639468s Aug 18 12:02:11.979: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.474976611s Aug 18 12:02:13.985: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.4804343s Aug 18 12:02:15.988: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.483737988s Aug 18 12:02:17.991: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.486815701s Aug 18 12:02:19.994: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.48969396s Aug 18 12:02:21.999: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.494354145s Aug 18 12:02:24.006: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.50108041s Aug 18 12:02:26.010: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.505077399s Aug 18 12:02:28.013: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.508271593s Aug 18 12:02:30.019: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.514192273s Aug 18 12:02:32.023: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.518308732s Aug 18 12:02:34.026: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.521961511s Aug 18 12:02:36.031: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.52617493s Aug 18 12:02:38.038: INFO: Failed to get logs from node "node2" pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419" container "env3cont": the server rejected our request for an unknown reason (get pods client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419) STEP: delete the pod Aug 18 12:02:38.044: INFO: Waiting for pod client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419 to disappear Aug 18 12:02:38.048: INFO: Pod client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419 still exists Aug 18 12:02:40.048: INFO: Waiting for pod client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419 to disappear Aug 18 12:02:40.051: INFO: Pod client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419 no longer exists Aug 18 12:02:40.051: INFO: (Attempt 2 of 3) Unexpected error occurred: expected pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419" success: Gave up after waiting 5m0s for pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419" to be "Succeeded or Failed" Aug 18 12:02:40.067: INFO: Waiting up to 5m0s for pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419" in namespace "pods-9046" to be "Succeeded or Failed" Aug 18 12:02:40.070: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2.907766ms Aug 18 12:02:42.072: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2.005345218s Aug 18 12:02:44.075: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4.008210077s Aug 18 12:02:46.078: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 6.011295795s Aug 18 12:02:48.082: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 8.015608988s Aug 18 12:02:50.085: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 10.018045659s Aug 18 12:02:52.087: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 12.020788046s Aug 18 12:02:54.091: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 14.02400457s Aug 18 12:02:56.094: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 16.027052118s Aug 18 12:02:58.097: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 18.03007387s Aug 18 12:03:00.102: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 20.035743489s Aug 18 12:03:02.108: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 22.040995742s Aug 18 12:03:04.112: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 24.045761355s Aug 18 12:03:06.118: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 26.051077737s Aug 18 12:03:08.120: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 28.053845045s Aug 18 12:03:10.125: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 30.058661962s Aug 18 12:03:12.130: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 32.063417092s Aug 18 12:03:14.133: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 34.06637398s Aug 18 12:03:16.138: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 36.07177366s Aug 18 12:03:18.143: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 38.076758688s Aug 18 12:03:20.147: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 40.080898997s Aug 18 12:03:22.151: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 42.084764974s Aug 18 12:03:24.155: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 44.088865107s Aug 18 12:03:26.162: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 46.095546497s Aug 18 12:03:28.167: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 48.099950266s Aug 18 12:03:30.172: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 50.105125502s Aug 18 12:03:32.176: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 52.109333743s Aug 18 12:03:34.179: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 54.112575621s Aug 18 12:03:36.183: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 56.116416144s Aug 18 12:03:38.188: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 58.12108889s Aug 18 12:03:40.192: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.124908001s Aug 18 12:03:42.195: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.128644193s Aug 18 12:03:44.200: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.133296102s Aug 18 12:03:46.204: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.136953059s Aug 18 12:03:48.206: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.139825853s Aug 18 12:03:50.211: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.143906558s Aug 18 12:03:52.213: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.146807409s Aug 18 12:03:54.216: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.149826191s Aug 18 12:03:56.221: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.153931674s Aug 18 12:03:58.224: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.157741813s Aug 18 12:04:00.227: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.160650897s Aug 18 12:04:02.231: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.164199439s Aug 18 12:04:04.235: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.167928893s Aug 18 12:04:06.238: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.171367081s Aug 18 12:04:08.242: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.175185043s Aug 18 12:04:10.246: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.179531487s Aug 18 12:04:12.250: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.183816321s Aug 18 12:04:14.254: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.18779776s Aug 18 12:04:16.258: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.191753264s Aug 18 12:04:18.264: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.197028069s Aug 18 12:04:20.268: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.201828322s Aug 18 12:04:22.273: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.206686408s Aug 18 12:04:24.276: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.209388329s Aug 18 12:04:26.280: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.213361843s Aug 18 12:04:28.283: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.216744873s Aug 18 12:04:30.287: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.220845831s Aug 18 12:04:32.291: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.223992485s Aug 18 12:04:34.295: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.228168238s Aug 18 12:04:36.301: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.234285373s Aug 18 12:04:38.304: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.237777881s Aug 18 12:04:40.308: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.240978186s Aug 18 12:04:42.313: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.245916919s Aug 18 12:04:44.317: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.25080187s Aug 18 12:04:46.324: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.257027582s Aug 18 12:04:48.327: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.25992774s Aug 18 12:04:50.330: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.26338968s Aug 18 12:04:52.335: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.268111749s Aug 18 12:04:54.339: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.272304994s Aug 18 12:04:56.346: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.279069998s Aug 18 12:04:58.350: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.283816879s Aug 18 12:05:00.354: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.287338071s Aug 18 12:05:02.360: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.293711468s Aug 18 12:05:04.364: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.297544649s Aug 18 12:05:06.370: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.303550254s Aug 18 12:05:08.376: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.309128789s Aug 18 12:05:10.381: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.313962189s Aug 18 12:05:12.384: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.317399601s Aug 18 12:05:14.388: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.321535927s Aug 18 12:05:16.392: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.325511465s Aug 18 12:05:18.395: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.328622441s Aug 18 12:05:20.400: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.333507252s Aug 18 12:05:22.403: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.336803887s Aug 18 12:05:24.407: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.340164825s Aug 18 12:05:26.411: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.344406308s Aug 18 12:05:28.415: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.348732398s Aug 18 12:05:30.419: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.352525763s Aug 18 12:05:32.422: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.355742646s Aug 18 12:05:34.425: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.358676105s Aug 18 12:05:36.429: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.362015644s Aug 18 12:05:38.433: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.366039845s Aug 18 12:05:40.437: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.369949263s Aug 18 12:05:42.440: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.373491859s Aug 18 12:05:44.443: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.376618042s Aug 18 12:05:46.447: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.380546502s Aug 18 12:05:48.450: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.383353408s Aug 18 12:05:50.454: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.38719531s Aug 18 12:05:52.458: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.391154766s Aug 18 12:05:54.461: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.39413123s Aug 18 12:05:56.464: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.39693758s Aug 18 12:05:58.467: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.400138486s Aug 18 12:06:00.471: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.404588535s Aug 18 12:06:02.475: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.408212232s Aug 18 12:06:04.479: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.411931232s Aug 18 12:06:06.482: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.414957795s Aug 18 12:06:08.487: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.420056545s Aug 18 12:06:10.494: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.427098858s Aug 18 12:06:12.499: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.43213675s Aug 18 12:06:14.502: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.434975613s Aug 18 12:06:16.505: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.438095488s Aug 18 12:06:18.511: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.444195136s Aug 18 12:06:20.517: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.450680408s Aug 18 12:06:22.520: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.453523231s Aug 18 12:06:24.524: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.45770141s Aug 18 12:06:26.530: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.463305477s Aug 18 12:06:28.535: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.468890838s Aug 18 12:06:30.539: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.472844303s Aug 18 12:06:32.543: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.47615416s Aug 18 12:06:34.547: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.479981569s Aug 18 12:06:36.551: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.484493009s Aug 18 12:06:38.555: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.488857677s Aug 18 12:06:40.560: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.493392411s Aug 18 12:06:42.563: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.496794579s Aug 18 12:06:44.567: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.500750303s Aug 18 12:06:46.573: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.506728961s Aug 18 12:06:48.580: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.513687791s Aug 18 12:06:50.587: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.520650372s Aug 18 12:06:52.591: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.524564345s Aug 18 12:06:54.595: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.527935168s Aug 18 12:06:56.598: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.531674682s Aug 18 12:06:58.603: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.536272099s Aug 18 12:07:00.607: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.540221141s Aug 18 12:07:02.610: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.543328923s Aug 18 12:07:04.614: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.547348301s Aug 18 12:07:06.618: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.551002377s Aug 18 12:07:08.621: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.554702034s Aug 18 12:07:10.624: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.557736499s Aug 18 12:07:12.627: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.560591253s Aug 18 12:07:14.630: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.563728699s Aug 18 12:07:16.639: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.572105874s Aug 18 12:07:18.644: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.577110156s Aug 18 12:07:20.648: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.581501373s Aug 18 12:07:22.652: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.585360441s Aug 18 12:07:24.656: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.589348753s Aug 18 12:07:26.660: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.593343512s Aug 18 12:07:28.665: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.598123334s Aug 18 12:07:30.670: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.603322321s Aug 18 12:07:32.674: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.607054603s Aug 18 12:07:34.679: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.611922122s Aug 18 12:07:36.686: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.61986822s Aug 18 12:07:38.691: INFO: Pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.624868902s Aug 18 12:07:40.706: INFO: Failed to get logs from node "node1" pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419" container "env3cont": the server rejected our request for an unknown reason (get pods client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419) STEP: delete the pod Aug 18 12:07:40.714: INFO: Waiting for pod client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419 to disappear Aug 18 12:07:40.716: INFO: Pod client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419 still exists Aug 18 12:07:42.717: INFO: Waiting for pod client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419 to disappear Aug 18 12:07:42.721: INFO: Pod client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419 no longer exists Aug 18 12:07:42.721: INFO: (Attempt 3 of 3) Unexpected error occurred: expected pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419" success: Gave up after waiting 5m0s for pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419" to be "Succeeded or Failed" goroutine 44 [running]: runtime/debug.Stack(0x4, 0x4bed6ae, 0x2) /usr/local/go/src/runtime/debug/stack.go:24 +0x9f runtime/debug.PrintStack() /usr/local/go/src/runtime/debug/stack.go:16 +0x25 k8s.io/kubernetes/test/e2e/common.expectNoErrorWithRetries(0xc0010a1108, 0x3, 0xc004dfbcc0, 0x1, 0x1) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/pods.go:173 +0x2bc k8s.io/kubernetes/test/e2e/common.glob..func18.6() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/pods.go:527 +0xaf2 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/internal/leafnodes.(*runner).runSync(0xc000281800, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/internal/leafnodes/runner.go:113 +0xa3 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/internal/leafnodes.(*runner).run(0xc000281800, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/internal/leafnodes/runner.go:64 +0x15c k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/internal/leafnodes.(*ItNode).Run(0xc000d08180, 0x52ea280, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/internal/leafnodes/it_node.go:26 +0x87 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/internal/spec.(*Spec).runSample(0xc002def590, 0x0, 0x52ea280, 0xc0002208c0) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/internal/spec/spec.go:215 +0x72f k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/internal/spec.(*Spec).Run(0xc002def590, 0x52ea280, 0xc0002208c0) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/internal/spec/spec.go:138 +0xf2 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/internal/specrunner.(*SpecRunner).runSpec(0xc0010688c0, 0xc002def590, 0x0) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/internal/specrunner/spec_runner.go:200 +0x111 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/internal/specrunner.(*SpecRunner).runSpecs(0xc0010688c0, 0x1) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/internal/specrunner/spec_runner.go:170 +0x127 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/internal/specrunner.(*SpecRunner).Run(0xc0010688c0, 0xc000d01a60) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/internal/specrunner/spec_runner.go:66 +0x117 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/internal/suite.(*Suite).Run(0xc000166280, 0x7f1bda3afad8, 0xc002593080, 0x4c2974b, 0x14, 0xc003bb3d40, 0x3, 0x3, 0x539f360, 0xc0002208c0, ...) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/internal/suite/suite.go:62 +0x426 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo.RunSpecsWithCustomReporters(0x52eeee0, 0xc002593080, 0x4c2974b, 0x14, 0xc003a0d100, 0x3, 0x4, 0x4) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/ginkgo_dsl.go:226 +0x238 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo.RunSpecsWithDefaultAndCustomReporters(0x52eeee0, 0xc002593080, 0x4c2974b, 0x14, 0xc000c77f00, 0x2, 0x2, 0x2) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/ginkgo_dsl.go:214 +0xad k8s.io/kubernetes/test/e2e.RunE2ETests(0xc002593080) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc002593080) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc002593080, 0x4deb2c0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 Aug 18 12:07:42.722: FAIL: Container should have service environment variables set Unexpected error: <*errors.errorString | 0xc009b372d0>: { s: "expected pod \"client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419\" success: Gave up after waiting 5m0s for pod \"client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419\" to be \"Succeeded or Failed\"", } expected pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419" success: Gave up after waiting 5m0s for pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419" to be "Succeeded or Failed" occurred Full Stack Trace k8s.io/kubernetes/test/e2e/common.glob..func18.6() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/pods.go:527 +0xaf2 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc002593080) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc002593080) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc002593080, 0x4deb2c0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] Pods /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "pods-9046". STEP: Found 31 events. Aug 18 12:07:42.728: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419: { } Scheduled: Successfully assigned pods-9046/client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419 to node1 Aug 18 12:07:42.728: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419: { } Scheduled: Successfully assigned pods-9046/client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419 to node2 Aug 18 12:07:42.728: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419: { } Scheduled: Successfully assigned pods-9046/client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419 to node1 Aug 18 12:07:42.728: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for server-envvars-dcc91a28-e119-476f-ad7b-86dc853ddeb4: { } Scheduled: Successfully assigned pods-9046/server-envvars-dcc91a28-e119-476f-ad7b-86dc853ddeb4 to node1 Aug 18 12:07:42.728: INFO: At 2021-08-18 11:52:30 +0000 UTC - event for server-envvars-dcc91a28-e119-476f-ad7b-86dc853ddeb4: {kubelet node1} Pulled: Successfully pulled image "k8s.gcr.io/e2e-test-images/agnhost:2.20" in 524.401707ms Aug 18 12:07:42.728: INFO: At 2021-08-18 11:52:30 +0000 UTC - event for server-envvars-dcc91a28-e119-476f-ad7b-86dc853ddeb4: {kubelet node1} Pulling: Pulling image "k8s.gcr.io/e2e-test-images/agnhost:2.20" Aug 18 12:07:42.728: INFO: At 2021-08-18 11:52:30 +0000 UTC - event for server-envvars-dcc91a28-e119-476f-ad7b-86dc853ddeb4: {multus } AddedInterface: Add eth0 [10.244.4.108/24] Aug 18 12:07:42.728: INFO: At 2021-08-18 11:52:31 +0000 UTC - event for server-envvars-dcc91a28-e119-476f-ad7b-86dc853ddeb4: {kubelet node1} Created: Created container srv Aug 18 12:07:42.728: INFO: At 2021-08-18 11:52:31 +0000 UTC - event for server-envvars-dcc91a28-e119-476f-ad7b-86dc853ddeb4: {kubelet node1} Started: Started container srv Aug 18 12:07:42.728: INFO: At 2021-08-18 11:52:34 +0000 UTC - event for client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419: {kubelet node1} Pulling: Pulling image "docker.io/library/busybox:1.29" Aug 18 12:07:42.728: INFO: At 2021-08-18 11:52:34 +0000 UTC - event for client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419: {multus } AddedInterface: Add eth0 [10.244.4.110/24] Aug 18 12:07:42.728: INFO: At 2021-08-18 11:52:35 +0000 UTC - event for client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419: {kubelet node1} Failed: Error: ErrImagePull Aug 18 12:07:42.728: INFO: At 2021-08-18 11:52:35 +0000 UTC - event for client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419: {kubelet node1} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit Aug 18 12:07:42.728: INFO: At 2021-08-18 11:52:36 +0000 UTC - event for client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419: {kubelet node1} Failed: Error: ImagePullBackOff Aug 18 12:07:42.728: INFO: At 2021-08-18 11:52:36 +0000 UTC - event for client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419: {kubelet node1} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" Aug 18 12:07:42.728: INFO: At 2021-08-18 11:57:38 +0000 UTC - event for client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419: {multus } AddedInterface: Add eth0 [10.244.3.129/24] Aug 18 12:07:42.728: INFO: At 2021-08-18 11:57:38 +0000 UTC - event for client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419: {kubelet node2} Pulling: Pulling image "docker.io/library/busybox:1.29" Aug 18 12:07:42.728: INFO: At 2021-08-18 11:57:39 +0000 UTC - event for client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419: {kubelet node2} Failed: Error: ErrImagePull Aug 18 12:07:42.728: INFO: At 2021-08-18 11:57:39 +0000 UTC - event for client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419: {kubelet node2} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit Aug 18 12:07:42.728: INFO: At 2021-08-18 11:57:40 +0000 UTC - event for client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419: {kubelet node2} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Aug 18 12:07:42.728: INFO: At 2021-08-18 11:57:42 +0000 UTC - event for client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419: {multus } AddedInterface: Add eth0 [10.244.3.130/24] Aug 18 12:07:42.728: INFO: At 2021-08-18 11:57:42 +0000 UTC - event for client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419: {kubelet node2} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" Aug 18 12:07:42.728: INFO: At 2021-08-18 11:57:42 +0000 UTC - event for client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419: {kubelet node2} Failed: Error: ImagePullBackOff Aug 18 12:07:42.728: INFO: At 2021-08-18 12:02:41 +0000 UTC - event for client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419: {multus } AddedInterface: Add eth0 [10.244.4.147/24] Aug 18 12:07:42.728: INFO: At 2021-08-18 12:02:41 +0000 UTC - event for client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419: {kubelet node1} Pulling: Pulling image "docker.io/library/busybox:1.29" Aug 18 12:07:42.728: INFO: At 2021-08-18 12:02:42 +0000 UTC - event for client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419: {kubelet node1} Failed: Error: ErrImagePull Aug 18 12:07:42.728: INFO: At 2021-08-18 12:02:42 +0000 UTC - event for client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419: {kubelet node1} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Aug 18 12:07:42.728: INFO: At 2021-08-18 12:02:42 +0000 UTC - event for client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419: {kubelet node1} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit Aug 18 12:07:42.728: INFO: At 2021-08-18 12:02:44 +0000 UTC - event for client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419: {multus } AddedInterface: Add eth0 [10.244.4.148/24] Aug 18 12:07:42.728: INFO: At 2021-08-18 12:02:44 +0000 UTC - event for client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419: {kubelet node1} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" Aug 18 12:07:42.728: INFO: At 2021-08-18 12:02:44 +0000 UTC - event for client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419: {kubelet node1} Failed: Error: ImagePullBackOff Aug 18 12:07:42.730: INFO: POD NODE PHASE GRACE CONDITIONS Aug 18 12:07:42.730: INFO: server-envvars-dcc91a28-e119-476f-ad7b-86dc853ddeb4 node1 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:52:28 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:52:31 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:52:31 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:52:28 +0000 UTC }] Aug 18 12:07:42.731: INFO: Aug 18 12:07:42.735: INFO: Logging node info for node master1 Aug 18 12:07:42.737: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 ebb211fa-503f-4cfe-b1ed-c95d27a70e6e 79840 0 2021-08-18 08:20:52 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"3a:82:be:72:b5:15"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:20:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:20:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:25:59 +0000 UTC,LastTransitionTime:2021-08-18 08:25:59 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 12:07:41 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 12:07:41 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 12:07:41 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 12:07:41 +0000 UTC,LastTransitionTime:2021-08-18 08:25:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:58c3e57359b641ad92fa1959f2fecf5d,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:012cd796-2076-45d6-8b14-d3e0451b1e64,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[@ :],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 12:07:42.738: INFO: Logging kubelet events for node master1 Aug 18 12:07:42.741: INFO: Logging pods the kubelet thinks is on node master1 Aug 18 12:07:42.757: INFO: kube-controller-manager-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 12:07:42.757: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 12:07:42.757: INFO: kube-multus-ds-amd64-kbcp6 started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 12:07:42.757: INFO: Container kube-multus ready: true, restart count 1 Aug 18 12:07:42.757: INFO: docker-registry-docker-registry-56cbc7bc58-49kl2 started at 2021-08-18 08:26:23 +0000 UTC (0+2 container statuses recorded) Aug 18 12:07:42.757: INFO: Container docker-registry ready: true, restart count 0 Aug 18 12:07:42.757: INFO: Container nginx ready: true, restart count 0 Aug 18 12:07:42.757: INFO: node-exporter-5hwz9 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 12:07:42.757: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 12:07:42.757: INFO: Container node-exporter ready: true, restart count 0 Aug 18 12:07:42.757: INFO: kube-apiserver-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 12:07:42.757: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 12:07:42.757: INFO: kube-proxy-vqk4v started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 12:07:42.757: INFO: Container kube-proxy ready: true, restart count 1 Aug 18 12:07:42.757: INFO: kube-flannel-q64cq started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 12:07:42.757: INFO: Init container install-cni ready: true, restart count 0 Aug 18 12:07:42.757: INFO: Container kube-flannel ready: true, restart count 3 Aug 18 12:07:42.757: INFO: coredns-7677f9bb54-kn2qg started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 12:07:42.757: INFO: Container coredns ready: true, restart count 2 Aug 18 12:07:42.758: INFO: kube-scheduler-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 12:07:42.758: INFO: Container kube-scheduler ready: true, restart count 0 W0818 12:07:42.771705 36 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 12:07:42.798: INFO: Latency metrics for node master1 Aug 18 12:07:42.798: INFO: Logging node info for node master2 Aug 18 12:07:42.801: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 78946293-3abe-4442-84d4-8ed6b1d15ce0 79838 0 2021-08-18 08:21:31 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"7e:f5:c2:cc:3a:b4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:21:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:21:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-08-18 08:29:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 12:07:40 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 12:07:40 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 12:07:40 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 12:07:40 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0c44122c7a7248c18d8571e1cc667258,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:0cd329f2-48e0-4c8f-b8b9-fa3ae0ed8406,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 12:07:42.802: INFO: Logging kubelet events for node master2 Aug 18 12:07:42.804: INFO: Logging pods the kubelet thinks is on node master2 Aug 18 12:07:42.819: INFO: kube-flannel-pp56h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 12:07:42.819: INFO: Init container install-cni ready: true, restart count 0 Aug 18 12:07:42.819: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 12:07:42.819: INFO: kube-controller-manager-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 12:07:42.819: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 12:07:42.819: INFO: kube-proxy-kh2l9 started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 12:07:42.819: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 12:07:42.819: INFO: kube-multus-ds-amd64-mld8g started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 12:07:42.819: INFO: Container kube-multus ready: true, restart count 1 Aug 18 12:07:42.819: INFO: dns-autoscaler-5b7b5c9b6f-hh47r started at 2021-08-18 08:23:57 +0000 UTC (0+1 container statuses recorded) Aug 18 12:07:42.819: INFO: Container autoscaler ready: true, restart count 2 Aug 18 12:07:42.819: INFO: node-feature-discovery-controller-5bf5c49849-mq57c started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 12:07:42.819: INFO: Container nfd-controller ready: true, restart count 0 Aug 18 12:07:42.819: INFO: node-exporter-48nfx started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 12:07:42.819: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 12:07:42.819: INFO: Container node-exporter ready: true, restart count 0 Aug 18 12:07:42.819: INFO: kube-apiserver-master2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 12:07:42.819: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 12:07:42.819: INFO: kube-scheduler-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 12:07:42.819: INFO: Container kube-scheduler ready: true, restart count 2 W0818 12:07:42.833092 36 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 12:07:42.858: INFO: Latency metrics for node master2 Aug 18 12:07:42.858: INFO: Logging node info for node master3 Aug 18 12:07:42.861: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 44feac2b-9447-4be2-9fcd-62f836d67c72 79817 0 2021-08-18 08:21:41 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"86:e4:31:99:58:40"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {kubelet Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 12:07:35 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 12:07:35 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 12:07:35 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 12:07:35 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1fae19ae59884c44899bcd08aa243244,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:5db926c5-6530-4635-a0d5-806974a3b732,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 12:07:42.861: INFO: Logging kubelet events for node master3 Aug 18 12:07:42.863: INFO: Logging pods the kubelet thinks is on node master3 Aug 18 12:07:42.878: INFO: kube-apiserver-master3 started at 2021-08-18 08:29:12 +0000 UTC (0+1 container statuses recorded) Aug 18 12:07:42.878: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 12:07:42.878: INFO: kube-proxy-sd5lc started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 12:07:42.878: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 12:07:42.878: INFO: kube-flannel-x6tlr started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 12:07:42.878: INFO: Init container install-cni ready: true, restart count 1 Aug 18 12:07:42.878: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 12:07:42.878: INFO: kube-multus-ds-amd64-bkw6c started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 12:07:42.878: INFO: Container kube-multus ready: true, restart count 1 Aug 18 12:07:42.878: INFO: coredns-7677f9bb54-5hxfh started at 2021-08-18 08:23:54 +0000 UTC (0+1 container statuses recorded) Aug 18 12:07:42.878: INFO: Container coredns ready: true, restart count 1 Aug 18 12:07:42.878: INFO: node-exporter-vq7d8 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 12:07:42.878: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 12:07:42.878: INFO: Container node-exporter ready: true, restart count 0 Aug 18 12:07:42.878: INFO: kube-controller-manager-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 12:07:42.878: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 12:07:42.878: INFO: kube-scheduler-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 12:07:42.878: INFO: Container kube-scheduler ready: true, restart count 2 W0818 12:07:42.889559 36 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 12:07:42.913: INFO: Latency metrics for node master3 Aug 18 12:07:42.913: INFO: Logging node info for node node1 Aug 18 12:07:42.917: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 84defabd-6ebf-43ec-a629-44c6713da9c9 79837 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"9a:87:55:36:7b:df"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:13 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:35 +0000 UTC,LastTransitionTime:2021-08-18 08:26:35 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 12:07:39 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 12:07:39 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 12:07:39 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 12:07:39 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:69946ff2b7bc462fa25eb7adb4703c23,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:736dc52f-f5e3-494e-86ca-01eedbea015c,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:a7cea43d9d2f67c38fbf0407786edbe660ee9072945f7bb272b55fd255e8eaca opnfv/barometer-collectd:stable],SizeBytes:1075746799,},ContainerImage{Names:[@ :],SizeBytes:1003788820,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[aquasec/kube-hunter@sha256:2be6820bc1d7e0f57193a9a27d5a3e16b2fd93c53747b03ce8ca48c6fc323781 aquasec/kube-hunter:0.3.1],SizeBytes:347611549,},ContainerImage{Names:[golang@sha256:db2475a1dbb2149508e5db31d7d77a75e6600d54be645f37681f03f2762169ba golang:alpine3.12],SizeBytes:301186719,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:de25c7fc6c4f3a27c7f0c2dff454e4671823a34d88abd533f210848d527e0fbb alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 12:07:42.918: INFO: Logging kubelet events for node node1 Aug 18 12:07:42.920: INFO: Logging pods the kubelet thinks is on node node1 Aug 18 12:07:42.933: INFO: cmk-init-discover-node1-bxznx started at 2021-08-18 08:32:10 +0000 UTC (0+3 container statuses recorded) Aug 18 12:07:42.933: INFO: Container discover ready: false, restart count 0 Aug 18 12:07:42.933: INFO: Container init ready: false, restart count 0 Aug 18 12:07:42.933: INFO: Container install ready: false, restart count 0 Aug 18 12:07:42.933: INFO: collectd-xdprr started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 12:07:42.933: INFO: Container collectd ready: true, restart count 0 Aug 18 12:07:42.933: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 12:07:42.933: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 12:07:42.933: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-vsxvg started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 12:07:42.933: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 12:07:42.933: INFO: kube-flannel-q78nd started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 12:07:42.933: INFO: Init container install-cni ready: true, restart count 2 Aug 18 12:07:42.933: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 12:07:42.933: INFO: prometheus-k8s-0 started at 2021-08-18 08:34:03 +0000 UTC (0+5 container statuses recorded) Aug 18 12:07:42.933: INFO: Container custom-metrics-apiserver ready: true, restart count 0 Aug 18 12:07:42.933: INFO: Container grafana ready: true, restart count 0 Aug 18 12:07:42.933: INFO: Container prometheus ready: true, restart count 1 Aug 18 12:07:42.933: INFO: Container prometheus-config-reloader ready: true, restart count 0 Aug 18 12:07:42.933: INFO: Container rules-configmap-reloader ready: true, restart count 0 Aug 18 12:07:42.933: INFO: kube-proxy-p6jvp started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 12:07:42.933: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 12:07:42.933: INFO: kubernetes-metrics-scraper-678c97765c-9nsv5 started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 12:07:42.933: INFO: Container kubernetes-metrics-scraper ready: true, restart count 2 Aug 18 12:07:42.933: INFO: cmk-d8r27 started at 2021-08-18 08:32:52 +0000 UTC (0+2 container statuses recorded) Aug 18 12:07:42.933: INFO: Container nodereport ready: true, restart count 0 Aug 18 12:07:42.933: INFO: Container reconcile ready: true, restart count 0 Aug 18 12:07:42.933: INFO: nginx-proxy-node1 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 12:07:42.933: INFO: Container nginx-proxy ready: true, restart count 2 Aug 18 12:07:42.933: INFO: kube-multus-ds-amd64-rrvmb started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 12:07:42.933: INFO: Container kube-multus ready: true, restart count 1 Aug 18 12:07:42.933: INFO: node-feature-discovery-worker-pflgw started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 12:07:42.933: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 12:07:42.933: INFO: node-exporter-kcwvn started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 12:07:42.933: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 12:07:42.933: INFO: Container node-exporter ready: true, restart count 0 Aug 18 12:07:42.933: INFO: foo-xpsfd started at 2021-08-18 11:53:08 +0000 UTC (0+1 container statuses recorded) Aug 18 12:07:42.933: INFO: Container c ready: false, restart count 0 Aug 18 12:07:42.933: INFO: server-envvars-dcc91a28-e119-476f-ad7b-86dc853ddeb4 started at 2021-08-18 11:52:28 +0000 UTC (0+1 container statuses recorded) Aug 18 12:07:42.933: INFO: Container srv ready: true, restart count 0 W0818 12:07:42.947252 36 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 12:07:42.978: INFO: Latency metrics for node node1 Aug 18 12:07:42.978: INFO: Logging node info for node node2 Aug 18 12:07:42.981: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 1d01177e-3dbb-48a1-a0bc-d18af27ab7f8 79824 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:d1:47:f8:1d:22"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:36 +0000 UTC,LastTransitionTime:2021-08-18 08:26:36 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 12:07:36 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 12:07:36 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 12:07:36 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 12:07:36 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:dc1f286135c145349b8a016880b65a2f,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:037e7e2d-94e9-42f4-a719-896e5005ac70,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 12:07:42.981: INFO: Logging kubelet events for node node2 Aug 18 12:07:42.984: INFO: Logging pods the kubelet thinks is on node node2 Aug 18 12:07:43.002: INFO: kube-proxy-qkj9c started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 12:07:43.002: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 12:07:43.002: INFO: node-feature-discovery-worker-hzpf5 started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 12:07:43.002: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 12:07:43.002: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-c82pt started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 12:07:43.002: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 12:07:43.002: INFO: prometheus-operator-5bb8cb9d8f-k97ws started at 2021-08-18 08:33:38 +0000 UTC (0+2 container statuses recorded) Aug 18 12:07:43.002: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 12:07:43.002: INFO: Container prometheus-operator ready: true, restart count 0 Aug 18 12:07:43.002: INFO: kube-multus-ds-amd64-rvzsg started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 12:07:43.002: INFO: Container kube-multus ready: true, restart count 1 Aug 18 12:07:43.002: INFO: collectd-67ntq started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 12:07:43.002: INFO: Container collectd ready: true, restart count 0 Aug 18 12:07:43.002: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 12:07:43.002: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 12:07:43.002: INFO: cmk-webhook-6c9d5f8578-7cxjr started at 2021-08-18 08:32:53 +0000 UTC (0+1 container statuses recorded) Aug 18 12:07:43.002: INFO: Container cmk-webhook ready: true, restart count 0 Aug 18 12:07:43.002: INFO: kube-flannel-h7t5h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 12:07:43.002: INFO: Init container install-cni ready: true, restart count 2 Aug 18 12:07:43.002: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 12:07:43.002: INFO: node-exporter-lrrf2 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 12:07:43.002: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 12:07:43.002: INFO: Container node-exporter ready: true, restart count 0 Aug 18 12:07:43.002: INFO: foo-mcmfh started at 2021-08-18 11:53:08 +0000 UTC (0+1 container statuses recorded) Aug 18 12:07:43.002: INFO: Container c ready: false, restart count 0 Aug 18 12:07:43.002: INFO: nginx-proxy-node2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 12:07:43.002: INFO: Container nginx-proxy ready: true, restart count 1 Aug 18 12:07:43.002: INFO: cmk-init-discover-node2-6b2kz started at 2021-08-18 08:32:30 +0000 UTC (0+3 container statuses recorded) Aug 18 12:07:43.002: INFO: Container discover ready: false, restart count 0 Aug 18 12:07:43.002: INFO: Container init ready: false, restart count 0 Aug 18 12:07:43.003: INFO: Container install ready: false, restart count 0 Aug 18 12:07:43.003: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-7rn45 started at 2021-08-18 08:36:42 +0000 UTC (0+2 container statuses recorded) Aug 18 12:07:43.003: INFO: Container tas-controller ready: true, restart count 0 Aug 18 12:07:43.003: INFO: Container tas-extender ready: true, restart count 0 Aug 18 12:07:43.003: INFO: kubernetes-dashboard-86c6f9df5b-qrtdk started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 12:07:43.003: INFO: Container kubernetes-dashboard ready: true, restart count 2 Aug 18 12:07:43.003: INFO: cmk-748rz started at 2021-08-18 08:32:53 +0000 UTC (0+2 container statuses recorded) Aug 18 12:07:43.003: INFO: Container nodereport ready: true, restart count 0 Aug 18 12:07:43.003: INFO: Container reconcile ready: true, restart count 0 W0818 12:07:43.015898 36 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 12:07:43.049: INFO: Latency metrics for node node2 Aug 18 12:07:43.049: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "pods-9046" for this suite. • Failure [914.159 seconds] [k8s.io] Pods /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:592 should contain environment variables for services [NodeConformance] [Conformance] [It] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 12:07:42.722: Container should have service environment variables set Unexpected error: <*errors.errorString | 0xc009b372d0>: { s: "expected pod \"client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419\" success: Gave up after waiting 5m0s for pod \"client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419\" to be \"Succeeded or Failed\"", } expected pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419" success: Gave up after waiting 5m0s for pod "client-envvars-b10c7159-c92c-40fb-a01a-9e3d14392419" to be "Succeeded or Failed" occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/pods.go:527 ------------------------------ {"msg":"FAILED [k8s.io] Pods should contain environment variables for services [NodeConformance] [Conformance]","total":-1,"completed":35,"skipped":873,"failed":6,"failures":["[sig-network] Services should be able to create a functioning NodePort service [Conformance]","[k8s.io] Pods should support retrieving logs from the container over websockets [NodeConformance] [Conformance]","[k8s.io] InitContainer [NodeConformance] should not start app containers if init containers fail on a RestartAlways pod [Conformance]","[k8s.io] Container Runtime blackbox test on terminated container should report termination message [LinuxOnly] if TerminationMessagePath is set as non-root user and at a non-default path [NodeConformance] [Conformance]","[sig-network] Services should have session affinity timeout work for NodePort service [LinuxOnly] [Conformance]","[k8s.io] Pods should contain environment variables for services [NodeConformance] [Conformance]"]} Aug 18 12:07:43.064: INFO: Running AfterSuite actions on all nodes [BeforeEach] [sig-apps] Job /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client Aug 18 11:53:08.699: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename job STEP: Waiting for a default service account to be provisioned in namespace [It] should delete a job [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating a job STEP: Ensuring active pods == parallelism Aug 18 12:08:08.734: FAIL: failed to ensure active pods == parallelism in namespace: job-7669 Unexpected error: <*errors.errorString | 0xc0003001f0>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/apps.glob..func6.6() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/job.go:163 +0x345 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc001283680) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc001283680) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc001283680, 0x4deb2c0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [sig-apps] Job /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "job-7669". STEP: Found 20 events. Aug 18 12:08:08.740: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for foo-mcmfh: { } Scheduled: Successfully assigned job-7669/foo-mcmfh to node2 Aug 18 12:08:08.740: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for foo-xpsfd: { } Scheduled: Successfully assigned job-7669/foo-xpsfd to node1 Aug 18 12:08:08.740: INFO: At 2021-08-18 11:53:08 +0000 UTC - event for foo: {job-controller } SuccessfulCreate: Created pod: foo-xpsfd Aug 18 12:08:08.740: INFO: At 2021-08-18 11:53:08 +0000 UTC - event for foo: {job-controller } SuccessfulCreate: Created pod: foo-mcmfh Aug 18 12:08:08.740: INFO: At 2021-08-18 11:53:10 +0000 UTC - event for foo-mcmfh: {multus } AddedInterface: Add eth0 [10.244.3.107/24] Aug 18 12:08:08.740: INFO: At 2021-08-18 11:53:10 +0000 UTC - event for foo-mcmfh: {kubelet node2} Pulling: Pulling image "docker.io/library/busybox:1.29" Aug 18 12:08:08.740: INFO: At 2021-08-18 11:53:10 +0000 UTC - event for foo-xpsfd: {multus } AddedInterface: Add eth0 [10.244.4.116/24] Aug 18 12:08:08.740: INFO: At 2021-08-18 11:53:10 +0000 UTC - event for foo-xpsfd: {kubelet node1} Pulling: Pulling image "docker.io/library/busybox:1.29" Aug 18 12:08:08.740: INFO: At 2021-08-18 11:53:11 +0000 UTC - event for foo-mcmfh: {kubelet node2} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit Aug 18 12:08:08.740: INFO: At 2021-08-18 11:53:11 +0000 UTC - event for foo-mcmfh: {kubelet node2} Failed: Error: ErrImagePull Aug 18 12:08:08.740: INFO: At 2021-08-18 11:53:11 +0000 UTC - event for foo-xpsfd: {kubelet node1} Failed: Error: ErrImagePull Aug 18 12:08:08.740: INFO: At 2021-08-18 11:53:11 +0000 UTC - event for foo-xpsfd: {kubelet node1} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Aug 18 12:08:08.740: INFO: At 2021-08-18 11:53:11 +0000 UTC - event for foo-xpsfd: {kubelet node1} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit Aug 18 12:08:08.740: INFO: At 2021-08-18 11:53:12 +0000 UTC - event for foo-mcmfh: {kubelet node2} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Aug 18 12:08:08.740: INFO: At 2021-08-18 11:53:12 +0000 UTC - event for foo-xpsfd: {kubelet node1} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" Aug 18 12:08:08.740: INFO: At 2021-08-18 11:53:12 +0000 UTC - event for foo-xpsfd: {kubelet node1} Failed: Error: ImagePullBackOff Aug 18 12:08:08.740: INFO: At 2021-08-18 11:53:12 +0000 UTC - event for foo-xpsfd: {multus } AddedInterface: Add eth0 [10.244.4.117/24] Aug 18 12:08:08.740: INFO: At 2021-08-18 11:53:16 +0000 UTC - event for foo-mcmfh: {multus } AddedInterface: Add eth0 [10.244.3.110/24] Aug 18 12:08:08.740: INFO: At 2021-08-18 11:53:17 +0000 UTC - event for foo-mcmfh: {kubelet node2} Failed: Error: ImagePullBackOff Aug 18 12:08:08.740: INFO: At 2021-08-18 11:53:17 +0000 UTC - event for foo-mcmfh: {kubelet node2} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" Aug 18 12:08:08.743: INFO: POD NODE PHASE GRACE CONDITIONS Aug 18 12:08:08.743: INFO: foo-mcmfh node2 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:53:08 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:53:08 +0000 UTC ContainersNotReady containers with unready status: [c]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:53:08 +0000 UTC ContainersNotReady containers with unready status: [c]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:53:08 +0000 UTC }] Aug 18 12:08:08.743: INFO: foo-xpsfd node1 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:53:08 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:53:08 +0000 UTC ContainersNotReady containers with unready status: [c]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:53:08 +0000 UTC ContainersNotReady containers with unready status: [c]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-08-18 11:53:08 +0000 UTC }] Aug 18 12:08:08.743: INFO: Aug 18 12:08:08.747: INFO: Logging node info for node master1 Aug 18 12:08:08.750: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 ebb211fa-503f-4cfe-b1ed-c95d27a70e6e 79954 0 2021-08-18 08:20:52 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"3a:82:be:72:b5:15"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:20:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:20:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234763776 0} {} 196518324Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324599808 0} {} 195629492Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:25:59 +0000 UTC,LastTransitionTime:2021-08-18 08:25:59 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 12:08:01 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 12:08:01 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 12:08:01 +0000 UTC,LastTransitionTime:2021-08-18 08:20:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 12:08:01 +0000 UTC,LastTransitionTime:2021-08-18 08:25:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:58c3e57359b641ad92fa1959f2fecf5d,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:012cd796-2076-45d6-8b14-d3e0451b1e64,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[@ :],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 12:08:08.750: INFO: Logging kubelet events for node master1 Aug 18 12:08:08.753: INFO: Logging pods the kubelet thinks is on node master1 Aug 18 12:08:08.762: INFO: kube-controller-manager-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 12:08:08.762: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 12:08:08.762: INFO: kube-multus-ds-amd64-kbcp6 started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 12:08:08.762: INFO: Container kube-multus ready: true, restart count 1 Aug 18 12:08:08.762: INFO: docker-registry-docker-registry-56cbc7bc58-49kl2 started at 2021-08-18 08:26:23 +0000 UTC (0+2 container statuses recorded) Aug 18 12:08:08.762: INFO: Container docker-registry ready: true, restart count 0 Aug 18 12:08:08.762: INFO: Container nginx ready: true, restart count 0 Aug 18 12:08:08.762: INFO: node-exporter-5hwz9 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 12:08:08.762: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 12:08:08.762: INFO: Container node-exporter ready: true, restart count 0 Aug 18 12:08:08.762: INFO: kube-apiserver-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 12:08:08.762: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 12:08:08.762: INFO: kube-proxy-vqk4v started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 12:08:08.762: INFO: Container kube-proxy ready: true, restart count 1 Aug 18 12:08:08.762: INFO: kube-flannel-q64cq started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 12:08:08.762: INFO: Init container install-cni ready: true, restart count 0 Aug 18 12:08:08.762: INFO: Container kube-flannel ready: true, restart count 3 Aug 18 12:08:08.762: INFO: coredns-7677f9bb54-kn2qg started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 12:08:08.762: INFO: Container coredns ready: true, restart count 2 Aug 18 12:08:08.762: INFO: kube-scheduler-master1 started at 2021-08-18 08:25:08 +0000 UTC (0+1 container statuses recorded) Aug 18 12:08:08.762: INFO: Container kube-scheduler ready: true, restart count 0 W0818 12:08:08.774135 27 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 12:08:08.805: INFO: Latency metrics for node master1 Aug 18 12:08:08.805: INFO: Logging node info for node master2 Aug 18 12:08:08.807: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 78946293-3abe-4442-84d4-8ed6b1d15ce0 79951 0 2021-08-18 08:21:31 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"7e:f5:c2:cc:3a:b4"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-08-18 08:21:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-08-18 08:21:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-08-18 08:29:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 12:08:00 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 12:08:00 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 12:08:00 +0000 UTC,LastTransitionTime:2021-08-18 08:21:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 12:08:00 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0c44122c7a7248c18d8571e1cc667258,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:0cd329f2-48e0-4c8f-b8b9-fa3ae0ed8406,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 12:08:08.808: INFO: Logging kubelet events for node master2 Aug 18 12:08:08.810: INFO: Logging pods the kubelet thinks is on node master2 Aug 18 12:08:08.818: INFO: kube-controller-manager-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 12:08:08.818: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 12:08:08.818: INFO: kube-proxy-kh2l9 started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 12:08:08.818: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 12:08:08.818: INFO: kube-flannel-pp56h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 12:08:08.818: INFO: Init container install-cni ready: true, restart count 0 Aug 18 12:08:08.818: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 12:08:08.818: INFO: kube-apiserver-master2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 12:08:08.818: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 12:08:08.818: INFO: kube-scheduler-master2 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 12:08:08.818: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 12:08:08.818: INFO: kube-multus-ds-amd64-mld8g started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 12:08:08.818: INFO: Container kube-multus ready: true, restart count 1 Aug 18 12:08:08.818: INFO: dns-autoscaler-5b7b5c9b6f-hh47r started at 2021-08-18 08:23:57 +0000 UTC (0+1 container statuses recorded) Aug 18 12:08:08.818: INFO: Container autoscaler ready: true, restart count 2 Aug 18 12:08:08.818: INFO: node-feature-discovery-controller-5bf5c49849-mq57c started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 12:08:08.818: INFO: Container nfd-controller ready: true, restart count 0 Aug 18 12:08:08.818: INFO: node-exporter-48nfx started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 12:08:08.818: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 12:08:08.818: INFO: Container node-exporter ready: true, restart count 0 W0818 12:08:08.833004 27 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 12:08:08.862: INFO: Latency metrics for node master2 Aug 18 12:08:08.862: INFO: Logging node info for node master3 Aug 18 12:08:08.865: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 44feac2b-9447-4be2-9fcd-62f836d67c72 79967 0 2021-08-18 08:21:41 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"86:e4:31:99:58:40"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {kubelet Update v1 2021-08-18 08:21:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {flanneld Update v1 2021-08-18 08:23:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-08-18 08:23:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{201234767872 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{200324603904 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:30 +0000 UTC,LastTransitionTime:2021-08-18 08:26:30 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 12:08:05 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 12:08:05 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 12:08:05 +0000 UTC,LastTransitionTime:2021-08-18 08:21:41 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 12:08:05 +0000 UTC,LastTransitionTime:2021-08-18 08:23:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1fae19ae59884c44899bcd08aa243244,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:5db926c5-6530-4635-a0d5-806974a3b732,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 12:08:08.865: INFO: Logging kubelet events for node master3 Aug 18 12:08:08.868: INFO: Logging pods the kubelet thinks is on node master3 Aug 18 12:08:08.877: INFO: kube-multus-ds-amd64-bkw6c started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 12:08:08.877: INFO: Container kube-multus ready: true, restart count 1 Aug 18 12:08:08.877: INFO: coredns-7677f9bb54-5hxfh started at 2021-08-18 08:23:54 +0000 UTC (0+1 container statuses recorded) Aug 18 12:08:08.877: INFO: Container coredns ready: true, restart count 1 Aug 18 12:08:08.877: INFO: node-exporter-vq7d8 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 12:08:08.877: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 12:08:08.877: INFO: Container node-exporter ready: true, restart count 0 Aug 18 12:08:08.877: INFO: kube-controller-manager-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 12:08:08.877: INFO: Container kube-controller-manager ready: true, restart count 2 Aug 18 12:08:08.877: INFO: kube-scheduler-master3 started at 2021-08-18 08:22:07 +0000 UTC (0+1 container statuses recorded) Aug 18 12:08:08.877: INFO: Container kube-scheduler ready: true, restart count 2 Aug 18 12:08:08.877: INFO: kube-apiserver-master3 started at 2021-08-18 08:29:12 +0000 UTC (0+1 container statuses recorded) Aug 18 12:08:08.877: INFO: Container kube-apiserver ready: true, restart count 0 Aug 18 12:08:08.877: INFO: kube-proxy-sd5lc started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 12:08:08.877: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 12:08:08.877: INFO: kube-flannel-x6tlr started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 12:08:08.877: INFO: Init container install-cni ready: true, restart count 1 Aug 18 12:08:08.877: INFO: Container kube-flannel ready: true, restart count 1 W0818 12:08:08.890326 27 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 12:08:08.916: INFO: Latency metrics for node master3 Aug 18 12:08:08.916: INFO: Logging node info for node node1 Aug 18 12:08:08.919: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 84defabd-6ebf-43ec-a629-44c6713da9c9 79950 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"9a:87:55:36:7b:df"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:13 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:35 +0000 UTC,LastTransitionTime:2021-08-18 08:26:35 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 12:08:00 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 12:08:00 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 12:08:00 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 12:08:00 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:69946ff2b7bc462fa25eb7adb4703c23,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:736dc52f-f5e3-494e-86ca-01eedbea015c,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:a7cea43d9d2f67c38fbf0407786edbe660ee9072945f7bb272b55fd255e8eaca opnfv/barometer-collectd:stable],SizeBytes:1075746799,},ContainerImage{Names:[@ :],SizeBytes:1003788820,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[aquasec/kube-hunter@sha256:2be6820bc1d7e0f57193a9a27d5a3e16b2fd93c53747b03ce8ca48c6fc323781 aquasec/kube-hunter:0.3.1],SizeBytes:347611549,},ContainerImage{Names:[golang@sha256:db2475a1dbb2149508e5db31d7d77a75e6600d54be645f37681f03f2762169ba golang:alpine3.12],SizeBytes:301186719,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[aquasec/kube-bench@sha256:3544f6662feb73d36fdba35b17652e2fd73aae45bd4b60e76d7ab928220b3cc6 aquasec/kube-bench:0.3.1],SizeBytes:19301876,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:de25c7fc6c4f3a27c7f0c2dff454e4671823a34d88abd533f210848d527e0fbb alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 12:08:08.920: INFO: Logging kubelet events for node node1 Aug 18 12:08:08.922: INFO: Logging pods the kubelet thinks is on node node1 Aug 18 12:08:08.934: INFO: kube-multus-ds-amd64-rrvmb started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 12:08:08.934: INFO: Container kube-multus ready: true, restart count 1 Aug 18 12:08:08.934: INFO: node-feature-discovery-worker-pflgw started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 12:08:08.934: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 12:08:08.934: INFO: node-exporter-kcwvn started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 12:08:08.934: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 12:08:08.934: INFO: Container node-exporter ready: true, restart count 0 Aug 18 12:08:08.934: INFO: foo-xpsfd started at 2021-08-18 11:53:08 +0000 UTC (0+1 container statuses recorded) Aug 18 12:08:08.935: INFO: Container c ready: false, restart count 0 Aug 18 12:08:08.935: INFO: cmk-init-discover-node1-bxznx started at 2021-08-18 08:32:10 +0000 UTC (0+3 container statuses recorded) Aug 18 12:08:08.935: INFO: Container discover ready: false, restart count 0 Aug 18 12:08:08.935: INFO: Container init ready: false, restart count 0 Aug 18 12:08:08.935: INFO: Container install ready: false, restart count 0 Aug 18 12:08:08.935: INFO: collectd-xdprr started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 12:08:08.935: INFO: Container collectd ready: true, restart count 0 Aug 18 12:08:08.935: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 12:08:08.935: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 12:08:08.935: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-vsxvg started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 12:08:08.935: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 12:08:08.935: INFO: kube-flannel-q78nd started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 12:08:08.935: INFO: Init container install-cni ready: true, restart count 2 Aug 18 12:08:08.935: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 12:08:08.935: INFO: prometheus-k8s-0 started at 2021-08-18 08:34:03 +0000 UTC (0+5 container statuses recorded) Aug 18 12:08:08.935: INFO: Container custom-metrics-apiserver ready: true, restart count 0 Aug 18 12:08:08.935: INFO: Container grafana ready: true, restart count 0 Aug 18 12:08:08.935: INFO: Container prometheus ready: true, restart count 1 Aug 18 12:08:08.935: INFO: Container prometheus-config-reloader ready: true, restart count 0 Aug 18 12:08:08.935: INFO: Container rules-configmap-reloader ready: true, restart count 0 Aug 18 12:08:08.935: INFO: kube-proxy-p6jvp started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 12:08:08.935: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 12:08:08.935: INFO: kubernetes-metrics-scraper-678c97765c-9nsv5 started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 12:08:08.935: INFO: Container kubernetes-metrics-scraper ready: true, restart count 2 Aug 18 12:08:08.935: INFO: cmk-d8r27 started at 2021-08-18 08:32:52 +0000 UTC (0+2 container statuses recorded) Aug 18 12:08:08.935: INFO: Container nodereport ready: true, restart count 0 Aug 18 12:08:08.935: INFO: Container reconcile ready: true, restart count 0 Aug 18 12:08:08.935: INFO: nginx-proxy-node1 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 12:08:08.935: INFO: Container nginx-proxy ready: true, restart count 2 W0818 12:08:08.946398 27 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 12:08:08.987: INFO: Latency metrics for node node1 Aug 18 12:08:08.987: INFO: Logging node info for node node2 Aug 18 12:08:08.989: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 1d01177e-3dbb-48a1-a0bc-d18af27ab7f8 79974 0 2021-08-18 08:22:49 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.36.2.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:d1:47:f8:1d:22"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-08-18 08:22:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-08-18 08:22:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-08-18 08:23:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-08-18 08:29:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-08-18 08:32:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-08-18 08:32:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{80 0} {} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{201269633024 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {} 3 DecimalSI},cpu: {{77 0} {} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {} 4 DecimalSI},memory: {{178884632576 0} {} BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-08-18 08:26:36 +0000 UTC,LastTransitionTime:2021-08-18 08:26:36 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-08-18 12:08:06 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-08-18 12:08:06 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-08-18 12:08:06 +0000 UTC,LastTransitionTime:2021-08-18 08:22:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-08-18 12:08:06 +0000 UTC,LastTransitionTime:2021-08-18 08:23:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:dc1f286135c145349b8a016880b65a2f,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:037e7e2d-94e9-42f4-a719-896e5005ac70,KernelVersion:3.10.0-1160.36.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:d56c8e10609e77af59159f698d19294b3e6164f3dfa4caeea2e9f8a03db3bbc9 localhost:30500/barometer-collectd:stable],SizeBytes:1238704095,},ContainerImage{Names:[localhost:30500/cmk@sha256:cfc6363fd65b307f56d5fda90d8b24ccf438917ea1adcbd081fa487574560240 localhost:30500/cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:723492975,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 sirot/netperf-latest:latest],SizeBytes:282025213,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:303c990733f0fd02559eb93953523657b9129af8e93af2b980e9a2dc39eb2163 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44394281,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:be4238d53eaa9d83cc4bb5a07d7a9e538d6fdb17890ea3d7a544557d3a58d7ac localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:825609c74c49cb0f2f1b97c13038e7896335c40081a310d3f25c630deb782efb localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Aug 18 12:08:08.990: INFO: Logging kubelet events for node node2 Aug 18 12:08:08.992: INFO: Logging pods the kubelet thinks is on node node2 Aug 18 12:08:09.003: INFO: nginx-proxy-node2 started at 2021-08-18 08:28:52 +0000 UTC (0+1 container statuses recorded) Aug 18 12:08:09.003: INFO: Container nginx-proxy ready: true, restart count 1 Aug 18 12:08:09.003: INFO: cmk-init-discover-node2-6b2kz started at 2021-08-18 08:32:30 +0000 UTC (0+3 container statuses recorded) Aug 18 12:08:09.003: INFO: Container discover ready: false, restart count 0 Aug 18 12:08:09.003: INFO: Container init ready: false, restart count 0 Aug 18 12:08:09.003: INFO: Container install ready: false, restart count 0 Aug 18 12:08:09.003: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-7rn45 started at 2021-08-18 08:36:42 +0000 UTC (0+2 container statuses recorded) Aug 18 12:08:09.003: INFO: Container tas-controller ready: true, restart count 0 Aug 18 12:08:09.003: INFO: Container tas-extender ready: true, restart count 0 Aug 18 12:08:09.003: INFO: kubernetes-dashboard-86c6f9df5b-qrtdk started at 2021-08-18 08:23:59 +0000 UTC (0+1 container statuses recorded) Aug 18 12:08:09.003: INFO: Container kubernetes-dashboard ready: true, restart count 2 Aug 18 12:08:09.003: INFO: cmk-748rz started at 2021-08-18 08:32:53 +0000 UTC (0+2 container statuses recorded) Aug 18 12:08:09.003: INFO: Container nodereport ready: true, restart count 0 Aug 18 12:08:09.003: INFO: Container reconcile ready: true, restart count 0 Aug 18 12:08:09.003: INFO: kube-proxy-qkj9c started at 2021-08-18 08:22:51 +0000 UTC (0+1 container statuses recorded) Aug 18 12:08:09.003: INFO: Container kube-proxy ready: true, restart count 2 Aug 18 12:08:09.003: INFO: node-feature-discovery-worker-hzpf5 started at 2021-08-18 08:29:40 +0000 UTC (0+1 container statuses recorded) Aug 18 12:08:09.003: INFO: Container nfd-worker ready: true, restart count 0 Aug 18 12:08:09.003: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-c82pt started at 2021-08-18 08:30:25 +0000 UTC (0+1 container statuses recorded) Aug 18 12:08:09.003: INFO: Container kube-sriovdp ready: true, restart count 0 Aug 18 12:08:09.003: INFO: prometheus-operator-5bb8cb9d8f-k97ws started at 2021-08-18 08:33:38 +0000 UTC (0+2 container statuses recorded) Aug 18 12:08:09.003: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 12:08:09.003: INFO: Container prometheus-operator ready: true, restart count 0 Aug 18 12:08:09.003: INFO: kube-multus-ds-amd64-rvzsg started at 2021-08-18 08:23:34 +0000 UTC (0+1 container statuses recorded) Aug 18 12:08:09.003: INFO: Container kube-multus ready: true, restart count 1 Aug 18 12:08:09.003: INFO: collectd-67ntq started at 2021-08-18 08:38:42 +0000 UTC (0+3 container statuses recorded) Aug 18 12:08:09.003: INFO: Container collectd ready: true, restart count 0 Aug 18 12:08:09.003: INFO: Container collectd-exporter ready: true, restart count 0 Aug 18 12:08:09.003: INFO: Container rbac-proxy ready: true, restart count 0 Aug 18 12:08:09.003: INFO: cmk-webhook-6c9d5f8578-7cxjr started at 2021-08-18 08:32:53 +0000 UTC (0+1 container statuses recorded) Aug 18 12:08:09.003: INFO: Container cmk-webhook ready: true, restart count 0 Aug 18 12:08:09.003: INFO: kube-flannel-h7t5h started at 2021-08-18 08:23:27 +0000 UTC (1+1 container statuses recorded) Aug 18 12:08:09.003: INFO: Init container install-cni ready: true, restart count 2 Aug 18 12:08:09.003: INFO: Container kube-flannel ready: true, restart count 1 Aug 18 12:08:09.003: INFO: node-exporter-lrrf2 started at 2021-08-18 08:33:45 +0000 UTC (0+2 container statuses recorded) Aug 18 12:08:09.003: INFO: Container kube-rbac-proxy ready: true, restart count 0 Aug 18 12:08:09.003: INFO: Container node-exporter ready: true, restart count 0 Aug 18 12:08:09.003: INFO: foo-mcmfh started at 2021-08-18 11:53:08 +0000 UTC (0+1 container statuses recorded) Aug 18 12:08:09.003: INFO: Container c ready: false, restart count 0 W0818 12:08:09.016672 27 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Aug 18 12:08:09.056: INFO: Latency metrics for node node2 Aug 18 12:08:09.056: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "job-7669" for this suite. • Failure [900.367 seconds] [sig-apps] Job /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/framework.go:23 should delete a job [Conformance] [It] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 Aug 18 12:08:08.734: failed to ensure active pods == parallelism in namespace: job-7669 Unexpected error: <*errors.errorString | 0xc0003001f0>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/job.go:163 ------------------------------ {"msg":"FAILED [sig-apps] Job should delete a job [Conformance]","total":-1,"completed":23,"skipped":474,"failed":5,"failures":["[sig-node] Downward API should provide host IP as an env var [NodeConformance] [Conformance]","[k8s.io] Kubelet when scheduling a busybox Pod with hostAliases should write entries to /etc/hosts [LinuxOnly] [NodeConformance] [Conformance]","[sig-api-machinery] Secrets should be consumable via the environment [NodeConformance] [Conformance]","[k8s.io] Variable Expansion should allow substituting values in a container's command [NodeConformance] [Conformance]","[sig-apps] Job should delete a job [Conformance]"]} Aug 18 12:08:09.071: INFO: Running AfterSuite actions on all nodes {"msg":"PASSED [sig-api-machinery] Garbage collector should orphan RS created by deployment when deleteOptions.PropagationPolicy is Orphan [Conformance]","total":-1,"completed":13,"skipped":335,"failed":6,"failures":["[sig-apps] StatefulSet [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] Should recreate evicted statefulset [Conformance]","[sig-node] Downward API should provide pod UID as env vars [NodeConformance] [Conformance]","[sig-apps] ReplicationController should adopt matching pods on creation [Conformance]","[sig-apps] ReplicaSet should adopt matching pods on creation and release no longer matching pods [Conformance]","[k8s.io] InitContainer [NodeConformance] should not start app containers and fail the pod if init containers fail on a RestartNever pod [Conformance]","[sig-apps] StatefulSet [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] Burst scaling should run to completion even with unhealthy pods [Slow] [Conformance]"]} Aug 18 11:58:48.379: INFO: Running AfterSuite actions on all nodes Aug 18 12:08:09.139: INFO: Running AfterSuite actions on node 1 Aug 18 12:08:09.139: INFO: Skipping dumping logs from cluster Summarizing 52 Failures: [Fail] [sig-apps] StatefulSet [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] [It] Should recreate evicted statefulset [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/statefulset.go:809 [Fail] [sig-network] Services [It] should be able to create a functioning NodePort service [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:1242 [Fail] [sig-apps] Deployment [It] deployment should support rollover [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/deployment.go:438 [Fail] [sig-node] Downward API [It] should provide host IP as an env var [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 [Fail] [k8s.io] Pods [It] should be submitted and removed [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/pods.go:296 [Fail] [k8s.io] Variable Expansion [It] should allow substituting values in a volume subpath [sig-storage] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 [Fail] [k8s.io] InitContainer [NodeConformance] [It] should invoke init containers on a RestartAlways pod [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/init_container.go:302 [Fail] [k8s.io] Variable Expansion [It] should verify that a failing subpath expansion can be modified during the lifecycle of a container [sig-storage][Slow] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/expansion.go:270 [Fail] [sig-network] Services [It] should be able to switch session affinity for NodePort service [LinuxOnly] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:3511 [Fail] [sig-apps] Deployment [It] RollingUpdateDeployment should delete old pods and create new ones [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/deployment.go:289 [Fail] [sig-node] Downward API [It] should provide pod UID as env vars [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 [Fail] [k8s.io] Pods [It] should support retrieving logs from the container over websockets [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:103 [Fail] [sig-apps] StatefulSet [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] [It] should perform rolling updates and roll backs of template modifications [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/statefulset/wait.go:74 [Fail] [sig-apps] Deployment [It] deployment should delete old replica sets [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/deployment.go:367 [Fail] [k8s.io] Pods [It] should allow activeDeadlineSeconds to be updated [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:103 [Fail] [k8s.io] Kubelet when scheduling a busybox Pod with hostAliases [It] should write entries to /etc/hosts [LinuxOnly] [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:103 [Fail] [sig-storage] ConfigMap [It] binary data should be reflected in volume [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:103 [Fail] [k8s.io] Variable Expansion [It] should succeed in writing subpaths in container [sig-storage][Slow] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/expansion.go:331 [Fail] [sig-apps] ReplicationController [It] should adopt matching pods on creation [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:103 [Fail] [k8s.io] InitContainer [NodeConformance] [It] should not start app containers if init containers fail on a RestartAlways pod [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/init_container.go:432 [Fail] [sig-apps] StatefulSet [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] [It] should perform canary updates and phased rolling updates of template modifications [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/statefulset/wait.go:58 [Fail] [k8s.io] Probing container [It] should be restarted with a exec "cat /tmp/health" liveness probe [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:426 [Fail] [k8s.io] Variable Expansion [It] should allow substituting values in a container's args [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 [Fail] [sig-node] Downward API [It] should provide container's limits.cpu/memory and requests.cpu/memory as env vars [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 [Fail] [k8s.io] Kubelet when scheduling a busybox command in a pod [It] should print the output to logs [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:103 [Fail] [k8s.io] Security Context When creating a pod with privileged [It] should run the container as unprivileged when false [LinuxOnly] [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:212 [Fail] [sig-apps] ReplicaSet [It] should adopt matching pods on creation and release no longer matching pods [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:103 [Fail] [k8s.io] InitContainer [NodeConformance] [It] should not start app containers and fail the pod if init containers fail on a RestartNever pod [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/init_container.go:547 [Fail] [sig-api-machinery] Secrets [It] should be consumable via the environment [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 [Fail] [k8s.io] Container Runtime blackbox test on terminated container [It] should report termination message [LinuxOnly] from log output if TerminationMessagePolicy FallbackToLogsOnError is set [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/runtime.go:154 [Fail] [k8s.io] Container Runtime blackbox test on terminated container [It] should report termination message [LinuxOnly] if TerminationMessagePath is set as non-root user and at a non-default path [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/runtime.go:154 [Fail] [sig-apps] Job [It] should run a job to completion when tasks sometimes fail and are locally restarted [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/job.go:113 [Fail] [k8s.io] [sig-node] PreStop [It] should call prestop when killing a pod [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/pre_stop.go:107 [Fail] [k8s.io] Pods [It] should support remote command execution over websockets [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:103 [Fail] [sig-node] ConfigMap [It] should be consumable via environment variable [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 [Fail] [sig-network] Services [It] should have session affinity timeout work for NodePort service [LinuxOnly] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:3444 [Fail] [sig-api-machinery] Secrets [It] should be consumable from pods in env vars [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 [Fail] [sig-network] Services [It] should have session affinity work for NodePort service [LinuxOnly] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:3511 [Fail] [k8s.io] Variable Expansion [It] should allow substituting values in a container's command [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 [Fail] [k8s.io] Kubelet when scheduling a busybox command that always fails in a pod [It] should have an terminated reason [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/kubelet.go:124 [Fail] [k8s.io] Container Runtime blackbox test when starting a container that exits [It] should run with the expected status [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/runtime.go:111 [Fail] [k8s.io] Container Runtime blackbox test on terminated container [It] should report termination message [LinuxOnly] from file when pod succeeds and TerminationMessagePolicy FallbackToLogsOnError is set [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/runtime.go:154 [Fail] [sig-apps] StatefulSet [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] [It] should have a working scale subresource [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/statefulset/wait.go:58 [Fail] [sig-node] ConfigMap [It] should be consumable via the environment [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 [Fail] [sig-apps] StatefulSet [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] [It] Burst scaling should run to completion even with unhealthy pods [Slow] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/statefulset/wait.go:58 [Fail] [k8s.io] Probing container [It] should *not* be restarted with a exec "cat /tmp/health" liveness probe [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:426 [Fail] [k8s.io] Pods [It] should be updated [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:103 [Fail] [sig-network] Services [It] should be able to change the type from ExternalName to NodePort [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:1760 [Fail] [sig-node] Downward API [It] should provide pod name, namespace and IP address as env vars [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 [Fail] [sig-apps] Deployment [It] deployment should support proportional scaling [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/deployment.go:736 [Fail] [k8s.io] Pods [It] should contain environment variables for services [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/pods.go:527 [Fail] [sig-apps] Job [It] should delete a job [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/job.go:163 Ran 286 of 5484 Specs in 2575.276 seconds FAIL! -- 234 Passed | 52 Failed | 0 Pending | 5198 Skipped Ginkgo ran 1 suite in 42m56.7681306s Test Suite Failed