/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 May 14 21:19:14.803: pod container-probe-323/busybox-3b0413d7-ae77-4c64-97ab-ca15dd7339ab - expected number of restarts: 1, found restarts: 0 /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:465 [BeforeEach] [k8s.io] Probing container /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client May 14 21:15:04.344: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename container-probe May 14 21:15:04.368: INFO: Found PodSecurityPolicies; testing pod creation to see if PodSecurityPolicy is enabled May 14 21:15:04.370: INFO: Error creating dryrun pod; assuming PodSecurityPolicy is disabled: admission webhook "cmk.intel.com" does not support dry run STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [k8s.io] Probing container /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:54 [It] should be restarted with a exec "cat /tmp/health" liveness probe [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating pod busybox-3b0413d7-ae77-4c64-97ab-ca15dd7339ab in namespace container-probe-323 May 14 21:15:14.391: INFO: Started pod busybox-3b0413d7-ae77-4c64-97ab-ca15dd7339ab in namespace container-probe-323 STEP: checking the pod's current state and verifying that restartCount is present May 14 21:15:14.394: INFO: Initial restart count of pod busybox-3b0413d7-ae77-4c64-97ab-ca15dd7339ab is 0 May 14 21:19:14.803: FAIL: pod container-probe-323/busybox-3b0413d7-ae77-4c64-97ab-ca15dd7339ab - expected number of restarts: 1, found restarts: 0 Full Stack Trace k8s.io/kubernetes/test/e2e/common.RunLivenessTest(0xc0001b3080, 0xc000801400, 0x1, 0x37e11d6000) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:465 +0xf45 k8s.io/kubernetes/test/e2e/common.glob..func3.4() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:130 +0x197 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc003896a80) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc003896a80) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc003896a80, 0x4de37a0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 STEP: deleting the pod [AfterEach] [k8s.io] Probing container /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "container-probe-323". STEP: Found 13 events. May 14 21:19:14.816: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for busybox-3b0413d7-ae77-4c64-97ab-ca15dd7339ab: { } Scheduled: Successfully assigned container-probe-323/busybox-3b0413d7-ae77-4c64-97ab-ca15dd7339ab to node1 May 14 21:19:14.816: INFO: At 2021-05-14 21:15:07 +0000 UTC - event for busybox-3b0413d7-ae77-4c64-97ab-ca15dd7339ab: {multus } AddedInterface: Add eth0 [10.244.3.41/24] May 14 21:19:14.816: INFO: At 2021-05-14 21:15:07 +0000 UTC - event for busybox-3b0413d7-ae77-4c64-97ab-ca15dd7339ab: {kubelet node1} Pulling: Pulling image "docker.io/library/busybox:1.29" May 14 21:19:14.816: INFO: At 2021-05-14 21:15:13 +0000 UTC - event for busybox-3b0413d7-ae77-4c64-97ab-ca15dd7339ab: {kubelet node1} Pulled: Successfully pulled image "docker.io/library/busybox:1.29" in 6.097483017s May 14 21:19:14.816: INFO: At 2021-05-14 21:15:13 +0000 UTC - event for busybox-3b0413d7-ae77-4c64-97ab-ca15dd7339ab: {kubelet node1} Created: Created container busybox May 14 21:19:14.816: INFO: At 2021-05-14 21:15:13 +0000 UTC - event for busybox-3b0413d7-ae77-4c64-97ab-ca15dd7339ab: {kubelet node1} Started: Started container busybox May 14 21:19:14.816: INFO: At 2021-05-14 21:15:33 +0000 UTC - event for busybox-3b0413d7-ae77-4c64-97ab-ca15dd7339ab: {kubelet node1} Killing: Container busybox failed liveness probe, will be restarted May 14 21:19:14.816: INFO: At 2021-05-14 21:15:33 +0000 UTC - event for busybox-3b0413d7-ae77-4c64-97ab-ca15dd7339ab: {kubelet node1} Unhealthy: Liveness probe failed: cat: can't open '/tmp/health': No such file or directory May 14 21:19:14.816: INFO: At 2021-05-14 21:16:04 +0000 UTC - event for busybox-3b0413d7-ae77-4c64-97ab-ca15dd7339ab: {kubelet node1} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit May 14 21:19:14.816: INFO: At 2021-05-14 21:16:04 +0000 UTC - event for busybox-3b0413d7-ae77-4c64-97ab-ca15dd7339ab: {kubelet node1} Failed: Error: ErrImagePull May 14 21:19:14.816: INFO: At 2021-05-14 21:16:05 +0000 UTC - event for busybox-3b0413d7-ae77-4c64-97ab-ca15dd7339ab: {kubelet node1} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" May 14 21:19:14.816: INFO: At 2021-05-14 21:16:05 +0000 UTC - event for busybox-3b0413d7-ae77-4c64-97ab-ca15dd7339ab: {kubelet node1} Failed: Error: ImagePullBackOff May 14 21:19:14.816: INFO: At 2021-05-14 21:16:58 +0000 UTC - event for busybox-3b0413d7-ae77-4c64-97ab-ca15dd7339ab: {kubelet node1} BackOff: Back-off restarting failed container May 14 21:19:14.818: INFO: POD NODE PHASE GRACE CONDITIONS May 14 21:19:14.818: INFO: May 14 21:19:14.822: INFO: Logging node info for node master1 May 14 21:19:14.824: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 8e20012e-a811-456d-9add-2ea316e23700 24283 0 2021-05-14 19:56:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"a6:a3:7b:a0:c9:75"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-14 19:56:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-14 19:56:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-14 19:59:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-05-14 20:06:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234763776 0} {<nil>} 196518324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324599808 0} {<nil>} 195629492Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:02:00 +0000 UTC,LastTransitionTime:2021-05-14 20:02:00 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-14 21:19:04 +0000 UTC,LastTransitionTime:2021-05-14 19:56:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-14 21:19:04 +0000 UTC,LastTransitionTime:2021-05-14 19:56:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-14 21:19:04 +0000 UTC,LastTransitionTime:2021-05-14 19:56:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-14 21:19:04 +0000 UTC,LastTransitionTime:2021-05-14 19:59:09 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a88b162033bc4931ba0342c7f78a28b9,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:ba5ed4e5-a8ef-4986-946f-e7e2d91395d2,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:e3157cfba16d361ffec06306dd0154c7dca1931cbc4569e3c5822e30e311948b tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:a43c7fdd150533238a300ad84ac906e551111f9b57273afcb8781ee675fd23b3 tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 14 21:19:14.825: INFO: Logging kubelet events for node master1 May 14 21:19:14.827: INFO: Logging pods the kubelet thinks is on node master1 May 14 21:19:14.856: INFO: kube-flannel-cx7s6 started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 14 21:19:14.856: INFO: Init container install-cni ready: true, restart count 0 May 14 21:19:14.856: INFO: Container kube-flannel ready: true, restart count 1 May 14 21:19:14.856: INFO: node-exporter-nvrxr started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 14 21:19:14.856: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 14 21:19:14.856: INFO: Container node-exporter ready: true, restart count 0 May 14 21:19:14.856: INFO: kube-scheduler-master1 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 14 21:19:14.856: INFO: Container kube-scheduler ready: true, restart count 0 May 14 21:19:14.856: INFO: kube-controller-manager-master1 started at 2021-05-14 20:01:22 +0000 UTC (0+1 container statuses recorded) May 14 21:19:14.856: INFO: Container kube-controller-manager ready: true, restart count 2 May 14 21:19:14.856: INFO: kube-proxy-v2c76 started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 14 21:19:14.856: INFO: Container kube-proxy ready: true, restart count 2 May 14 21:19:14.856: INFO: kube-multus-ds-amd64-m54v2 started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 14 21:19:14.856: INFO: Container kube-multus ready: true, restart count 1 May 14 21:19:14.856: INFO: coredns-7677f9bb54-mlcmv started at 2021-05-14 19:59:27 +0000 UTC (0+1 container statuses recorded) May 14 21:19:14.856: INFO: Container coredns ready: true, restart count 1 May 14 21:19:14.856: INFO: docker-registry-docker-registry-56cbc7bc58-bjc5h started at 2021-05-14 20:02:43 +0000 UTC (0+2 container statuses recorded) May 14 21:19:14.856: INFO: Container docker-registry ready: true, restart count 0 May 14 21:19:14.856: INFO: Container nginx ready: true, restart count 0 May 14 21:19:14.856: INFO: node-feature-discovery-controller-5bf5c49849-27v77 started at 2021-05-14 20:05:52 +0000 UTC (0+1 container statuses recorded) May 14 21:19:14.856: INFO: Container nfd-controller ready: true, restart count 0 May 14 21:19:14.856: INFO: kube-apiserver-master1 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 14 21:19:14.856: INFO: Container kube-apiserver ready: true, restart count 0 W0514 21:19:14.869427 35 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 14 21:19:14.894: INFO: Latency metrics for node master1 May 14 21:19:14.894: INFO: Logging node info for node master2 May 14 21:19:14.897: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 e8f1881f-5ded-4c6c-b7e6-eb354b7962e2 24284 0 2021-05-14 19:57:04 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"0a:97:9a:eb:9d:a8"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-14 19:57:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-14 19:57:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-14 19:59:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-14 19:59:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234763776 0} {<nil>} 196518324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324599808 0} {<nil>} 195629492Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:02:07 +0000 UTC,LastTransitionTime:2021-05-14 20:02:07 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-14 21:19:04 +0000 UTC,LastTransitionTime:2021-05-14 19:57:04 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-14 21:19:04 +0000 UTC,LastTransitionTime:2021-05-14 19:57:04 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-14 21:19:04 +0000 UTC,LastTransitionTime:2021-05-14 19:57:04 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-14 21:19:04 +0000 UTC,LastTransitionTime:2021-05-14 19:59:09 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:14c4cdd0613041bb923c5f9b84e0bcde,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:9bdca68c-a5fc-48f7-b392-63d2c04d224d,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 14 21:19:14.897: INFO: Logging kubelet events for node master2 May 14 21:19:14.899: INFO: Logging pods the kubelet thinks is on node master2 May 14 21:19:14.915: INFO: kube-flannel-fc4sf started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 14 21:19:14.915: INFO: Init container install-cni ready: true, restart count 0 May 14 21:19:14.915: INFO: Container kube-flannel ready: true, restart count 1 May 14 21:19:14.915: INFO: kube-multus-ds-amd64-bt5kr started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 14 21:19:14.915: INFO: Container kube-multus ready: true, restart count 1 May 14 21:19:14.915: INFO: dns-autoscaler-5b7b5c9b6f-fgzqp started at 2021-05-14 19:59:30 +0000 UTC (0+1 container statuses recorded) May 14 21:19:14.915: INFO: Container autoscaler ready: true, restart count 2 May 14 21:19:14.915: INFO: node-exporter-gjrtc started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 14 21:19:14.915: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 14 21:19:14.915: INFO: Container node-exporter ready: true, restart count 0 May 14 21:19:14.915: INFO: kube-apiserver-master2 started at 2021-05-14 20:05:10 +0000 UTC (0+1 container statuses recorded) May 14 21:19:14.915: INFO: Container kube-apiserver ready: true, restart count 0 May 14 21:19:14.915: INFO: kube-controller-manager-master2 started at 2021-05-14 20:01:22 +0000 UTC (0+1 container statuses recorded) May 14 21:19:14.915: INFO: Container kube-controller-manager ready: true, restart count 2 May 14 21:19:14.915: INFO: kube-scheduler-master2 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 14 21:19:14.915: INFO: Container kube-scheduler ready: true, restart count 2 May 14 21:19:14.915: INFO: kube-proxy-qcgpm started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 14 21:19:14.915: INFO: Container kube-proxy ready: true, restart count 2 W0514 21:19:14.928777 35 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 14 21:19:14.957: INFO: Latency metrics for node master2 May 14 21:19:14.957: INFO: Logging node info for node master3 May 14 21:19:14.959: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 29fd0a5d-1350-4e28-a4cb-b26dd82cd397 24389 0 2021-05-14 19:57:14 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:27:37:b7:ad:a5"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-14 19:57:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-14 19:57:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-14 19:59:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234767872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324603904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:01:03 +0000 UTC,LastTransitionTime:2021-05-14 20:01:03 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-14 21:19:11 +0000 UTC,LastTransitionTime:2021-05-14 19:57:14 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-14 21:19:11 +0000 UTC,LastTransitionTime:2021-05-14 19:57:14 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-14 21:19:11 +0000 UTC,LastTransitionTime:2021-05-14 19:57:14 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-14 21:19:11 +0000 UTC,LastTransitionTime:2021-05-14 20:00:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f3fe601830d34e59967ed389af552f25,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:56dd60e2-98fe-4d87-81d9-95db820e7426,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 14 21:19:14.959: INFO: Logging kubelet events for node master3 May 14 21:19:14.961: INFO: Logging pods the kubelet thinks is on node master3 May 14 21:19:14.977: INFO: kube-scheduler-master3 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 14 21:19:14.977: INFO: Container kube-scheduler ready: true, restart count 3 May 14 21:19:14.977: INFO: kube-apiserver-master3 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 14 21:19:14.977: INFO: Container kube-apiserver ready: true, restart count 0 May 14 21:19:14.977: INFO: kube-proxy-2crs2 started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 14 21:19:14.977: INFO: Container kube-proxy ready: true, restart count 1 May 14 21:19:14.977: INFO: kube-flannel-cl8jf started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 14 21:19:14.977: INFO: Init container install-cni ready: true, restart count 0 May 14 21:19:14.977: INFO: Container kube-flannel ready: true, restart count 2 May 14 21:19:14.977: INFO: kube-multus-ds-amd64-hp6bp started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 14 21:19:14.977: INFO: Container kube-multus ready: true, restart count 1 May 14 21:19:14.977: INFO: coredns-7677f9bb54-qhzrv started at 2021-05-14 19:59:32 +0000 UTC (0+1 container statuses recorded) May 14 21:19:14.977: INFO: Container coredns ready: true, restart count 2 May 14 21:19:14.977: INFO: node-exporter-4cgbq started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 14 21:19:14.977: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 14 21:19:14.977: INFO: Container node-exporter ready: true, restart count 0 May 14 21:19:14.977: INFO: kube-controller-manager-master3 started at 2021-05-14 20:00:41 +0000 UTC (0+1 container statuses recorded) May 14 21:19:14.977: INFO: Container kube-controller-manager ready: true, restart count 3 W0514 21:19:14.990947 35 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 14 21:19:15.016: INFO: Latency metrics for node master3 May 14 21:19:15.016: INFO: Logging node info for node node1 May 14 21:19:15.020: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 5e4c0fba-b5fa-4177-b834-f3e04c846ff3 24384 0 2021-05-14 19:58:21 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ba:ee:c6:a6:52:03"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-14 19:58:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-05-14 19:58:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-14 20:06:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-14 20:08:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-14 20:08:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269633024 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884632576 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:00:44 +0000 UTC,LastTransitionTime:2021-05-14 20:00:44 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-14 21:19:11 +0000 UTC,LastTransitionTime:2021-05-14 19:58:21 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-14 21:19:11 +0000 UTC,LastTransitionTime:2021-05-14 19:58:21 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-14 21:19:11 +0000 UTC,LastTransitionTime:2021-05-14 19:58:21 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-14 21:19:11 +0000 UTC,LastTransitionTime:2021-05-14 20:00:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:4b96d01fdbcb4fadb4a59fca2e1bf368,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:93c238b3-1895-423c-a1aa-193fbcf8b55f,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:869f7b3516c269b43448f1227c57d536e8a4cf723eeef3b5f8b8e224ecbcfd8e localhost:30500/barometer-collectd:stable],SizeBytes:1464261626,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:1002487751,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:ed5c574f653e2a39e784ff322033a2319aafde7366c803a88f20f7a2a8bc1efb opnfv/barometer-collectd:stable],SizeBytes:825413035,},ContainerImage{Names:[localhost:30500/cmk@sha256:f759b012c29126f880575ac543d09301d45f0b2b9d0f5329849ea40e65017dde cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[golang@sha256:1636899c10870ab66c48d960a9df620f4f9e86a0c72fbacf36032d27404e7e6c golang:alpine3.12],SizeBytes:301156062,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:948a93bc3803d61dd66ab49f99d4cc657e87273682aec7dd5955a000fd17a7e5 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392645,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:36553b10a4947067b9fbb7d532951066293a68eae893beba1d9235f7d11a20ad alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 14 21:19:15.021: INFO: Logging kubelet events for node node1 May 14 21:19:15.024: INFO: Logging pods the kubelet thinks is on node node1 May 14 21:19:15.108: INFO: webserver-deployment-dd94f59b7-t2bth started at 2021-05-14 21:15:51 +0000 UTC (0+1 container statuses recorded) May 14 21:19:15.108: INFO: Container httpd ready: true, restart count 0 May 14 21:19:15.108: INFO: kubernetes-metrics-scraper-678c97765c-pqnd6 started at 2021-05-14 19:59:31 +0000 UTC (0+1 container statuses recorded) May 14 21:19:15.108: INFO: Container kubernetes-metrics-scraper ready: true, restart count 1 May 14 21:19:15.108: INFO: node-feature-discovery-worker-nvg9t started at 2021-05-14 20:05:42 +0000 UTC (0+1 container statuses recorded) May 14 21:19:15.108: INFO: Container nfd-worker ready: true, restart count 0 May 14 21:19:15.108: INFO: cmk-9nqjc started at 2021-05-14 20:09:03 +0000 UTC (0+2 container statuses recorded) May 14 21:19:15.108: INFO: Container nodereport ready: true, restart count 0 May 14 21:19:15.108: INFO: Container reconcile ready: true, restart count 0 May 14 21:19:15.108: INFO: node-exporter-r62rn started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 14 21:19:15.108: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 14 21:19:15.108: INFO: Container node-exporter ready: true, restart count 0 May 14 21:19:15.108: INFO: prometheus-k8s-0 started at 2021-05-14 20:09:58 +0000 UTC (0+5 container statuses recorded) May 14 21:19:15.108: INFO: Container custom-metrics-apiserver ready: true, restart count 0 May 14 21:19:15.108: INFO: Container grafana ready: true, restart count 0 May 14 21:19:15.108: INFO: Container prometheus ready: true, restart count 1 May 14 21:19:15.108: INFO: Container prometheus-config-reloader ready: true, restart count 0 May 14 21:19:15.108: INFO: Container rules-configmap-reloader ready: true, restart count 0 May 14 21:19:15.108: INFO: kube-flannel-hj8sj started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 14 21:19:15.108: INFO: Init container install-cni ready: true, restart count 0 May 14 21:19:15.108: INFO: Container kube-flannel ready: true, restart count 1 May 14 21:19:15.108: INFO: prometheus-operator-5bb8cb9d8f-4lq8j started at 2021-05-14 20:09:49 +0000 UTC (0+2 container statuses recorded) May 14 21:19:15.108: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 14 21:19:15.108: INFO: Container prometheus-operator ready: true, restart count 0 May 14 21:19:15.108: INFO: webserver-deployment-dd94f59b7-x44rs started at 2021-05-14 21:15:51 +0000 UTC (0+1 container statuses recorded) May 14 21:19:15.108: INFO: Container httpd ready: true, restart count 0 May 14 21:19:15.108: INFO: webserver-deployment-dd94f59b7-sj7bw started at 2021-05-14 21:15:51 +0000 UTC (0+1 container statuses recorded) May 14 21:19:15.108: INFO: Container httpd ready: true, restart count 0 May 14 21:19:15.108: INFO: server started at 2021-05-14 21:19:02 +0000 UTC (0+1 container statuses recorded) May 14 21:19:15.108: INFO: Container agnhost-container ready: true, restart count 0 May 14 21:19:15.108: INFO: kube-proxy-l7697 started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 14 21:19:15.108: INFO: Container kube-proxy ready: true, restart count 2 May 14 21:19:15.108: INFO: kube-multus-ds-amd64-jhf4c started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 14 21:19:15.108: INFO: Container kube-multus ready: true, restart count 1 May 14 21:19:15.108: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-bw262 started at 2021-05-14 20:06:38 +0000 UTC (0+1 container statuses recorded) May 14 21:19:15.108: INFO: Container kube-sriovdp ready: true, restart count 0 May 14 21:19:15.108: INFO: collectd-qhp77 started at 2021-05-14 20:15:36 +0000 UTC (0+3 container statuses recorded) May 14 21:19:15.108: INFO: Container collectd ready: true, restart count 0 May 14 21:19:15.108: INFO: Container collectd-exporter ready: true, restart count 0 May 14 21:19:15.108: INFO: Container rbac-proxy ready: true, restart count 0 May 14 21:19:15.108: INFO: downward-api-118931da-069c-419f-b847-6151f1901a26 started at 2021-05-14 21:15:53 +0000 UTC (0+1 container statuses recorded) May 14 21:19:15.108: INFO: Container dapi-container ready: false, restart count 0 May 14 21:19:15.108: INFO: nginx-proxy-node1 started at 2021-05-14 20:05:10 +0000 UTC (0+1 container statuses recorded) May 14 21:19:15.108: INFO: Container nginx-proxy ready: true, restart count 2 May 14 21:19:15.108: INFO: cmk-init-discover-node1-g6c6q started at 2021-05-14 20:08:21 +0000 UTC (0+3 container statuses recorded) May 14 21:19:15.108: INFO: Container discover ready: false, restart count 0 May 14 21:19:15.108: INFO: Container init ready: false, restart count 0 May 14 21:19:15.108: INFO: Container install ready: false, restart count 0 May 14 21:19:15.108: INFO: webserver-deployment-dd94f59b7-hlmh8 started at 2021-05-14 21:15:51 +0000 UTC (0+1 container statuses recorded) May 14 21:19:15.108: INFO: Container httpd ready: true, restart count 0 May 14 21:19:15.108: INFO: webserver-deployment-dd94f59b7-2lh2f started at 2021-05-14 21:15:51 +0000 UTC (0+1 container statuses recorded) May 14 21:19:15.108: INFO: Container httpd ready: true, restart count 0 W0514 21:19:15.120714 35 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 14 21:19:15.150: INFO: Latency metrics for node node1 May 14 21:19:15.150: INFO: Logging node info for node node2 May 14 21:19:15.153: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 0bae98dc-2ebc-4849-b99e-7780a3bea71e 24370 0 2021-05-14 19:58:22 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"c6:18:ed:95:bb:1a"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-14 19:58:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-05-14 19:58:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-14 20:06:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-14 20:08:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-14 20:08:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269633024 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884632576 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:01:27 +0000 UTC,LastTransitionTime:2021-05-14 20:01:27 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-14 21:19:10 +0000 UTC,LastTransitionTime:2021-05-14 19:58:22 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-14 21:19:10 +0000 UTC,LastTransitionTime:2021-05-14 19:58:22 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-14 21:19:10 +0000 UTC,LastTransitionTime:2021-05-14 19:58:22 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-14 21:19:10 +0000 UTC,LastTransitionTime:2021-05-14 19:59:04 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a3f22fbf9e534ba1819f7a549414a8a6,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:166b6e45-ba8b-4b89-80b0-befc9a0152b8,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:869f7b3516c269b43448f1227c57d536e8a4cf723eeef3b5f8b8e224ecbcfd8e localhost:30500/barometer-collectd:stable],SizeBytes:1464261626,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[localhost:30500/cmk@sha256:f759b012c29126f880575ac543d09301d45f0b2b9d0f5329849ea40e65017dde localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:948a93bc3803d61dd66ab49f99d4cc657e87273682aec7dd5955a000fd17a7e5 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392645,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:e3157cfba16d361ffec06306dd0154c7dca1931cbc4569e3c5822e30e311948b localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:a43c7fdd150533238a300ad84ac906e551111f9b57273afcb8781ee675fd23b3 localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 14 21:19:15.154: INFO: Logging kubelet events for node node2 May 14 21:19:15.156: INFO: Logging pods the kubelet thinks is on node node2 May 14 21:19:15.171: INFO: nginx-proxy-node2 started at 2021-05-14 20:05:10 +0000 UTC (0+1 container statuses recorded) May 14 21:19:15.171: INFO: Container nginx-proxy ready: true, restart count 2 May 14 21:19:15.171: INFO: node-feature-discovery-worker-76m6b started at 2021-05-14 20:05:42 +0000 UTC (0+1 container statuses recorded) May 14 21:19:15.171: INFO: Container nfd-worker ready: true, restart count 0 May 14 21:19:15.171: INFO: cmk-d2qwf started at 2021-05-14 20:09:04 +0000 UTC (0+2 container statuses recorded) May 14 21:19:15.171: INFO: Container nodereport ready: true, restart count 0 May 14 21:19:15.171: INFO: Container reconcile ready: true, restart count 0 May 14 21:19:15.171: INFO: kube-flannel-rqcwp started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 14 21:19:15.171: INFO: Init container install-cni ready: true, restart count 1 May 14 21:19:15.171: INFO: Container kube-flannel ready: true, restart count 4 May 14 21:19:15.171: INFO: cmk-webhook-6c9d5f8578-pjgxh started at 2021-05-14 20:09:04 +0000 UTC (0+1 container statuses recorded) May 14 21:19:15.171: INFO: Container cmk-webhook ready: true, restart count 0 May 14 21:19:15.171: INFO: node-exporter-rnd5f started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 14 21:19:15.171: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 14 21:19:15.171: INFO: Container node-exporter ready: true, restart count 0 May 14 21:19:15.171: INFO: webserver-deployment-dd94f59b7-cxrgx started at 2021-05-14 21:15:51 +0000 UTC (0+1 container statuses recorded) May 14 21:19:15.171: INFO: Container httpd ready: false, restart count 0 May 14 21:19:15.171: INFO: webserver-deployment-dd94f59b7-l7sq5 started at 2021-05-14 21:15:51 +0000 UTC (0+1 container statuses recorded) May 14 21:19:15.171: INFO: Container httpd ready: true, restart count 0 May 14 21:19:15.171: INFO: ss2-0 started at 2021-05-14 21:16:52 +0000 UTC (0+1 container statuses recorded) May 14 21:19:15.171: INFO: Container webserver ready: false, restart count 0 May 14 21:19:15.171: INFO: cmk-init-discover-node2-j75ff started at 2021-05-14 20:08:41 +0000 UTC (0+3 container statuses recorded) May 14 21:19:15.171: INFO: Container discover ready: false, restart count 0 May 14 21:19:15.171: INFO: Container init ready: false, restart count 0 May 14 21:19:15.171: INFO: Container install ready: false, restart count 0 May 14 21:19:15.171: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-l5hlq started at 2021-05-14 20:12:48 +0000 UTC (0+2 container statuses recorded) May 14 21:19:15.171: INFO: Container tas-controller ready: true, restart count 0 May 14 21:19:15.171: INFO: Container tas-extender ready: true, restart count 0 May 14 21:19:15.171: INFO: collectd-xzrgs started at 2021-05-14 20:15:36 +0000 UTC (0+3 container statuses recorded) May 14 21:19:15.171: INFO: Container collectd ready: true, restart count 0 May 14 21:19:15.171: INFO: Container collectd-exporter ready: true, restart count 0 May 14 21:19:15.171: INFO: Container rbac-proxy ready: true, restart count 0 May 14 21:19:15.171: INFO: termination-message-containere6005221-b7c3-46a0-8e25-68b7e59305ac started at 2021-05-14 21:19:05 +0000 UTC (0+1 container statuses recorded) May 14 21:19:15.171: INFO: Container termination-message-container ready: false, restart count 0 May 14 21:19:15.171: INFO: webserver-deployment-dd94f59b7-wrbmm started at 2021-05-14 21:15:51 +0000 UTC (0+1 container statuses recorded) May 14 21:19:15.171: INFO: Container httpd ready: true, restart count 0 May 14 21:19:15.171: INFO: webserver-deployment-dd94f59b7-bgk6n started at 2021-05-14 21:15:51 +0000 UTC (0+1 container statuses recorded) May 14 21:19:15.171: INFO: Container httpd ready: false, restart count 0 May 14 21:19:15.171: INFO: tester started at 2021-05-14 21:19:06 +0000 UTC (0+1 container statuses recorded) May 14 21:19:15.171: INFO: Container tester ready: false, restart count 0 May 14 21:19:15.171: INFO: dns-test-1d26f5a3-8092-4976-bf0a-366d846513a1 started at 2021-05-14 21:19:12 +0000 UTC (0+3 container statuses recorded) May 14 21:19:15.171: INFO: Container jessie-querier ready: false, restart count 0 May 14 21:19:15.171: INFO: Container querier ready: false, restart count 0 May 14 21:19:15.171: INFO: Container webserver ready: false, restart count 0 May 14 21:19:15.171: INFO: kube-proxy-t524z started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 14 21:19:15.171: INFO: Container kube-proxy ready: true, restart count 2 May 14 21:19:15.171: INFO: kube-multus-ds-amd64-n7cb2 started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 14 21:19:15.171: INFO: Container kube-multus ready: true, restart count 1 May 14 21:19:15.171: INFO: kubernetes-dashboard-86c6f9df5b-ndntg started at 2021-05-14 19:59:31 +0000 UTC (0+1 container statuses recorded) May 14 21:19:15.171: INFO: Container kubernetes-dashboard ready: true, restart count 2 May 14 21:19:15.171: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-2c2pw started at 2021-05-14 20:06:38 +0000 UTC (0+1 container statuses recorded) May 14 21:19:15.171: INFO: Container kube-sriovdp ready: true, restart count 0 May 14 21:19:15.171: INFO: downward-api-44c5b413-a1ee-4173-a91e-6ba172df4e61 started at 2021-05-14 21:16:37 +0000 UTC (0+1 container statuses recorded) May 14 21:19:15.171: INFO: Container dapi-container ready: false, restart count 0 May 14 21:19:15.171: INFO: webserver-deployment-dd94f59b7-qdz6c started at 2021-05-14 21:15:51 +0000 UTC (0+1 container statuses recorded) May 14 21:19:15.171: INFO: Container httpd ready: true, restart count 0 May 14 21:19:15.171: INFO: busybox-host-aliases440536ff-8609-4c65-870a-994e8b5cd63d started at 2021-05-14 21:15:53 +0000 UTC (0+1 container statuses recorded) May 14 21:19:15.172: INFO: Container busybox-host-aliases440536ff-8609-4c65-870a-994e8b5cd63d ready: false, restart count 0 W0514 21:19:15.185781 35 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 14 21:19:15.221: INFO: Latency metrics for node node2 May 14 21:19:15.221: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "container-probe-323" for this suite. /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 May 14 21:26:50.048: Unexpected error: <*errors.errorString | 0xc001f1c8d0>: { s: "expected pod \"pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178\" success: Gave up after waiting 5m0s for pod \"pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178\" to be \"Succeeded or Failed\"", } expected pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178" success: Gave up after waiting 5m0s for pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178" to be "Succeeded or Failed" occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 [BeforeEach] [sig-api-machinery] Secrets /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client May 14 21:21:45.448: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename secrets STEP: Waiting for a default service account to be provisioned in namespace [It] should be consumable from pods in env vars [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating secret with name secret-test-524ac36e-cddc-4b0a-8c02-3a704f2709c9 STEP: Creating a pod to test consume secrets May 14 21:21:45.484: INFO: Waiting up to 5m0s for pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178" in namespace "secrets-9096" to be "Succeeded or Failed" May 14 21:21:45.489: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 4.884581ms May 14 21:21:47.492: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 2.007971372s May 14 21:21:49.497: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 4.012493717s May 14 21:21:51.502: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 6.017089077s May 14 21:21:53.505: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 8.020368042s May 14 21:21:55.508: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 10.02378932s May 14 21:21:57.511: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 12.026964329s May 14 21:21:59.515: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 14.030092553s May 14 21:22:01.519: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 16.034567175s May 14 21:22:03.523: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 18.038359401s May 14 21:22:05.526: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 20.041659514s May 14 21:22:07.529: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 22.044933593s May 14 21:22:09.532: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 24.047993359s May 14 21:22:11.536: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 26.051589532s May 14 21:22:13.540: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 28.055122614s May 14 21:22:15.544: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 30.05987684s May 14 21:22:17.549: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 32.064275329s May 14 21:22:19.552: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 34.067663928s May 14 21:22:21.556: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 36.071454142s May 14 21:22:23.559: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 38.0742737s May 14 21:22:25.562: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 40.077446225s May 14 21:22:27.564: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 42.080024593s May 14 21:22:29.568: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 44.083249097s May 14 21:22:31.572: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 46.087986715s May 14 21:22:33.577: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 48.092073892s May 14 21:22:35.581: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 50.096066931s May 14 21:22:37.584: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 52.099713724s May 14 21:22:39.587: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 54.102812901s May 14 21:22:41.590: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 56.105862797s May 14 21:22:43.594: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 58.1091081s May 14 21:22:45.596: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.111829832s May 14 21:22:47.600: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.115676537s May 14 21:22:49.604: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.119268154s May 14 21:22:51.607: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.12276151s May 14 21:22:53.611: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.126330011s May 14 21:22:55.614: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.129473637s May 14 21:22:57.617: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.132783822s May 14 21:22:59.622: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.137741847s May 14 21:23:01.626: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.141343598s May 14 21:23:03.629: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.144670974s May 14 21:23:05.632: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.147976804s May 14 21:23:07.636: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.151374102s May 14 21:23:09.639: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.155003098s May 14 21:23:11.643: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.158217697s May 14 21:23:13.647: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.16213766s May 14 21:23:15.650: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.165625164s May 14 21:23:17.653: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.168753469s May 14 21:23:19.656: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.171560304s May 14 21:23:21.660: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.175330126s May 14 21:23:23.663: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.178682295s May 14 21:23:25.667: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.18212216s May 14 21:23:27.670: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.185285031s May 14 21:23:29.672: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.188000409s May 14 21:23:31.675: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.1910305s May 14 21:23:33.678: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.193991354s May 14 21:23:35.682: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.197528562s May 14 21:23:37.686: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.201468918s May 14 21:23:39.690: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.205396439s May 14 21:23:41.694: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.209988159s May 14 21:23:43.697: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.212560542s May 14 21:23:45.700: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.215495157s May 14 21:23:47.705: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.220116539s May 14 21:23:49.708: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.223184066s May 14 21:23:51.712: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.227833339s May 14 21:23:53.715: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.230569214s May 14 21:23:55.720: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.235377275s May 14 21:23:57.723: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.238107087s May 14 21:23:59.725: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.240617136s May 14 21:24:01.728: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.243444857s May 14 21:24:03.731: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.24612634s May 14 21:24:05.733: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.248974785s May 14 21:24:07.736: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.25197702s May 14 21:24:09.740: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.255210685s May 14 21:24:11.743: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.258668976s May 14 21:24:13.746: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.262003115s May 14 21:24:15.750: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.265243859s May 14 21:24:17.753: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.268664113s May 14 21:24:19.756: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.271949222s May 14 21:24:21.760: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.275224797s May 14 21:24:23.764: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.279588878s May 14 21:24:25.768: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.283973409s May 14 21:24:27.772: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.287309843s May 14 21:24:29.775: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.29080891s May 14 21:24:31.779: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.294420204s May 14 21:24:33.782: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.297942938s May 14 21:24:35.787: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.303021991s May 14 21:24:37.790: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.305811642s May 14 21:24:39.794: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.309666399s May 14 21:24:41.798: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.313883844s May 14 21:24:43.804: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.319911919s May 14 21:24:45.809: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.324351182s May 14 21:24:47.812: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.327210667s May 14 21:24:49.815: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.330708893s May 14 21:24:51.822: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.337235605s May 14 21:24:53.826: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.341419767s May 14 21:24:55.830: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.345845739s May 14 21:24:57.834: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.349532572s May 14 21:24:59.839: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.354143657s May 14 21:25:01.843: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.358715948s May 14 21:25:03.846: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.361334485s May 14 21:25:05.849: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.364931063s May 14 21:25:07.853: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.368231817s May 14 21:25:09.856: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.371353747s May 14 21:25:11.859: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.374216065s May 14 21:25:13.863: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.378258503s May 14 21:25:15.867: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.382665863s May 14 21:25:17.871: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.386367699s May 14 21:25:19.874: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.389332186s May 14 21:25:21.877: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.392456158s May 14 21:25:23.880: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.395206285s May 14 21:25:25.883: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.398127666s May 14 21:25:27.885: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.400679686s May 14 21:25:29.889: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.404280893s May 14 21:25:31.893: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.408730658s May 14 21:25:33.896: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.411637605s May 14 21:25:35.899: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.414719971s May 14 21:25:37.903: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.418070869s May 14 21:25:39.906: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.421955126s May 14 21:25:41.911: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.426765268s May 14 21:25:43.916: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.431411064s May 14 21:25:45.921: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.436418584s May 14 21:25:47.923: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.43900097s May 14 21:25:49.927: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.442346805s May 14 21:25:51.935: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.450213633s May 14 21:25:53.938: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.453445425s May 14 21:25:55.942: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.457833334s May 14 21:25:57.946: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.461175449s May 14 21:25:59.949: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.464802548s May 14 21:26:01.952: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.467481945s May 14 21:26:03.956: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.471714713s May 14 21:26:05.960: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.475904357s May 14 21:26:07.964: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.479248125s May 14 21:26:09.968: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.483358071s May 14 21:26:11.972: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.487163769s May 14 21:26:13.975: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.490587019s May 14 21:26:15.979: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.494578717s May 14 21:26:17.983: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.498677229s May 14 21:26:19.987: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.502948062s May 14 21:26:21.991: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.506780023s May 14 21:26:23.995: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.510642823s May 14 21:26:25.999: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.514375642s May 14 21:26:28.002: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.517548996s May 14 21:26:30.005: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.520952236s May 14 21:26:32.009: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.524363005s May 14 21:26:34.013: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.52850777s May 14 21:26:36.017: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.532544729s May 14 21:26:38.020: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.535252635s May 14 21:26:40.022: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.53805618s May 14 21:26:42.026: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.541356478s May 14 21:26:44.029: INFO: Pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.5445295s May 14 21:26:46.037: INFO: Failed to get logs from node "node2" pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178" container "secret-env-test": the server rejected our request for an unknown reason (get pods pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178) STEP: delete the pod May 14 21:26:46.042: INFO: Waiting for pod pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178 to disappear May 14 21:26:46.044: INFO: Pod pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178 still exists May 14 21:26:48.044: INFO: Waiting for pod pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178 to disappear May 14 21:26:48.047: INFO: Pod pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178 still exists May 14 21:26:50.044: INFO: Waiting for pod pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178 to disappear May 14 21:26:50.047: INFO: Pod pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178 no longer exists May 14 21:26:50.048: FAIL: Unexpected error: <*errors.errorString | 0xc001f1c8d0>: { s: "expected pod \"pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178\" success: Gave up after waiting 5m0s for pod \"pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178\" to be \"Succeeded or Failed\"", } expected pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178" success: Gave up after waiting 5m0s for pod "pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178" to be "Succeeded or Failed" occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).testContainerOutputMatcher(0xc001410f20, 0x4c097bc, 0xf, 0xc00378c400, 0x0, 0xc00319b168, 0x1, 0x1, 0x4de7488) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 +0x1ee k8s.io/kubernetes/test/e2e/framework.(*Framework).TestContainerOutput(...) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:525 k8s.io/kubernetes/test/e2e/common.glob..func27.1() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/secrets.go:83 +0x91a k8s.io/kubernetes/test/e2e.RunE2ETests(0xc003896a80) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc003896a80) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc003896a80, 0x4de37a0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [sig-api-machinery] Secrets /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "secrets-9096". STEP: Found 7 events. May 14 21:26:50.053: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178: { } Scheduled: Successfully assigned secrets-9096/pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178 to node2 May 14 21:26:50.053: INFO: At 2021-05-14 21:21:47 +0000 UTC - event for pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178: {multus } AddedInterface: Add eth0 [10.244.4.100/24] May 14 21:26:50.053: INFO: At 2021-05-14 21:21:47 +0000 UTC - event for pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178: {kubelet node2} Pulling: Pulling image "docker.io/library/busybox:1.29" May 14 21:26:50.053: INFO: At 2021-05-14 21:21:48 +0000 UTC - event for pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178: {kubelet node2} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit May 14 21:26:50.053: INFO: At 2021-05-14 21:21:48 +0000 UTC - event for pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178: {kubelet node2} Failed: Error: ErrImagePull May 14 21:26:50.053: INFO: At 2021-05-14 21:21:48 +0000 UTC - event for pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178: {kubelet node2} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" May 14 21:26:50.053: INFO: At 2021-05-14 21:21:48 +0000 UTC - event for pod-secrets-637d8d95-1b69-464b-ba71-4883dbbc8178: {kubelet node2} Failed: Error: ImagePullBackOff May 14 21:26:50.056: INFO: POD NODE PHASE GRACE CONDITIONS May 14 21:26:50.056: INFO: May 14 21:26:50.061: INFO: Logging node info for node master1 May 14 21:26:50.064: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 8e20012e-a811-456d-9add-2ea316e23700 29036 0 2021-05-14 19:56:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"a6:a3:7b:a0:c9:75"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-14 19:56:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-14 19:56:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-14 19:59:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-05-14 20:06:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234763776 0} {<nil>} 196518324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324599808 0} {<nil>} 195629492Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:02:00 +0000 UTC,LastTransitionTime:2021-05-14 20:02:00 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-14 21:26:46 +0000 UTC,LastTransitionTime:2021-05-14 19:56:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-14 21:26:46 +0000 UTC,LastTransitionTime:2021-05-14 19:56:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-14 21:26:46 +0000 UTC,LastTransitionTime:2021-05-14 19:56:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-14 21:26:46 +0000 UTC,LastTransitionTime:2021-05-14 19:59:09 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a88b162033bc4931ba0342c7f78a28b9,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:ba5ed4e5-a8ef-4986-946f-e7e2d91395d2,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:e3157cfba16d361ffec06306dd0154c7dca1931cbc4569e3c5822e30e311948b tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:a43c7fdd150533238a300ad84ac906e551111f9b57273afcb8781ee675fd23b3 tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 14 21:26:50.064: INFO: Logging kubelet events for node master1 May 14 21:26:50.067: INFO: Logging pods the kubelet thinks is on node master1 May 14 21:26:50.078: INFO: node-exporter-nvrxr started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 14 21:26:50.078: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 14 21:26:50.078: INFO: Container node-exporter ready: true, restart count 0 May 14 21:26:50.078: INFO: kube-scheduler-master1 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 14 21:26:50.078: INFO: Container kube-scheduler ready: true, restart count 0 May 14 21:26:50.078: INFO: kube-controller-manager-master1 started at 2021-05-14 20:01:22 +0000 UTC (0+1 container statuses recorded) May 14 21:26:50.078: INFO: Container kube-controller-manager ready: true, restart count 2 May 14 21:26:50.078: INFO: kube-flannel-cx7s6 started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 14 21:26:50.078: INFO: Init container install-cni ready: true, restart count 0 May 14 21:26:50.078: INFO: Container kube-flannel ready: true, restart count 1 May 14 21:26:50.078: INFO: kube-proxy-v2c76 started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 14 21:26:50.078: INFO: Container kube-proxy ready: true, restart count 2 May 14 21:26:50.078: INFO: kube-multus-ds-amd64-m54v2 started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 14 21:26:50.078: INFO: Container kube-multus ready: true, restart count 1 May 14 21:26:50.078: INFO: coredns-7677f9bb54-mlcmv started at 2021-05-14 19:59:27 +0000 UTC (0+1 container statuses recorded) May 14 21:26:50.078: INFO: Container coredns ready: true, restart count 1 May 14 21:26:50.078: INFO: docker-registry-docker-registry-56cbc7bc58-bjc5h started at 2021-05-14 20:02:43 +0000 UTC (0+2 container statuses recorded) May 14 21:26:50.078: INFO: Container docker-registry ready: true, restart count 0 May 14 21:26:50.078: INFO: Container nginx ready: true, restart count 0 May 14 21:26:50.078: INFO: node-feature-discovery-controller-5bf5c49849-27v77 started at 2021-05-14 20:05:52 +0000 UTC (0+1 container statuses recorded) May 14 21:26:50.078: INFO: Container nfd-controller ready: true, restart count 0 May 14 21:26:50.078: INFO: kube-apiserver-master1 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 14 21:26:50.078: INFO: Container kube-apiserver ready: true, restart count 0 W0514 21:26:50.092844 35 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 14 21:26:50.117: INFO: Latency metrics for node master1 May 14 21:26:50.117: INFO: Logging node info for node master2 May 14 21:26:50.120: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 e8f1881f-5ded-4c6c-b7e6-eb354b7962e2 29035 0 2021-05-14 19:57:04 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"0a:97:9a:eb:9d:a8"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-14 19:57:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-14 19:57:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-14 19:59:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-14 19:59:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234763776 0} {<nil>} 196518324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324599808 0} {<nil>} 195629492Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:02:07 +0000 UTC,LastTransitionTime:2021-05-14 20:02:07 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-14 21:26:46 +0000 UTC,LastTransitionTime:2021-05-14 19:57:04 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-14 21:26:46 +0000 UTC,LastTransitionTime:2021-05-14 19:57:04 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-14 21:26:46 +0000 UTC,LastTransitionTime:2021-05-14 19:57:04 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-14 21:26:46 +0000 UTC,LastTransitionTime:2021-05-14 19:59:09 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:14c4cdd0613041bb923c5f9b84e0bcde,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:9bdca68c-a5fc-48f7-b392-63d2c04d224d,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 14 21:26:50.121: INFO: Logging kubelet events for node master2 May 14 21:26:50.123: INFO: Logging pods the kubelet thinks is on node master2 May 14 21:26:50.130: INFO: kube-proxy-qcgpm started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 14 21:26:50.130: INFO: Container kube-proxy ready: true, restart count 2 May 14 21:26:50.130: INFO: kube-flannel-fc4sf started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 14 21:26:50.130: INFO: Init container install-cni ready: true, restart count 0 May 14 21:26:50.130: INFO: Container kube-flannel ready: true, restart count 1 May 14 21:26:50.130: INFO: kube-multus-ds-amd64-bt5kr started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 14 21:26:50.130: INFO: Container kube-multus ready: true, restart count 1 May 14 21:26:50.130: INFO: dns-autoscaler-5b7b5c9b6f-fgzqp started at 2021-05-14 19:59:30 +0000 UTC (0+1 container statuses recorded) May 14 21:26:50.130: INFO: Container autoscaler ready: true, restart count 2 May 14 21:26:50.130: INFO: node-exporter-gjrtc started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 14 21:26:50.130: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 14 21:26:50.130: INFO: Container node-exporter ready: true, restart count 0 May 14 21:26:50.130: INFO: kube-apiserver-master2 started at 2021-05-14 20:05:10 +0000 UTC (0+1 container statuses recorded) May 14 21:26:50.130: INFO: Container kube-apiserver ready: true, restart count 0 May 14 21:26:50.130: INFO: kube-controller-manager-master2 started at 2021-05-14 20:01:22 +0000 UTC (0+1 container statuses recorded) May 14 21:26:50.130: INFO: Container kube-controller-manager ready: true, restart count 2 May 14 21:26:50.130: INFO: kube-scheduler-master2 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 14 21:26:50.130: INFO: Container kube-scheduler ready: true, restart count 2 W0514 21:26:50.143568 35 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 14 21:26:50.171: INFO: Latency metrics for node master2 May 14 21:26:50.171: INFO: Logging node info for node master3 May 14 21:26:50.173: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 29fd0a5d-1350-4e28-a4cb-b26dd82cd397 28946 0 2021-05-14 19:57:14 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:27:37:b7:ad:a5"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-14 19:57:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-14 19:57:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-14 19:59:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234767872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324603904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:01:03 +0000 UTC,LastTransitionTime:2021-05-14 20:01:03 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-14 21:26:43 +0000 UTC,LastTransitionTime:2021-05-14 19:57:14 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-14 21:26:43 +0000 UTC,LastTransitionTime:2021-05-14 19:57:14 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-14 21:26:43 +0000 UTC,LastTransitionTime:2021-05-14 19:57:14 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-14 21:26:43 +0000 UTC,LastTransitionTime:2021-05-14 20:00:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f3fe601830d34e59967ed389af552f25,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:56dd60e2-98fe-4d87-81d9-95db820e7426,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 14 21:26:50.174: INFO: Logging kubelet events for node master3 May 14 21:26:50.177: INFO: Logging pods the kubelet thinks is on node master3 May 14 21:26:50.185: INFO: kube-flannel-cl8jf started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 14 21:26:50.185: INFO: Init container install-cni ready: true, restart count 0 May 14 21:26:50.185: INFO: Container kube-flannel ready: true, restart count 2 May 14 21:26:50.185: INFO: kube-multus-ds-amd64-hp6bp started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 14 21:26:50.185: INFO: Container kube-multus ready: true, restart count 1 May 14 21:26:50.185: INFO: coredns-7677f9bb54-qhzrv started at 2021-05-14 19:59:32 +0000 UTC (0+1 container statuses recorded) May 14 21:26:50.185: INFO: Container coredns ready: true, restart count 2 May 14 21:26:50.185: INFO: node-exporter-4cgbq started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 14 21:26:50.185: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 14 21:26:50.185: INFO: Container node-exporter ready: true, restart count 0 May 14 21:26:50.185: INFO: kube-controller-manager-master3 started at 2021-05-14 20:00:41 +0000 UTC (0+1 container statuses recorded) May 14 21:26:50.185: INFO: Container kube-controller-manager ready: true, restart count 3 May 14 21:26:50.185: INFO: kube-scheduler-master3 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 14 21:26:50.185: INFO: Container kube-scheduler ready: true, restart count 3 May 14 21:26:50.185: INFO: kube-apiserver-master3 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 14 21:26:50.185: INFO: Container kube-apiserver ready: true, restart count 0 May 14 21:26:50.185: INFO: kube-proxy-2crs2 started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 14 21:26:50.185: INFO: Container kube-proxy ready: true, restart count 1 W0514 21:26:50.197268 35 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 14 21:26:50.221: INFO: Latency metrics for node master3 May 14 21:26:50.221: INFO: Logging node info for node node1 May 14 21:26:50.224: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 5e4c0fba-b5fa-4177-b834-f3e04c846ff3 28973 0 2021-05-14 19:58:21 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ba:ee:c6:a6:52:03"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-14 19:58:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-05-14 19:58:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-14 20:06:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-14 20:08:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-14 20:08:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269633024 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884632576 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:00:44 +0000 UTC,LastTransitionTime:2021-05-14 20:00:44 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-14 21:26:44 +0000 UTC,LastTransitionTime:2021-05-14 19:58:21 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-14 21:26:44 +0000 UTC,LastTransitionTime:2021-05-14 19:58:21 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-14 21:26:44 +0000 UTC,LastTransitionTime:2021-05-14 19:58:21 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-14 21:26:44 +0000 UTC,LastTransitionTime:2021-05-14 20:00:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:4b96d01fdbcb4fadb4a59fca2e1bf368,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:93c238b3-1895-423c-a1aa-193fbcf8b55f,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:869f7b3516c269b43448f1227c57d536e8a4cf723eeef3b5f8b8e224ecbcfd8e localhost:30500/barometer-collectd:stable],SizeBytes:1464261626,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:1002487751,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:ed5c574f653e2a39e784ff322033a2319aafde7366c803a88f20f7a2a8bc1efb opnfv/barometer-collectd:stable],SizeBytes:825413035,},ContainerImage{Names:[localhost:30500/cmk@sha256:f759b012c29126f880575ac543d09301d45f0b2b9d0f5329849ea40e65017dde cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[golang@sha256:1636899c10870ab66c48d960a9df620f4f9e86a0c72fbacf36032d27404e7e6c golang:alpine3.12],SizeBytes:301156062,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:948a93bc3803d61dd66ab49f99d4cc657e87273682aec7dd5955a000fd17a7e5 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392645,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:36553b10a4947067b9fbb7d532951066293a68eae893beba1d9235f7d11a20ad alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 14 21:26:50.224: INFO: Logging kubelet events for node node1 May 14 21:26:50.226: INFO: Logging pods the kubelet thinks is on node node1 May 14 21:26:50.240: INFO: pod-sharedvolume-9d40da78-d9a0-4470-aff6-7399b2ddf7ef started at 2021-05-14 21:24:20 +0000 UTC (0+2 container statuses recorded) May 14 21:26:50.240: INFO: Container busybox-main-container ready: false, restart count 0 May 14 21:26:50.240: INFO: Container busybox-sub-container ready: false, restart count 0 May 14 21:26:50.240: INFO: kube-flannel-hj8sj started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 14 21:26:50.240: INFO: Init container install-cni ready: true, restart count 0 May 14 21:26:50.240: INFO: Container kube-flannel ready: true, restart count 1 May 14 21:26:50.240: INFO: prometheus-operator-5bb8cb9d8f-4lq8j started at 2021-05-14 20:09:49 +0000 UTC (0+2 container statuses recorded) May 14 21:26:50.240: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 14 21:26:50.240: INFO: Container prometheus-operator ready: true, restart count 0 May 14 21:26:50.240: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-bw262 started at 2021-05-14 20:06:38 +0000 UTC (0+1 container statuses recorded) May 14 21:26:50.240: INFO: Container kube-sriovdp ready: true, restart count 0 May 14 21:26:50.240: INFO: collectd-qhp77 started at 2021-05-14 20:15:36 +0000 UTC (0+3 container statuses recorded) May 14 21:26:50.240: INFO: Container collectd ready: true, restart count 0 May 14 21:26:50.240: INFO: Container collectd-exporter ready: true, restart count 0 May 14 21:26:50.240: INFO: Container rbac-proxy ready: true, restart count 0 May 14 21:26:50.240: INFO: kube-proxy-l7697 started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 14 21:26:50.240: INFO: Container kube-proxy ready: true, restart count 2 May 14 21:26:50.240: INFO: kube-multus-ds-amd64-jhf4c started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 14 21:26:50.240: INFO: Container kube-multus ready: true, restart count 1 May 14 21:26:50.240: INFO: nginx-proxy-node1 started at 2021-05-14 20:05:10 +0000 UTC (0+1 container statuses recorded) May 14 21:26:50.240: INFO: Container nginx-proxy ready: true, restart count 2 May 14 21:26:50.240: INFO: cmk-init-discover-node1-g6c6q started at 2021-05-14 20:08:21 +0000 UTC (0+3 container statuses recorded) May 14 21:26:50.240: INFO: Container discover ready: false, restart count 0 May 14 21:26:50.240: INFO: Container init ready: false, restart count 0 May 14 21:26:50.240: INFO: Container install ready: false, restart count 0 May 14 21:26:50.240: INFO: cmk-9nqjc started at 2021-05-14 20:09:03 +0000 UTC (0+2 container statuses recorded) May 14 21:26:50.240: INFO: Container nodereport ready: true, restart count 0 May 14 21:26:50.240: INFO: Container reconcile ready: true, restart count 0 May 14 21:26:50.240: INFO: node-exporter-r62rn started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 14 21:26:50.240: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 14 21:26:50.240: INFO: Container node-exporter ready: true, restart count 0 May 14 21:26:50.240: INFO: prometheus-k8s-0 started at 2021-05-14 20:09:58 +0000 UTC (0+5 container statuses recorded) May 14 21:26:50.240: INFO: Container custom-metrics-apiserver ready: true, restart count 0 May 14 21:26:50.240: INFO: Container grafana ready: true, restart count 0 May 14 21:26:50.240: INFO: Container prometheus ready: true, restart count 1 May 14 21:26:50.240: INFO: Container prometheus-config-reloader ready: true, restart count 0 May 14 21:26:50.240: INFO: Container rules-configmap-reloader ready: true, restart count 0 May 14 21:26:50.240: INFO: fail-once-local-frcf7 started at 2021-05-14 21:26:40 +0000 UTC (0+1 container statuses recorded) May 14 21:26:50.240: INFO: Container c ready: false, restart count 0 May 14 21:26:50.240: INFO: kubernetes-metrics-scraper-678c97765c-pqnd6 started at 2021-05-14 19:59:31 +0000 UTC (0+1 container statuses recorded) May 14 21:26:50.240: INFO: Container kubernetes-metrics-scraper ready: true, restart count 1 May 14 21:26:50.240: INFO: node-feature-discovery-worker-nvg9t started at 2021-05-14 20:05:42 +0000 UTC (0+1 container statuses recorded) May 14 21:26:50.240: INFO: Container nfd-worker ready: true, restart count 0 W0514 21:26:50.253815 35 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 14 21:26:50.296: INFO: Latency metrics for node node1 May 14 21:26:50.296: INFO: Logging node info for node node2 May 14 21:26:50.299: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 0bae98dc-2ebc-4849-b99e-7780a3bea71e 28970 0 2021-05-14 19:58:22 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"c6:18:ed:95:bb:1a"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-14 19:58:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-05-14 19:58:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-14 20:06:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-14 20:08:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-14 20:08:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269633024 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884632576 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:01:27 +0000 UTC,LastTransitionTime:2021-05-14 20:01:27 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-14 21:26:44 +0000 UTC,LastTransitionTime:2021-05-14 19:58:22 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-14 21:26:44 +0000 UTC,LastTransitionTime:2021-05-14 19:58:22 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-14 21:26:44 +0000 UTC,LastTransitionTime:2021-05-14 19:58:22 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-14 21:26:44 +0000 UTC,LastTransitionTime:2021-05-14 19:59:04 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a3f22fbf9e534ba1819f7a549414a8a6,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:166b6e45-ba8b-4b89-80b0-befc9a0152b8,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:869f7b3516c269b43448f1227c57d536e8a4cf723eeef3b5f8b8e224ecbcfd8e localhost:30500/barometer-collectd:stable],SizeBytes:1464261626,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[localhost:30500/cmk@sha256:f759b012c29126f880575ac543d09301d45f0b2b9d0f5329849ea40e65017dde localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:948a93bc3803d61dd66ab49f99d4cc657e87273682aec7dd5955a000fd17a7e5 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392645,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:e3157cfba16d361ffec06306dd0154c7dca1931cbc4569e3c5822e30e311948b localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:a43c7fdd150533238a300ad84ac906e551111f9b57273afcb8781ee675fd23b3 localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 14 21:26:50.299: INFO: Logging kubelet events for node node2 May 14 21:26:50.301: INFO: Logging pods the kubelet thinks is on node node2 May 14 21:26:50.311: INFO: kube-proxy-t524z started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 14 21:26:50.311: INFO: Container kube-proxy ready: true, restart count 2 May 14 21:26:50.311: INFO: kube-multus-ds-amd64-n7cb2 started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 14 21:26:50.311: INFO: Container kube-multus ready: true, restart count 1 May 14 21:26:50.311: INFO: kubernetes-dashboard-86c6f9df5b-ndntg started at 2021-05-14 19:59:31 +0000 UTC (0+1 container statuses recorded) May 14 21:26:50.311: INFO: Container kubernetes-dashboard ready: true, restart count 2 May 14 21:26:50.311: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-2c2pw started at 2021-05-14 20:06:38 +0000 UTC (0+1 container statuses recorded) May 14 21:26:50.311: INFO: Container kube-sriovdp ready: true, restart count 0 May 14 21:26:50.311: INFO: liveness-9fa58f7c-ac7d-4238-9615-5e6e86456837 started at 2021-05-14 21:25:39 +0000 UTC (0+1 container statuses recorded) May 14 21:26:50.311: INFO: Container liveness ready: true, restart count 0 May 14 21:26:50.311: INFO: pod-init-7ea4fb42-75f4-4d54-a036-96d88aab0965 started at 2021-05-14 21:21:42 +0000 UTC (2+1 container statuses recorded) May 14 21:26:50.311: INFO: Init container init1 ready: false, restart count 0 May 14 21:26:50.311: INFO: Init container init2 ready: false, restart count 0 May 14 21:26:50.311: INFO: Container run1 ready: false, restart count 0 May 14 21:26:50.311: INFO: nginx-proxy-node2 started at 2021-05-14 20:05:10 +0000 UTC (0+1 container statuses recorded) May 14 21:26:50.311: INFO: Container nginx-proxy ready: true, restart count 2 May 14 21:26:50.311: INFO: node-feature-discovery-worker-76m6b started at 2021-05-14 20:05:42 +0000 UTC (0+1 container statuses recorded) May 14 21:26:50.311: INFO: Container nfd-worker ready: true, restart count 0 May 14 21:26:50.311: INFO: cmk-d2qwf started at 2021-05-14 20:09:04 +0000 UTC (0+2 container statuses recorded) May 14 21:26:50.311: INFO: Container nodereport ready: true, restart count 0 May 14 21:26:50.311: INFO: Container reconcile ready: true, restart count 0 May 14 21:26:50.311: INFO: busybox-user-65534-69c07549-5cd7-4a38-80d2-7e5291ec2832 started at 2021-05-14 21:23:59 +0000 UTC (0+1 container statuses recorded) May 14 21:26:50.311: INFO: Container busybox-user-65534-69c07549-5cd7-4a38-80d2-7e5291ec2832 ready: false, restart count 0 May 14 21:26:50.311: INFO: ss2-0 started at 2021-05-14 21:16:52 +0000 UTC (0+1 container statuses recorded) May 14 21:26:50.311: INFO: Container webserver ready: false, restart count 0 May 14 21:26:50.311: INFO: kube-flannel-rqcwp started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 14 21:26:50.311: INFO: Init container install-cni ready: true, restart count 1 May 14 21:26:50.311: INFO: Container kube-flannel ready: true, restart count 4 May 14 21:26:50.311: INFO: cmk-webhook-6c9d5f8578-pjgxh started at 2021-05-14 20:09:04 +0000 UTC (0+1 container statuses recorded) May 14 21:26:50.311: INFO: Container cmk-webhook ready: true, restart count 0 May 14 21:26:50.311: INFO: node-exporter-rnd5f started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 14 21:26:50.311: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 14 21:26:50.311: INFO: Container node-exporter ready: true, restart count 0 May 14 21:26:50.311: INFO: test-rollover-controller-4ds9r started at 2021-05-14 21:24:35 +0000 UTC (0+1 container statuses recorded) May 14 21:26:50.311: INFO: Container httpd ready: false, restart count 0 May 14 21:26:50.311: INFO: client-containers-360e5216-ac58-46a4-88e6-85ba583f212d started at 2021-05-14 21:26:46 +0000 UTC (0+1 container statuses recorded) May 14 21:26:50.311: INFO: Container test-container ready: false, restart count 0 May 14 21:26:50.311: INFO: cmk-init-discover-node2-j75ff started at 2021-05-14 20:08:41 +0000 UTC (0+3 container statuses recorded) May 14 21:26:50.311: INFO: Container discover ready: false, restart count 0 May 14 21:26:50.311: INFO: Container init ready: false, restart count 0 May 14 21:26:50.311: INFO: Container install ready: false, restart count 0 May 14 21:26:50.311: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-l5hlq started at 2021-05-14 20:12:48 +0000 UTC (0+2 container statuses recorded) May 14 21:26:50.311: INFO: Container tas-controller ready: true, restart count 0 May 14 21:26:50.311: INFO: Container tas-extender ready: true, restart count 0 May 14 21:26:50.311: INFO: collectd-xzrgs started at 2021-05-14 20:15:36 +0000 UTC (0+3 container statuses recorded) May 14 21:26:50.311: INFO: Container collectd ready: true, restart count 0 May 14 21:26:50.311: INFO: Container collectd-exporter ready: true, restart count 0 May 14 21:26:50.311: INFO: Container rbac-proxy ready: true, restart count 0 May 14 21:26:50.311: INFO: fail-once-local-vsfv6 started at 2021-05-14 21:26:40 +0000 UTC (0+1 container statuses recorded) May 14 21:26:50.311: INFO: Container c ready: false, restart count 0 W0514 21:26:50.321571 35 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 14 21:26:50.350: INFO: Latency metrics for node node2 May 14 21:26:50.351: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "secrets-9096" for this suite. /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 May 14 21:29:30.514: Unexpected error: <*errors.errorString | 0xc000dcaa20>: { s: "service is not reachable within 2m0s timeout on endpoint 10.10.190.207:31007 over TCP protocol", } service is not reachable within 2m0s timeout on endpoint 10.10.190.207:31007 over TCP protocol occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:1760 [BeforeEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client May 14 21:27:21.100: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename services STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:782 [It] should be able to change the type from ExternalName to NodePort [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: creating a service externalname-service with the type=ExternalName in namespace services-2040 STEP: changing the ExternalName service to type=NodePort STEP: creating replication controller externalname-service in namespace services-2040 I0514 21:27:21.149071 35 runners.go:190] Created replication controller with name: externalname-service, namespace: services-2040, replica count: 2 I0514 21:27:24.199750 35 runners.go:190] externalname-service Pods: 2 out of 2 created, 2 running, 0 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady May 14 21:27:24.199: INFO: Creating new exec pod May 14 21:27:29.226: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 externalname-service 80' May 14 21:27:29.483: INFO: stderr: "+ nc -zv -t -w 2 externalname-service 80\nConnection to externalname-service 80 port [tcp/http] succeeded!\n" May 14 21:27:29.483: INFO: stdout: "" May 14 21:27:29.484: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.233.43.200 80' May 14 21:27:29.745: INFO: stderr: "+ nc -zv -t -w 2 10.233.43.200 80\nConnection to 10.233.43.200 80 port [tcp/http] succeeded!\n" May 14 21:27:29.745: INFO: stdout: "" May 14 21:27:29.745: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:27:30.000: INFO: rc: 1 May 14 21:27:30.000: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:27:31.000: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:27:31.255: INFO: rc: 1 May 14 21:27:31.255: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:27:32.001: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:27:32.266: INFO: rc: 1 May 14 21:27:32.266: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:27:33.000: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:27:33.254: INFO: rc: 1 May 14 21:27:33.254: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:27:34.001: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:27:34.248: INFO: rc: 1 May 14 21:27:34.248: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:27:35.001: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:27:35.238: INFO: rc: 1 May 14 21:27:35.238: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:27:36.002: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:27:36.262: INFO: rc: 1 May 14 21:27:36.262: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:27:37.002: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:27:37.257: INFO: rc: 1 May 14 21:27:37.257: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:27:38.001: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:27:38.273: INFO: rc: 1 May 14 21:27:38.273: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:27:39.001: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:27:39.253: INFO: rc: 1 May 14 21:27:39.253: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:27:40.000: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:27:40.274: INFO: rc: 1 May 14 21:27:40.274: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:27:41.001: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:27:41.263: INFO: rc: 1 May 14 21:27:41.263: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:27:42.000: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:27:42.279: INFO: rc: 1 May 14 21:27:42.279: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:27:43.000: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:27:43.260: INFO: rc: 1 May 14 21:27:43.260: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:27:44.000: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:27:44.268: INFO: rc: 1 May 14 21:27:44.268: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:27:45.000: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:27:45.251: INFO: rc: 1 May 14 21:27:45.251: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:27:46.000: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:27:46.267: INFO: rc: 1 May 14 21:27:46.267: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:27:47.000: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:27:47.245: INFO: rc: 1 May 14 21:27:47.245: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:27:48.000: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:27:48.275: INFO: rc: 1 May 14 21:27:48.275: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:27:49.000: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:27:49.265: INFO: rc: 1 May 14 21:27:49.265: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:27:50.000: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:27:50.254: INFO: rc: 1 May 14 21:27:50.254: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:27:51.000: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:27:51.249: INFO: rc: 1 May 14 21:27:51.249: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:27:52.001: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:27:52.270: INFO: rc: 1 May 14 21:27:52.270: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:27:53.000: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:27:53.288: INFO: rc: 1 May 14 21:27:53.288: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:27:54.002: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:27:54.270: INFO: rc: 1 May 14 21:27:54.270: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:27:55.001: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:27:55.253: INFO: rc: 1 May 14 21:27:55.253: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:27:56.001: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:27:56.286: INFO: rc: 1 May 14 21:27:56.286: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:27:57.002: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:27:57.264: INFO: rc: 1 May 14 21:27:57.264: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:27:58.000: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:27:58.267: INFO: rc: 1 May 14 21:27:58.267: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:27:59.000: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:27:59.270: INFO: rc: 1 May 14 21:27:59.270: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:28:00.000: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:28:00.258: INFO: rc: 1 May 14 21:28:00.258: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:28:01.000: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:28:01.276: INFO: rc: 1 May 14 21:28:01.276: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:28:02.001: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:28:02.255: INFO: rc: 1 May 14 21:28:02.255: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:28:03.000: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:28:03.247: INFO: rc: 1 May 14 21:28:03.247: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:28:04.000: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:28:04.268: INFO: rc: 1 May 14 21:28:04.268: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:28:05.001: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:28:05.265: INFO: rc: 1 May 14 21:28:05.265: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:28:06.001: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:28:06.263: INFO: rc: 1 May 14 21:28:06.263: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:28:07.000: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:28:07.269: INFO: rc: 1 May 14 21:28:07.269: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:28:08.000: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:28:08.260: INFO: rc: 1 May 14 21:28:08.260: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:28:09.000: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:28:09.275: INFO: rc: 1 May 14 21:28:09.275: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:28:10.000: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:28:10.280: INFO: rc: 1 May 14 21:28:10.280: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:28:11.002: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:28:11.278: INFO: rc: 1 May 14 21:28:11.278: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:28:12.002: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:28:12.293: INFO: rc: 1 May 14 21:28:12.293: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:28:13.000: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:28:13.287: INFO: rc: 1 May 14 21:28:13.287: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:28:14.000: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:28:14.263: INFO: rc: 1 May 14 21:28:14.263: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:28:15.002: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:28:15.248: INFO: rc: 1 May 14 21:28:15.248: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:28:16.002: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:28:16.269: INFO: rc: 1 May 14 21:28:16.269: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:28:17.002: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:28:17.271: INFO: rc: 1 May 14 21:28:17.271: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:28:18.001: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:28:18.253: INFO: rc: 1 May 14 21:28:18.253: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:28:19.002: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:28:19.256: INFO: rc: 1 May 14 21:28:19.256: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:28:20.002: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:28:20.265: INFO: rc: 1 May 14 21:28:20.265: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:28:21.000: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:28:21.251: INFO: rc: 1 May 14 21:28:21.251: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:28:22.000: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:28:22.271: INFO: rc: 1 May 14 21:28:22.271: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:28:23.001: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:28:23.296: INFO: rc: 1 May 14 21:28:23.296: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:28:24.002: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:28:24.259: INFO: rc: 1 May 14 21:28:24.259: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:28:25.002: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:28:25.258: INFO: rc: 1 May 14 21:28:25.258: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:28:26.001: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:28:26.262: INFO: rc: 1 May 14 21:28:26.262: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:28:27.000: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:28:27.282: INFO: rc: 1 May 14 21:28:27.282: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:28:28.001: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:28:28.252: INFO: rc: 1 May 14 21:28:28.252: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:28:29.001: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:28:29.262: INFO: rc: 1 May 14 21:28:29.262: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:28:30.002: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:28:30.269: INFO: rc: 1 May 14 21:28:30.269: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:28:31.002: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:28:31.265: INFO: rc: 1 May 14 21:28:31.265: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:28:32.002: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:28:32.271: INFO: rc: 1 May 14 21:28:32.271: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:28:33.000: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:28:33.273: INFO: rc: 1 May 14 21:28:33.273: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:28:34.001: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:28:34.279: INFO: rc: 1 May 14 21:28:34.279: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:28:35.001: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:28:35.262: INFO: rc: 1 May 14 21:28:35.262: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:28:36.002: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:28:36.279: INFO: rc: 1 May 14 21:28:36.279: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:28:37.001: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:28:37.284: INFO: rc: 1 May 14 21:28:37.284: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:28:38.000: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:28:38.255: INFO: rc: 1 May 14 21:28:38.255: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:28:39.002: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:28:39.270: INFO: rc: 1 May 14 21:28:39.270: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:28:40.002: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:28:40.261: INFO: rc: 1 May 14 21:28:40.261: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:28:41.001: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:28:41.264: INFO: rc: 1 May 14 21:28:41.265: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:28:42.002: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:28:42.256: INFO: rc: 1 May 14 21:28:42.256: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:28:43.001: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:28:43.293: INFO: rc: 1 May 14 21:28:43.293: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:28:44.000: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:28:44.267: INFO: rc: 1 May 14 21:28:44.267: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:28:45.000: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:28:45.251: INFO: rc: 1 May 14 21:28:45.251: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:28:46.000: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:28:46.268: INFO: rc: 1 May 14 21:28:46.268: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:28:47.000: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:28:47.263: INFO: rc: 1 May 14 21:28:47.263: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:28:48.000: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:28:48.268: INFO: rc: 1 May 14 21:28:48.269: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:28:49.000: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:28:49.274: INFO: rc: 1 May 14 21:28:49.274: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:28:50.000: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:28:50.295: INFO: rc: 1 May 14 21:28:50.295: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:28:51.000: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:28:51.251: INFO: rc: 1 May 14 21:28:51.251: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:28:52.000: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:28:52.257: INFO: rc: 1 May 14 21:28:52.257: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:28:53.000: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:28:53.269: INFO: rc: 1 May 14 21:28:53.269: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:28:54.000: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:28:54.242: INFO: rc: 1 May 14 21:28:54.243: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:28:55.000: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:28:55.267: INFO: rc: 1 May 14 21:28:55.267: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:28:56.000: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:28:56.254: INFO: rc: 1 May 14 21:28:56.254: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:28:57.001: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:28:57.285: INFO: rc: 1 May 14 21:28:57.285: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:28:58.001: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:28:58.287: INFO: rc: 1 May 14 21:28:58.287: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:28:59.001: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:28:59.261: INFO: rc: 1 May 14 21:28:59.261: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:29:00.000: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:29:00.273: INFO: rc: 1 May 14 21:29:00.273: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:29:01.001: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:29:01.259: INFO: rc: 1 May 14 21:29:01.259: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:29:02.000: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:29:02.499: INFO: rc: 1 May 14 21:29:02.499: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:29:03.000: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:29:03.282: INFO: rc: 1 May 14 21:29:03.282: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:29:04.000: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:29:04.261: INFO: rc: 1 May 14 21:29:04.261: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:29:05.001: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:29:05.282: INFO: rc: 1 May 14 21:29:05.282: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:29:06.002: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:29:06.262: INFO: rc: 1 May 14 21:29:06.262: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:29:07.000: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:29:07.268: INFO: rc: 1 May 14 21:29:07.268: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:29:08.001: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:29:08.567: INFO: rc: 1 May 14 21:29:08.567: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:29:09.001: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:29:09.273: INFO: rc: 1 May 14 21:29:09.273: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:29:10.001: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:29:10.257: INFO: rc: 1 May 14 21:29:10.257: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:29:11.002: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:29:11.267: INFO: rc: 1 May 14 21:29:11.267: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:29:12.001: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:29:12.263: INFO: rc: 1 May 14 21:29:12.263: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:29:13.000: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:29:13.285: INFO: rc: 1 May 14 21:29:13.286: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:29:14.000: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:29:14.271: INFO: rc: 1 May 14 21:29:14.271: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:29:15.000: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:29:15.242: INFO: rc: 1 May 14 21:29:15.242: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:29:16.000: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:29:16.494: INFO: rc: 1 May 14 21:29:16.494: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:29:17.000: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:29:17.262: INFO: rc: 1 May 14 21:29:17.262: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:29:18.000: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:29:18.258: INFO: rc: 1 May 14 21:29:18.258: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:29:19.001: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:29:19.390: INFO: rc: 1 May 14 21:29:19.390: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:29:20.000: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:29:20.453: INFO: rc: 1 May 14 21:29:20.453: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:29:21.000: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:29:21.711: INFO: rc: 1 May 14 21:29:21.711: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:29:22.001: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:29:22.595: INFO: rc: 1 May 14 21:29:22.595: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:29:23.001: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:29:23.406: INFO: rc: 1 May 14 21:29:23.406: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:29:24.001: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:29:24.634: INFO: rc: 1 May 14 21:29:24.634: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:29:25.001: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:29:25.386: INFO: rc: 1 May 14 21:29:25.386: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:29:26.000: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:29:26.449: INFO: rc: 1 May 14 21:29:26.449: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:29:27.001: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:29:27.260: INFO: rc: 1 May 14 21:29:27.260: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:29:28.001: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:29:28.263: INFO: rc: 1 May 14 21:29:28.263: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:29:29.002: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:29:29.248: INFO: rc: 1 May 14 21:29:29.248: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:29:30.001: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:29:30.248: INFO: rc: 1 May 14 21:29:30.248: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:29:30.248: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007' May 14 21:29:30.513: INFO: rc: 1 May 14 21:29:30.513: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-2040 exec execpodp9589 -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 31007: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 31007 nc: connect to 10.10.190.207 port 31007 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:29:30.514: FAIL: Unexpected error: <*errors.errorString | 0xc000dcaa20>: { s: "service is not reachable within 2m0s timeout on endpoint 10.10.190.207:31007 over TCP protocol", } service is not reachable within 2m0s timeout on endpoint 10.10.190.207:31007 over TCP protocol occurred Full Stack Trace k8s.io/kubernetes/test/e2e/network.glob..func24.15() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:1760 +0x358 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc003896a80) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc003896a80) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc003896a80, 0x4de37a0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 May 14 21:29:30.515: INFO: Cleaning up the ExternalName to NodePort test service [AfterEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "services-2040". STEP: Found 20 events. May 14 21:29:30.545: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for execpodp9589: { } Scheduled: Successfully assigned services-2040/execpodp9589 to node1 May 14 21:29:30.545: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for externalname-service-8qnzs: { } Scheduled: Successfully assigned services-2040/externalname-service-8qnzs to node1 May 14 21:29:30.545: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for externalname-service-nkx29: { } Scheduled: Successfully assigned services-2040/externalname-service-nkx29 to node2 May 14 21:29:30.545: INFO: At 2021-05-14 21:27:21 +0000 UTC - event for externalname-service: {replication-controller } SuccessfulCreate: Created pod: externalname-service-8qnzs May 14 21:29:30.545: INFO: At 2021-05-14 21:27:21 +0000 UTC - event for externalname-service: {replication-controller } SuccessfulCreate: Created pod: externalname-service-nkx29 May 14 21:29:30.545: INFO: At 2021-05-14 21:27:22 +0000 UTC - event for externalname-service-8qnzs: {multus } AddedInterface: Add eth0 [10.244.3.102/24] May 14 21:29:30.545: INFO: At 2021-05-14 21:27:22 +0000 UTC - event for externalname-service-8qnzs: {kubelet node1} Pulling: Pulling image "k8s.gcr.io/e2e-test-images/agnhost:2.20" May 14 21:29:30.545: INFO: At 2021-05-14 21:27:22 +0000 UTC - event for externalname-service-nkx29: {multus } AddedInterface: Add eth0 [10.244.4.134/24] May 14 21:29:30.545: INFO: At 2021-05-14 21:27:22 +0000 UTC - event for externalname-service-nkx29: {kubelet node2} Pulling: Pulling image "k8s.gcr.io/e2e-test-images/agnhost:2.20" May 14 21:29:30.545: INFO: At 2021-05-14 21:27:23 +0000 UTC - event for externalname-service-8qnzs: {kubelet node1} Started: Started container externalname-service May 14 21:29:30.545: INFO: At 2021-05-14 21:27:23 +0000 UTC - event for externalname-service-8qnzs: {kubelet node1} Created: Created container externalname-service May 14 21:29:30.545: INFO: At 2021-05-14 21:27:23 +0000 UTC - event for externalname-service-8qnzs: {kubelet node1} Pulled: Successfully pulled image "k8s.gcr.io/e2e-test-images/agnhost:2.20" in 514.448671ms May 14 21:29:30.545: INFO: At 2021-05-14 21:27:23 +0000 UTC - event for externalname-service-nkx29: {kubelet node2} Started: Started container externalname-service May 14 21:29:30.545: INFO: At 2021-05-14 21:27:23 +0000 UTC - event for externalname-service-nkx29: {kubelet node2} Pulled: Successfully pulled image "k8s.gcr.io/e2e-test-images/agnhost:2.20" in 509.433116ms May 14 21:29:30.545: INFO: At 2021-05-14 21:27:23 +0000 UTC - event for externalname-service-nkx29: {kubelet node2} Created: Created container externalname-service May 14 21:29:30.545: INFO: At 2021-05-14 21:27:25 +0000 UTC - event for execpodp9589: {kubelet node1} Pulling: Pulling image "k8s.gcr.io/e2e-test-images/agnhost:2.20" May 14 21:29:30.545: INFO: At 2021-05-14 21:27:25 +0000 UTC - event for execpodp9589: {multus } AddedInterface: Add eth0 [10.244.3.103/24] May 14 21:29:30.545: INFO: At 2021-05-14 21:27:26 +0000 UTC - event for execpodp9589: {kubelet node1} Pulled: Successfully pulled image "k8s.gcr.io/e2e-test-images/agnhost:2.20" in 486.094901ms May 14 21:29:30.545: INFO: At 2021-05-14 21:27:26 +0000 UTC - event for execpodp9589: {kubelet node1} Created: Created container agnhost-container May 14 21:29:30.545: INFO: At 2021-05-14 21:27:26 +0000 UTC - event for execpodp9589: {kubelet node1} Started: Started container agnhost-container May 14 21:29:30.547: INFO: POD NODE PHASE GRACE CONDITIONS May 14 21:29:30.547: INFO: execpodp9589 node1 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-05-14 21:27:24 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2021-05-14 21:27:26 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2021-05-14 21:27:26 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-05-14 21:27:24 +0000 UTC }] May 14 21:29:30.547: INFO: externalname-service-8qnzs node1 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-05-14 21:27:21 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2021-05-14 21:27:23 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2021-05-14 21:27:23 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-05-14 21:27:21 +0000 UTC }] May 14 21:29:30.548: INFO: externalname-service-nkx29 node2 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-05-14 21:27:21 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2021-05-14 21:27:24 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2021-05-14 21:27:24 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-05-14 21:27:21 +0000 UTC }] May 14 21:29:30.548: INFO: May 14 21:29:30.551: INFO: Logging node info for node master1 May 14 21:29:30.554: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 8e20012e-a811-456d-9add-2ea316e23700 31010 0 2021-05-14 19:56:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"a6:a3:7b:a0:c9:75"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-14 19:56:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-14 19:56:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-14 19:59:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-05-14 20:06:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234763776 0} {<nil>} 196518324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324599808 0} {<nil>} 195629492Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:02:00 +0000 UTC,LastTransitionTime:2021-05-14 20:02:00 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-14 21:29:27 +0000 UTC,LastTransitionTime:2021-05-14 19:56:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-14 21:29:27 +0000 UTC,LastTransitionTime:2021-05-14 19:56:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-14 21:29:27 +0000 UTC,LastTransitionTime:2021-05-14 19:56:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-14 21:29:27 +0000 UTC,LastTransitionTime:2021-05-14 19:59:09 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a88b162033bc4931ba0342c7f78a28b9,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:ba5ed4e5-a8ef-4986-946f-e7e2d91395d2,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:e3157cfba16d361ffec06306dd0154c7dca1931cbc4569e3c5822e30e311948b tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:a43c7fdd150533238a300ad84ac906e551111f9b57273afcb8781ee675fd23b3 tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 14 21:29:30.555: INFO: Logging kubelet events for node master1 May 14 21:29:30.557: INFO: Logging pods the kubelet thinks is on node master1 May 14 21:29:30.566: INFO: kube-controller-manager-master1 started at 2021-05-14 20:01:22 +0000 UTC (0+1 container statuses recorded) May 14 21:29:30.566: INFO: Container kube-controller-manager ready: true, restart count 2 May 14 21:29:30.566: INFO: kube-flannel-cx7s6 started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 14 21:29:30.566: INFO: Init container install-cni ready: true, restart count 0 May 14 21:29:30.566: INFO: Container kube-flannel ready: true, restart count 1 May 14 21:29:30.566: INFO: node-exporter-nvrxr started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 14 21:29:30.566: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 14 21:29:30.566: INFO: Container node-exporter ready: true, restart count 0 May 14 21:29:30.566: INFO: kube-scheduler-master1 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 14 21:29:30.566: INFO: Container kube-scheduler ready: true, restart count 0 May 14 21:29:30.566: INFO: docker-registry-docker-registry-56cbc7bc58-bjc5h started at 2021-05-14 20:02:43 +0000 UTC (0+2 container statuses recorded) May 14 21:29:30.566: INFO: Container docker-registry ready: true, restart count 0 May 14 21:29:30.566: INFO: Container nginx ready: true, restart count 0 May 14 21:29:30.566: INFO: node-feature-discovery-controller-5bf5c49849-27v77 started at 2021-05-14 20:05:52 +0000 UTC (0+1 container statuses recorded) May 14 21:29:30.566: INFO: Container nfd-controller ready: true, restart count 0 May 14 21:29:30.566: INFO: kube-apiserver-master1 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 14 21:29:30.566: INFO: Container kube-apiserver ready: true, restart count 0 May 14 21:29:30.566: INFO: kube-proxy-v2c76 started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 14 21:29:30.566: INFO: Container kube-proxy ready: true, restart count 2 May 14 21:29:30.566: INFO: kube-multus-ds-amd64-m54v2 started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 14 21:29:30.566: INFO: Container kube-multus ready: true, restart count 1 May 14 21:29:30.566: INFO: coredns-7677f9bb54-mlcmv started at 2021-05-14 19:59:27 +0000 UTC (0+1 container statuses recorded) May 14 21:29:30.566: INFO: Container coredns ready: true, restart count 1 W0514 21:29:30.578798 35 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 14 21:29:30.610: INFO: Latency metrics for node master1 May 14 21:29:30.610: INFO: Logging node info for node master2 May 14 21:29:30.612: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 e8f1881f-5ded-4c6c-b7e6-eb354b7962e2 31009 0 2021-05-14 19:57:04 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"0a:97:9a:eb:9d:a8"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-14 19:57:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-14 19:57:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-14 19:59:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-14 19:59:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234763776 0} {<nil>} 196518324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324599808 0} {<nil>} 195629492Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:02:07 +0000 UTC,LastTransitionTime:2021-05-14 20:02:07 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-14 21:29:27 +0000 UTC,LastTransitionTime:2021-05-14 19:57:04 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-14 21:29:27 +0000 UTC,LastTransitionTime:2021-05-14 19:57:04 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-14 21:29:27 +0000 UTC,LastTransitionTime:2021-05-14 19:57:04 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-14 21:29:27 +0000 UTC,LastTransitionTime:2021-05-14 19:59:09 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:14c4cdd0613041bb923c5f9b84e0bcde,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:9bdca68c-a5fc-48f7-b392-63d2c04d224d,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 14 21:29:30.613: INFO: Logging kubelet events for node master2 May 14 21:29:30.614: INFO: Logging pods the kubelet thinks is on node master2 May 14 21:29:30.621: INFO: kube-multus-ds-amd64-bt5kr started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 14 21:29:30.621: INFO: Container kube-multus ready: true, restart count 1 May 14 21:29:30.621: INFO: dns-autoscaler-5b7b5c9b6f-fgzqp started at 2021-05-14 19:59:30 +0000 UTC (0+1 container statuses recorded) May 14 21:29:30.621: INFO: Container autoscaler ready: true, restart count 2 May 14 21:29:30.621: INFO: node-exporter-gjrtc started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 14 21:29:30.621: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 14 21:29:30.621: INFO: Container node-exporter ready: true, restart count 0 May 14 21:29:30.621: INFO: kube-apiserver-master2 started at 2021-05-14 20:05:10 +0000 UTC (0+1 container statuses recorded) May 14 21:29:30.621: INFO: Container kube-apiserver ready: true, restart count 0 May 14 21:29:30.621: INFO: kube-controller-manager-master2 started at 2021-05-14 20:01:22 +0000 UTC (0+1 container statuses recorded) May 14 21:29:30.621: INFO: Container kube-controller-manager ready: true, restart count 2 May 14 21:29:30.621: INFO: kube-scheduler-master2 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 14 21:29:30.621: INFO: Container kube-scheduler ready: true, restart count 2 May 14 21:29:30.621: INFO: kube-proxy-qcgpm started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 14 21:29:30.621: INFO: Container kube-proxy ready: true, restart count 2 May 14 21:29:30.621: INFO: kube-flannel-fc4sf started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 14 21:29:30.621: INFO: Init container install-cni ready: true, restart count 0 May 14 21:29:30.621: INFO: Container kube-flannel ready: true, restart count 1 W0514 21:29:30.636754 35 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 14 21:29:30.661: INFO: Latency metrics for node master2 May 14 21:29:30.661: INFO: Logging node info for node master3 May 14 21:29:30.665: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 29fd0a5d-1350-4e28-a4cb-b26dd82cd397 30956 0 2021-05-14 19:57:14 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:27:37:b7:ad:a5"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-14 19:57:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-14 19:57:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-14 19:59:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234767872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324603904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:01:03 +0000 UTC,LastTransitionTime:2021-05-14 20:01:03 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-14 21:29:24 +0000 UTC,LastTransitionTime:2021-05-14 19:57:14 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-14 21:29:24 +0000 UTC,LastTransitionTime:2021-05-14 19:57:14 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-14 21:29:24 +0000 UTC,LastTransitionTime:2021-05-14 19:57:14 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-14 21:29:24 +0000 UTC,LastTransitionTime:2021-05-14 20:00:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f3fe601830d34e59967ed389af552f25,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:56dd60e2-98fe-4d87-81d9-95db820e7426,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 14 21:29:30.666: INFO: Logging kubelet events for node master3 May 14 21:29:30.668: INFO: Logging pods the kubelet thinks is on node master3 May 14 21:29:30.676: INFO: kube-flannel-cl8jf started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 14 21:29:30.676: INFO: Init container install-cni ready: true, restart count 0 May 14 21:29:30.676: INFO: Container kube-flannel ready: true, restart count 2 May 14 21:29:30.676: INFO: kube-multus-ds-amd64-hp6bp started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 14 21:29:30.676: INFO: Container kube-multus ready: true, restart count 1 May 14 21:29:30.676: INFO: coredns-7677f9bb54-qhzrv started at 2021-05-14 19:59:32 +0000 UTC (0+1 container statuses recorded) May 14 21:29:30.676: INFO: Container coredns ready: true, restart count 2 May 14 21:29:30.676: INFO: node-exporter-4cgbq started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 14 21:29:30.676: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 14 21:29:30.676: INFO: Container node-exporter ready: true, restart count 0 May 14 21:29:30.676: INFO: kube-controller-manager-master3 started at 2021-05-14 20:00:41 +0000 UTC (0+1 container statuses recorded) May 14 21:29:30.676: INFO: Container kube-controller-manager ready: true, restart count 3 May 14 21:29:30.676: INFO: kube-scheduler-master3 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 14 21:29:30.676: INFO: Container kube-scheduler ready: true, restart count 3 May 14 21:29:30.676: INFO: kube-apiserver-master3 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 14 21:29:30.676: INFO: Container kube-apiserver ready: true, restart count 0 May 14 21:29:30.676: INFO: kube-proxy-2crs2 started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 14 21:29:30.676: INFO: Container kube-proxy ready: true, restart count 1 W0514 21:29:30.690732 35 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 14 21:29:30.720: INFO: Latency metrics for node master3 May 14 21:29:30.720: INFO: Logging node info for node node1 May 14 21:29:30.723: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 5e4c0fba-b5fa-4177-b834-f3e04c846ff3 31004 0 2021-05-14 19:58:21 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ba:ee:c6:a6:52:03"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-14 19:58:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-05-14 19:58:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-14 20:06:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-14 20:08:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-14 20:08:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269633024 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884632576 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:00:44 +0000 UTC,LastTransitionTime:2021-05-14 20:00:44 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-14 21:29:26 +0000 UTC,LastTransitionTime:2021-05-14 19:58:21 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-14 21:29:26 +0000 UTC,LastTransitionTime:2021-05-14 19:58:21 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-14 21:29:26 +0000 UTC,LastTransitionTime:2021-05-14 19:58:21 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-14 21:29:26 +0000 UTC,LastTransitionTime:2021-05-14 20:00:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:4b96d01fdbcb4fadb4a59fca2e1bf368,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:93c238b3-1895-423c-a1aa-193fbcf8b55f,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:869f7b3516c269b43448f1227c57d536e8a4cf723eeef3b5f8b8e224ecbcfd8e localhost:30500/barometer-collectd:stable],SizeBytes:1464261626,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:1002487751,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:ed5c574f653e2a39e784ff322033a2319aafde7366c803a88f20f7a2a8bc1efb opnfv/barometer-collectd:stable],SizeBytes:825413035,},ContainerImage{Names:[localhost:30500/cmk@sha256:f759b012c29126f880575ac543d09301d45f0b2b9d0f5329849ea40e65017dde cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[golang@sha256:1636899c10870ab66c48d960a9df620f4f9e86a0c72fbacf36032d27404e7e6c golang:alpine3.12],SizeBytes:301156062,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:948a93bc3803d61dd66ab49f99d4cc657e87273682aec7dd5955a000fd17a7e5 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392645,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:36553b10a4947067b9fbb7d532951066293a68eae893beba1d9235f7d11a20ad alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 14 21:29:30.724: INFO: Logging kubelet events for node node1 May 14 21:29:30.726: INFO: Logging pods the kubelet thinks is on node node1 May 14 21:29:30.740: INFO: pod-submit-remove-c7145e9c-9a31-4d5e-9250-67965e544bac started at 2021-05-14 21:27:15 +0000 UTC (0+1 container statuses recorded) May 14 21:29:30.740: INFO: Container nginx ready: false, restart count 0 May 14 21:29:30.740: INFO: externalname-service-8qnzs started at 2021-05-14 21:27:21 +0000 UTC (0+1 container statuses recorded) May 14 21:29:30.740: INFO: Container externalname-service ready: true, restart count 0 May 14 21:29:30.740: INFO: kube-flannel-hj8sj started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 14 21:29:30.740: INFO: Init container install-cni ready: true, restart count 0 May 14 21:29:30.740: INFO: Container kube-flannel ready: true, restart count 1 May 14 21:29:30.740: INFO: prometheus-operator-5bb8cb9d8f-4lq8j started at 2021-05-14 20:09:49 +0000 UTC (0+2 container statuses recorded) May 14 21:29:30.740: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 14 21:29:30.740: INFO: Container prometheus-operator ready: true, restart count 0 May 14 21:29:30.740: INFO: downward-api-3c64adfe-8fcd-431c-b626-0e6b20c516e3 started at 2021-05-14 21:27:07 +0000 UTC (0+1 container statuses recorded) May 14 21:29:30.740: INFO: Container dapi-container ready: false, restart count 0 May 14 21:29:30.741: INFO: kube-proxy-l7697 started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 14 21:29:30.741: INFO: Container kube-proxy ready: true, restart count 2 May 14 21:29:30.741: INFO: kube-multus-ds-amd64-jhf4c started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 14 21:29:30.741: INFO: Container kube-multus ready: true, restart count 1 May 14 21:29:30.741: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-bw262 started at 2021-05-14 20:06:38 +0000 UTC (0+1 container statuses recorded) May 14 21:29:30.741: INFO: Container kube-sriovdp ready: true, restart count 0 May 14 21:29:30.741: INFO: collectd-qhp77 started at 2021-05-14 20:15:36 +0000 UTC (0+3 container statuses recorded) May 14 21:29:30.741: INFO: Container collectd ready: true, restart count 0 May 14 21:29:30.741: INFO: Container collectd-exporter ready: true, restart count 0 May 14 21:29:30.741: INFO: Container rbac-proxy ready: true, restart count 0 May 14 21:29:30.741: INFO: nginx-proxy-node1 started at 2021-05-14 20:05:10 +0000 UTC (0+1 container statuses recorded) May 14 21:29:30.741: INFO: Container nginx-proxy ready: true, restart count 2 May 14 21:29:30.741: INFO: cmk-init-discover-node1-g6c6q started at 2021-05-14 20:08:21 +0000 UTC (0+3 container statuses recorded) May 14 21:29:30.741: INFO: Container discover ready: false, restart count 0 May 14 21:29:30.741: INFO: Container init ready: false, restart count 0 May 14 21:29:30.741: INFO: Container install ready: false, restart count 0 May 14 21:29:30.741: INFO: prometheus-k8s-0 started at 2021-05-14 20:09:58 +0000 UTC (0+5 container statuses recorded) May 14 21:29:30.741: INFO: Container custom-metrics-apiserver ready: true, restart count 0 May 14 21:29:30.741: INFO: Container grafana ready: true, restart count 0 May 14 21:29:30.741: INFO: Container prometheus ready: true, restart count 1 May 14 21:29:30.741: INFO: Container prometheus-config-reloader ready: true, restart count 0 May 14 21:29:30.741: INFO: Container rules-configmap-reloader ready: true, restart count 0 May 14 21:29:30.741: INFO: fail-once-local-frcf7 started at 2021-05-14 21:26:40 +0000 UTC (0+1 container statuses recorded) May 14 21:29:30.741: INFO: Container c ready: false, restart count 0 May 14 21:29:30.741: INFO: execpodp9589 started at 2021-05-14 21:27:24 +0000 UTC (0+1 container statuses recorded) May 14 21:29:30.741: INFO: Container agnhost-container ready: true, restart count 0 May 14 21:29:30.741: INFO: kubernetes-metrics-scraper-678c97765c-pqnd6 started at 2021-05-14 19:59:31 +0000 UTC (0+1 container statuses recorded) May 14 21:29:30.741: INFO: Container kubernetes-metrics-scraper ready: true, restart count 1 May 14 21:29:30.741: INFO: node-feature-discovery-worker-nvg9t started at 2021-05-14 20:05:42 +0000 UTC (0+1 container statuses recorded) May 14 21:29:30.741: INFO: Container nfd-worker ready: true, restart count 0 May 14 21:29:30.741: INFO: cmk-9nqjc started at 2021-05-14 20:09:03 +0000 UTC (0+2 container statuses recorded) May 14 21:29:30.741: INFO: Container nodereport ready: true, restart count 0 May 14 21:29:30.741: INFO: Container reconcile ready: true, restart count 0 May 14 21:29:30.741: INFO: node-exporter-r62rn started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 14 21:29:30.741: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 14 21:29:30.741: INFO: Container node-exporter ready: true, restart count 0 W0514 21:29:30.755200 35 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 14 21:29:30.785: INFO: Latency metrics for node node1 May 14 21:29:30.785: INFO: Logging node info for node node2 May 14 21:29:30.788: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 0bae98dc-2ebc-4849-b99e-7780a3bea71e 30995 0 2021-05-14 19:58:22 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"c6:18:ed:95:bb:1a"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-14 19:58:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-05-14 19:58:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-14 20:06:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-14 20:08:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-14 20:08:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269633024 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884632576 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:01:27 +0000 UTC,LastTransitionTime:2021-05-14 20:01:27 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-14 21:29:26 +0000 UTC,LastTransitionTime:2021-05-14 19:58:22 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-14 21:29:26 +0000 UTC,LastTransitionTime:2021-05-14 19:58:22 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-14 21:29:26 +0000 UTC,LastTransitionTime:2021-05-14 19:58:22 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-14 21:29:26 +0000 UTC,LastTransitionTime:2021-05-14 19:59:04 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a3f22fbf9e534ba1819f7a549414a8a6,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:166b6e45-ba8b-4b89-80b0-befc9a0152b8,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:869f7b3516c269b43448f1227c57d536e8a4cf723eeef3b5f8b8e224ecbcfd8e localhost:30500/barometer-collectd:stable],SizeBytes:1464261626,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[localhost:30500/cmk@sha256:f759b012c29126f880575ac543d09301d45f0b2b9d0f5329849ea40e65017dde localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:948a93bc3803d61dd66ab49f99d4cc657e87273682aec7dd5955a000fd17a7e5 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392645,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:e3157cfba16d361ffec06306dd0154c7dca1931cbc4569e3c5822e30e311948b localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:a43c7fdd150533238a300ad84ac906e551111f9b57273afcb8781ee675fd23b3 localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 14 21:29:30.789: INFO: Logging kubelet events for node node2 May 14 21:29:30.791: INFO: Logging pods the kubelet thinks is on node node2 May 14 21:29:30.804: INFO: kube-multus-ds-amd64-n7cb2 started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 14 21:29:30.804: INFO: Container kube-multus ready: true, restart count 1 May 14 21:29:30.804: INFO: kubernetes-dashboard-86c6f9df5b-ndntg started at 2021-05-14 19:59:31 +0000 UTC (0+1 container statuses recorded) May 14 21:29:30.804: INFO: Container kubernetes-dashboard ready: true, restart count 2 May 14 21:29:30.804: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-2c2pw started at 2021-05-14 20:06:38 +0000 UTC (0+1 container statuses recorded) May 14 21:29:30.804: INFO: Container kube-sriovdp ready: true, restart count 0 May 14 21:29:30.804: INFO: liveness-9fa58f7c-ac7d-4238-9615-5e6e86456837 started at 2021-05-14 21:25:39 +0000 UTC (0+1 container statuses recorded) May 14 21:29:30.804: INFO: Container liveness ready: true, restart count 0 May 14 21:29:30.804: INFO: externalname-service-nkx29 started at 2021-05-14 21:27:21 +0000 UTC (0+1 container statuses recorded) May 14 21:29:30.804: INFO: Container externalname-service ready: true, restart count 0 May 14 21:29:30.804: INFO: kube-proxy-t524z started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 14 21:29:30.804: INFO: Container kube-proxy ready: true, restart count 2 May 14 21:29:30.804: INFO: node-feature-discovery-worker-76m6b started at 2021-05-14 20:05:42 +0000 UTC (0+1 container statuses recorded) May 14 21:29:30.804: INFO: Container nfd-worker ready: true, restart count 0 May 14 21:29:30.804: INFO: cmk-d2qwf started at 2021-05-14 20:09:04 +0000 UTC (0+2 container statuses recorded) May 14 21:29:30.804: INFO: Container nodereport ready: true, restart count 0 May 14 21:29:30.804: INFO: Container reconcile ready: true, restart count 0 May 14 21:29:30.804: INFO: ss-0 started at 2021-05-14 21:27:08 +0000 UTC (0+1 container statuses recorded) May 14 21:29:30.804: INFO: Container webserver ready: false, restart count 0 May 14 21:29:30.804: INFO: sample-webhook-deployment-cbccbf6bb-2cb8w started at 2021-05-14 21:29:21 +0000 UTC (0+1 container statuses recorded) May 14 21:29:30.804: INFO: Container sample-webhook ready: true, restart count 0 May 14 21:29:30.804: INFO: nginx-proxy-node2 started at 2021-05-14 20:05:10 +0000 UTC (0+1 container statuses recorded) May 14 21:29:30.804: INFO: Container nginx-proxy ready: true, restart count 2 May 14 21:29:30.804: INFO: cmk-webhook-6c9d5f8578-pjgxh started at 2021-05-14 20:09:04 +0000 UTC (0+1 container statuses recorded) May 14 21:29:30.804: INFO: Container cmk-webhook ready: true, restart count 0 May 14 21:29:30.804: INFO: node-exporter-rnd5f started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 14 21:29:30.804: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 14 21:29:30.804: INFO: Container node-exporter ready: true, restart count 0 May 14 21:29:30.804: INFO: test-rollover-controller-4ds9r started at 2021-05-14 21:24:35 +0000 UTC (0+1 container statuses recorded) May 14 21:29:30.804: INFO: Container httpd ready: false, restart count 0 May 14 21:29:30.804: INFO: projected-volume-1a2260c4-0c64-4c99-80f0-d9700ddbb5b9 started at 2021-05-14 21:27:03 +0000 UTC (0+1 container statuses recorded) May 14 21:29:30.804: INFO: Container projected-all-volume-test ready: false, restart count 0 May 14 21:29:30.804: INFO: kube-flannel-rqcwp started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 14 21:29:30.805: INFO: Init container install-cni ready: true, restart count 1 May 14 21:29:30.805: INFO: Container kube-flannel ready: true, restart count 4 May 14 21:29:30.805: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-l5hlq started at 2021-05-14 20:12:48 +0000 UTC (0+2 container statuses recorded) May 14 21:29:30.805: INFO: Container tas-controller ready: true, restart count 0 May 14 21:29:30.805: INFO: Container tas-extender ready: true, restart count 0 May 14 21:29:30.805: INFO: collectd-xzrgs started at 2021-05-14 20:15:36 +0000 UTC (0+3 container statuses recorded) May 14 21:29:30.805: INFO: Container collectd ready: true, restart count 0 May 14 21:29:30.805: INFO: Container collectd-exporter ready: true, restart count 0 May 14 21:29:30.805: INFO: Container rbac-proxy ready: true, restart count 0 May 14 21:29:30.805: INFO: fail-once-local-vsfv6 started at 2021-05-14 21:26:40 +0000 UTC (0+1 container statuses recorded) May 14 21:29:30.805: INFO: Container c ready: false, restart count 0 May 14 21:29:30.805: INFO: cmk-init-discover-node2-j75ff started at 2021-05-14 20:08:41 +0000 UTC (0+3 container statuses recorded) May 14 21:29:30.805: INFO: Container discover ready: false, restart count 0 May 14 21:29:30.805: INFO: Container init ready: false, restart count 0 May 14 21:29:30.805: INFO: Container install ready: false, restart count 0 W0514 21:29:30.819293 35 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 14 21:29:30.847: INFO: Latency metrics for node node2 May 14 21:29:30.847: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "services-2040" for this suite. [AfterEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:786 /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 May 14 21:34:35.479: Unexpected error: <*errors.errorString | 0xc003d04e10>: { s: "expected pod \"var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46\" success: Gave up after waiting 5m0s for pod \"var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46\" to be \"Succeeded or Failed\"", } expected pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46" success: Gave up after waiting 5m0s for pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46" to be "Succeeded or Failed" occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 {"msg":"FAILED [sig-network] Services should be able to change the type from ExternalName to NodePort [Conformance]","total":-1,"completed":8,"skipped":182,"failed":3,"failures":["[k8s.io] Probing container should be restarted with a exec \"cat /tmp/health\" liveness probe [NodeConformance] [Conformance]","[sig-api-machinery] Secrets should be consumable from pods in env vars [NodeConformance] [Conformance]","[sig-network] Services should be able to change the type from ExternalName to NodePort [Conformance]"]} [BeforeEach] [k8s.io] Variable Expansion /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client May 14 21:29:30.865: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename var-expansion STEP: Waiting for a default service account to be provisioned in namespace [It] should allow substituting values in a container's command [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating a pod to test substitution in container's command May 14 21:29:30.901: INFO: Waiting up to 5m0s for pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46" in namespace "var-expansion-1740" to be "Succeeded or Failed" May 14 21:29:30.905: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 4.162637ms May 14 21:29:32.908: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 2.006899288s May 14 21:29:34.912: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 4.011703554s May 14 21:29:36.917: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 6.016553736s May 14 21:29:38.925: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 8.023958445s May 14 21:29:40.929: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 10.027934133s May 14 21:29:42.933: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 12.031796176s May 14 21:29:44.937: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 14.036226217s May 14 21:29:46.942: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 16.040975848s May 14 21:29:48.947: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 18.046413694s May 14 21:29:50.952: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 20.051242765s May 14 21:29:52.956: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 22.055216087s May 14 21:29:54.959: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 24.05862722s May 14 21:29:56.964: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 26.063438058s May 14 21:29:58.967: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 28.065893485s May 14 21:30:00.970: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 30.069526109s May 14 21:30:02.973: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 32.072567751s May 14 21:30:04.977: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 34.076113051s May 14 21:30:06.983: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 36.082787309s May 14 21:30:08.987: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 38.086558705s May 14 21:30:10.990: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 40.089281714s May 14 21:30:12.993: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 42.092643s May 14 21:30:14.996: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 44.095504117s May 14 21:30:17.000: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 46.098855231s May 14 21:30:19.003: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 48.102126925s May 14 21:30:21.007: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 50.106423272s May 14 21:30:23.010: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 52.109194763s May 14 21:30:25.014: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 54.113564772s May 14 21:30:27.018: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 56.117079133s May 14 21:30:29.021: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 58.120690029s May 14 21:30:31.024: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.123570362s May 14 21:30:33.028: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.127232505s May 14 21:30:35.031: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.130168044s May 14 21:30:37.033: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.132614696s May 14 21:30:39.037: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.135985577s May 14 21:30:41.040: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.139299477s May 14 21:30:43.043: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.142315814s May 14 21:30:45.046: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.145272503s May 14 21:30:47.049: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.148166262s May 14 21:30:49.053: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.152035578s May 14 21:30:51.056: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.155557827s May 14 21:30:53.061: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.159953054s May 14 21:30:55.065: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.164435928s May 14 21:30:57.068: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.167199196s May 14 21:30:59.071: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.170628181s May 14 21:31:01.075: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.174369183s May 14 21:31:03.078: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.177235484s May 14 21:31:05.081: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.179982006s May 14 21:31:07.085: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.183867654s May 14 21:31:09.088: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.187670711s May 14 21:31:11.093: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.191834719s May 14 21:31:13.096: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.195714219s May 14 21:31:15.099: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.19852538s May 14 21:31:17.103: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.202426756s May 14 21:31:19.106: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.205519073s May 14 21:31:21.110: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.20892238s May 14 21:31:23.113: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.212013671s May 14 21:31:25.116: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.215008678s May 14 21:31:27.120: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.218860614s May 14 21:31:29.122: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.221784049s May 14 21:31:31.128: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.227060231s May 14 21:31:33.131: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.230457539s May 14 21:31:35.135: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.234375018s May 14 21:31:37.138: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.237399343s May 14 21:31:39.142: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.241398077s May 14 21:31:41.146: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.245749602s May 14 21:31:43.150: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.248970962s May 14 21:31:45.153: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.252474769s May 14 21:31:47.157: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.255981101s May 14 21:31:49.160: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.258989397s May 14 21:31:51.165: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.264038256s May 14 21:31:53.168: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.266910997s May 14 21:31:55.171: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.270153162s May 14 21:31:57.175: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.273986316s May 14 21:31:59.178: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.276863805s May 14 21:32:01.182: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.281717294s May 14 21:32:03.186: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.285138516s May 14 21:32:05.190: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.289702569s May 14 21:32:07.195: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.294391128s May 14 21:32:09.198: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.297000101s May 14 21:32:11.204: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.302919341s May 14 21:32:13.207: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.305889366s May 14 21:32:15.210: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.309686678s May 14 21:32:17.215: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.313821449s May 14 21:32:19.218: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.317372402s May 14 21:32:21.222: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.320858471s May 14 21:32:23.225: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.324360714s May 14 21:32:25.228: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.326806785s May 14 21:32:27.231: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.330066344s May 14 21:32:29.233: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.332650948s May 14 21:32:31.237: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.336241458s May 14 21:32:33.240: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.339087981s May 14 21:32:35.243: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.342549409s May 14 21:32:37.246: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.345428679s May 14 21:32:39.249: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.348401312s May 14 21:32:41.252: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.350917701s May 14 21:32:43.256: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.35516641s May 14 21:32:45.261: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.360190883s May 14 21:32:47.265: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.364591695s May 14 21:32:49.268: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.367140058s May 14 21:32:51.272: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.370874488s May 14 21:32:53.275: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.37407654s May 14 21:32:55.278: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.376862114s May 14 21:32:57.282: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.380829353s May 14 21:32:59.285: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.38456795s May 14 21:33:01.289: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.388757561s May 14 21:33:03.292: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.391630827s May 14 21:33:05.296: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.39577901s May 14 21:33:07.299: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.398747827s May 14 21:33:09.302: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.401376768s May 14 21:33:11.305: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.404794019s May 14 21:33:13.308: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.407637915s May 14 21:33:15.312: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.411686628s May 14 21:33:17.317: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.415999656s May 14 21:33:19.321: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.419923083s May 14 21:33:21.325: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.423834045s May 14 21:33:23.327: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.426295544s May 14 21:33:25.329: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.428753898s May 14 21:33:27.333: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.432169088s May 14 21:33:29.336: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.434888654s May 14 21:33:31.340: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.438852927s May 14 21:33:33.343: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.44210261s May 14 21:33:35.346: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.445569956s May 14 21:33:37.351: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.449822956s May 14 21:33:39.354: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.453249484s May 14 21:33:41.358: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.457033525s May 14 21:33:43.362: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.460890343s May 14 21:33:45.366: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.464832261s May 14 21:33:47.370: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.468954606s May 14 21:33:49.372: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.471589186s May 14 21:33:51.375: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.474311797s May 14 21:33:53.379: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.478024845s May 14 21:33:55.383: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.48240902s May 14 21:33:57.387: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.486504159s May 14 21:33:59.390: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.489689025s May 14 21:34:01.395: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.493869672s May 14 21:34:03.399: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.498640151s May 14 21:34:05.403: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.502539996s May 14 21:34:07.407: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.50664179s May 14 21:34:09.410: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.509634521s May 14 21:34:11.415: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.513870777s May 14 21:34:13.417: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.516712501s May 14 21:34:15.420: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.519634336s May 14 21:34:17.425: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.523800754s May 14 21:34:19.429: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.527983709s May 14 21:34:21.432: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.531218429s May 14 21:34:23.435: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.534561245s May 14 21:34:25.439: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.53871979s May 14 21:34:27.444: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.543460262s May 14 21:34:29.448: INFO: Pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.547113936s May 14 21:34:31.466: INFO: Failed to get logs from node "node2" pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46" container "dapi-container": the server rejected our request for an unknown reason (get pods var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46) STEP: delete the pod May 14 21:34:31.472: INFO: Waiting for pod var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46 to disappear May 14 21:34:31.474: INFO: Pod var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46 still exists May 14 21:34:33.475: INFO: Waiting for pod var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46 to disappear May 14 21:34:33.478: INFO: Pod var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46 still exists May 14 21:34:35.475: INFO: Waiting for pod var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46 to disappear May 14 21:34:35.478: INFO: Pod var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46 no longer exists May 14 21:34:35.479: FAIL: Unexpected error: <*errors.errorString | 0xc003d04e10>: { s: "expected pod \"var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46\" success: Gave up after waiting 5m0s for pod \"var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46\" to be \"Succeeded or Failed\"", } expected pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46" success: Gave up after waiting 5m0s for pod "var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46" to be "Succeeded or Failed" occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).testContainerOutputMatcher(0xc000460f20, 0x4c85bd2, 0x23, 0xc002cc7400, 0x0, 0xc000fcb1c8, 0x1, 0x1, 0x4de7488) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 +0x1ee k8s.io/kubernetes/test/e2e/framework.(*Framework).TestContainerOutput(...) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:525 k8s.io/kubernetes/test/e2e/common.glob..func9.2() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/expansion.go:79 +0x198 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc003896a80) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc003896a80) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc003896a80, 0x4de37a0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] Variable Expansion /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "var-expansion-1740". STEP: Found 9 events. May 14 21:34:35.484: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46: { } Scheduled: Successfully assigned var-expansion-1740/var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46 to node2 May 14 21:34:35.484: INFO: At 2021-05-14 21:29:32 +0000 UTC - event for var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46: {multus } AddedInterface: Add eth0 [10.244.4.142/24] May 14 21:34:35.484: INFO: At 2021-05-14 21:29:32 +0000 UTC - event for var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46: {kubelet node2} Pulling: Pulling image "docker.io/library/busybox:1.29" May 14 21:34:35.484: INFO: At 2021-05-14 21:29:33 +0000 UTC - event for var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46: {kubelet node2} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit May 14 21:34:35.484: INFO: At 2021-05-14 21:29:33 +0000 UTC - event for var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46: {kubelet node2} Failed: Error: ErrImagePull May 14 21:34:35.484: INFO: At 2021-05-14 21:29:34 +0000 UTC - event for var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46: {kubelet node2} SandboxChanged: Pod sandbox changed, it will be killed and re-created. May 14 21:34:35.484: INFO: At 2021-05-14 21:29:35 +0000 UTC - event for var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46: {multus } AddedInterface: Add eth0 [10.244.4.143/24] May 14 21:34:35.484: INFO: At 2021-05-14 21:29:35 +0000 UTC - event for var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46: {kubelet node2} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" May 14 21:34:35.484: INFO: At 2021-05-14 21:29:35 +0000 UTC - event for var-expansion-4d944dc6-c9cf-425e-9f1b-6a02dd3a3e46: {kubelet node2} Failed: Error: ImagePullBackOff May 14 21:34:35.487: INFO: POD NODE PHASE GRACE CONDITIONS May 14 21:34:35.487: INFO: May 14 21:34:35.492: INFO: Logging node info for node master1 May 14 21:34:35.494: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 8e20012e-a811-456d-9add-2ea316e23700 35486 0 2021-05-14 19:56:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"a6:a3:7b:a0:c9:75"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-14 19:56:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-14 19:56:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-14 19:59:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-05-14 20:06:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234763776 0} {<nil>} 196518324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324599808 0} {<nil>} 195629492Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:02:00 +0000 UTC,LastTransitionTime:2021-05-14 20:02:00 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-14 21:34:28 +0000 UTC,LastTransitionTime:2021-05-14 19:56:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-14 21:34:28 +0000 UTC,LastTransitionTime:2021-05-14 19:56:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-14 21:34:28 +0000 UTC,LastTransitionTime:2021-05-14 19:56:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-14 21:34:28 +0000 UTC,LastTransitionTime:2021-05-14 19:59:09 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a88b162033bc4931ba0342c7f78a28b9,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:ba5ed4e5-a8ef-4986-946f-e7e2d91395d2,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:e3157cfba16d361ffec06306dd0154c7dca1931cbc4569e3c5822e30e311948b tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:a43c7fdd150533238a300ad84ac906e551111f9b57273afcb8781ee675fd23b3 tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 14 21:34:35.495: INFO: Logging kubelet events for node master1 May 14 21:34:35.498: INFO: Logging pods the kubelet thinks is on node master1 May 14 21:34:35.513: INFO: kube-controller-manager-master1 started at 2021-05-14 20:01:22 +0000 UTC (0+1 container statuses recorded) May 14 21:34:35.513: INFO: Container kube-controller-manager ready: true, restart count 2 May 14 21:34:35.513: INFO: kube-flannel-cx7s6 started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 14 21:34:35.513: INFO: Init container install-cni ready: true, restart count 0 May 14 21:34:35.513: INFO: Container kube-flannel ready: true, restart count 1 May 14 21:34:35.513: INFO: node-exporter-nvrxr started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 14 21:34:35.513: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 14 21:34:35.513: INFO: Container node-exporter ready: true, restart count 0 May 14 21:34:35.513: INFO: kube-scheduler-master1 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 14 21:34:35.513: INFO: Container kube-scheduler ready: true, restart count 0 May 14 21:34:35.513: INFO: coredns-7677f9bb54-mlcmv started at 2021-05-14 19:59:27 +0000 UTC (0+1 container statuses recorded) May 14 21:34:35.513: INFO: Container coredns ready: true, restart count 1 May 14 21:34:35.513: INFO: docker-registry-docker-registry-56cbc7bc58-bjc5h started at 2021-05-14 20:02:43 +0000 UTC (0+2 container statuses recorded) May 14 21:34:35.513: INFO: Container docker-registry ready: true, restart count 0 May 14 21:34:35.513: INFO: Container nginx ready: true, restart count 0 May 14 21:34:35.513: INFO: node-feature-discovery-controller-5bf5c49849-27v77 started at 2021-05-14 20:05:52 +0000 UTC (0+1 container statuses recorded) May 14 21:34:35.513: INFO: Container nfd-controller ready: true, restart count 0 May 14 21:34:35.513: INFO: kube-apiserver-master1 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 14 21:34:35.513: INFO: Container kube-apiserver ready: true, restart count 0 May 14 21:34:35.513: INFO: kube-proxy-v2c76 started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 14 21:34:35.513: INFO: Container kube-proxy ready: true, restart count 2 May 14 21:34:35.513: INFO: kube-multus-ds-amd64-m54v2 started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 14 21:34:35.513: INFO: Container kube-multus ready: true, restart count 1 W0514 21:34:35.526796 35 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 14 21:34:35.551: INFO: Latency metrics for node master1 May 14 21:34:35.551: INFO: Logging node info for node master2 May 14 21:34:35.553: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 e8f1881f-5ded-4c6c-b7e6-eb354b7962e2 35485 0 2021-05-14 19:57:04 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"0a:97:9a:eb:9d:a8"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-14 19:57:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-14 19:57:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-14 19:59:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-14 19:59:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234763776 0} {<nil>} 196518324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324599808 0} {<nil>} 195629492Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:02:07 +0000 UTC,LastTransitionTime:2021-05-14 20:02:07 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-14 21:34:28 +0000 UTC,LastTransitionTime:2021-05-14 19:57:04 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-14 21:34:28 +0000 UTC,LastTransitionTime:2021-05-14 19:57:04 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-14 21:34:28 +0000 UTC,LastTransitionTime:2021-05-14 19:57:04 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-14 21:34:28 +0000 UTC,LastTransitionTime:2021-05-14 19:59:09 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:14c4cdd0613041bb923c5f9b84e0bcde,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:9bdca68c-a5fc-48f7-b392-63d2c04d224d,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 14 21:34:35.554: INFO: Logging kubelet events for node master2 May 14 21:34:35.555: INFO: Logging pods the kubelet thinks is on node master2 May 14 21:34:35.569: INFO: dns-autoscaler-5b7b5c9b6f-fgzqp started at 2021-05-14 19:59:30 +0000 UTC (0+1 container statuses recorded) May 14 21:34:35.569: INFO: Container autoscaler ready: true, restart count 2 May 14 21:34:35.569: INFO: node-exporter-gjrtc started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 14 21:34:35.569: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 14 21:34:35.569: INFO: Container node-exporter ready: true, restart count 0 May 14 21:34:35.569: INFO: kube-apiserver-master2 started at 2021-05-14 20:05:10 +0000 UTC (0+1 container statuses recorded) May 14 21:34:35.569: INFO: Container kube-apiserver ready: true, restart count 0 May 14 21:34:35.569: INFO: kube-controller-manager-master2 started at 2021-05-14 20:01:22 +0000 UTC (0+1 container statuses recorded) May 14 21:34:35.569: INFO: Container kube-controller-manager ready: true, restart count 2 May 14 21:34:35.569: INFO: kube-scheduler-master2 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 14 21:34:35.569: INFO: Container kube-scheduler ready: true, restart count 2 May 14 21:34:35.569: INFO: kube-proxy-qcgpm started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 14 21:34:35.569: INFO: Container kube-proxy ready: true, restart count 2 May 14 21:34:35.569: INFO: kube-flannel-fc4sf started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 14 21:34:35.569: INFO: Init container install-cni ready: true, restart count 0 May 14 21:34:35.569: INFO: Container kube-flannel ready: true, restart count 1 May 14 21:34:35.569: INFO: kube-multus-ds-amd64-bt5kr started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 14 21:34:35.569: INFO: Container kube-multus ready: true, restart count 1 W0514 21:34:35.583231 35 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 14 21:34:35.612: INFO: Latency metrics for node master2 May 14 21:34:35.612: INFO: Logging node info for node master3 May 14 21:34:35.614: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 29fd0a5d-1350-4e28-a4cb-b26dd82cd397 35511 0 2021-05-14 19:57:14 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:27:37:b7:ad:a5"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-14 19:57:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-14 19:57:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-14 19:59:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234767872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324603904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:01:03 +0000 UTC,LastTransitionTime:2021-05-14 20:01:03 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-14 21:34:35 +0000 UTC,LastTransitionTime:2021-05-14 19:57:14 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-14 21:34:35 +0000 UTC,LastTransitionTime:2021-05-14 19:57:14 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-14 21:34:35 +0000 UTC,LastTransitionTime:2021-05-14 19:57:14 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-14 21:34:35 +0000 UTC,LastTransitionTime:2021-05-14 20:00:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f3fe601830d34e59967ed389af552f25,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:56dd60e2-98fe-4d87-81d9-95db820e7426,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 14 21:34:35.615: INFO: Logging kubelet events for node master3 May 14 21:34:35.616: INFO: Logging pods the kubelet thinks is on node master3 May 14 21:34:35.631: INFO: kube-proxy-2crs2 started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 14 21:34:35.631: INFO: Container kube-proxy ready: true, restart count 1 May 14 21:34:35.631: INFO: kube-flannel-cl8jf started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 14 21:34:35.631: INFO: Init container install-cni ready: true, restart count 0 May 14 21:34:35.631: INFO: Container kube-flannel ready: true, restart count 2 May 14 21:34:35.631: INFO: kube-multus-ds-amd64-hp6bp started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 14 21:34:35.631: INFO: Container kube-multus ready: true, restart count 1 May 14 21:34:35.631: INFO: coredns-7677f9bb54-qhzrv started at 2021-05-14 19:59:32 +0000 UTC (0+1 container statuses recorded) May 14 21:34:35.631: INFO: Container coredns ready: true, restart count 2 May 14 21:34:35.631: INFO: node-exporter-4cgbq started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 14 21:34:35.631: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 14 21:34:35.631: INFO: Container node-exporter ready: true, restart count 0 May 14 21:34:35.631: INFO: kube-controller-manager-master3 started at 2021-05-14 20:00:41 +0000 UTC (0+1 container statuses recorded) May 14 21:34:35.631: INFO: Container kube-controller-manager ready: true, restart count 3 May 14 21:34:35.631: INFO: kube-scheduler-master3 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 14 21:34:35.631: INFO: Container kube-scheduler ready: true, restart count 3 May 14 21:34:35.631: INFO: kube-apiserver-master3 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 14 21:34:35.631: INFO: Container kube-apiserver ready: true, restart count 0 W0514 21:34:35.644755 35 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 14 21:34:35.668: INFO: Latency metrics for node master3 May 14 21:34:35.668: INFO: Logging node info for node node1 May 14 21:34:35.671: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 5e4c0fba-b5fa-4177-b834-f3e04c846ff3 35487 0 2021-05-14 19:58:21 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ba:ee:c6:a6:52:03"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-14 19:58:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-05-14 19:58:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-14 20:06:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-14 20:08:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-14 20:08:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269633024 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884632576 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:00:44 +0000 UTC,LastTransitionTime:2021-05-14 20:00:44 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-14 21:34:28 +0000 UTC,LastTransitionTime:2021-05-14 19:58:21 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-14 21:34:28 +0000 UTC,LastTransitionTime:2021-05-14 19:58:21 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-14 21:34:28 +0000 UTC,LastTransitionTime:2021-05-14 19:58:21 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-14 21:34:28 +0000 UTC,LastTransitionTime:2021-05-14 20:00:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:4b96d01fdbcb4fadb4a59fca2e1bf368,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:93c238b3-1895-423c-a1aa-193fbcf8b55f,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:869f7b3516c269b43448f1227c57d536e8a4cf723eeef3b5f8b8e224ecbcfd8e localhost:30500/barometer-collectd:stable],SizeBytes:1464261626,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:1002487751,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:ed5c574f653e2a39e784ff322033a2319aafde7366c803a88f20f7a2a8bc1efb opnfv/barometer-collectd:stable],SizeBytes:825413035,},ContainerImage{Names:[localhost:30500/cmk@sha256:f759b012c29126f880575ac543d09301d45f0b2b9d0f5329849ea40e65017dde cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[golang@sha256:1636899c10870ab66c48d960a9df620f4f9e86a0c72fbacf36032d27404e7e6c golang:alpine3.12],SizeBytes:301156062,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:948a93bc3803d61dd66ab49f99d4cc657e87273682aec7dd5955a000fd17a7e5 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392645,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:36553b10a4947067b9fbb7d532951066293a68eae893beba1d9235f7d11a20ad alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 14 21:34:35.671: INFO: Logging kubelet events for node node1 May 14 21:34:35.674: INFO: Logging pods the kubelet thinks is on node node1 May 14 21:34:35.688: INFO: node-exporter-r62rn started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 14 21:34:35.688: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 14 21:34:35.688: INFO: Container node-exporter ready: true, restart count 0 May 14 21:34:35.688: INFO: prometheus-k8s-0 started at 2021-05-14 20:09:58 +0000 UTC (0+5 container statuses recorded) May 14 21:34:35.688: INFO: Container custom-metrics-apiserver ready: true, restart count 0 May 14 21:34:35.688: INFO: Container grafana ready: true, restart count 0 May 14 21:34:35.688: INFO: Container prometheus ready: true, restart count 1 May 14 21:34:35.688: INFO: Container prometheus-config-reloader ready: true, restart count 0 May 14 21:34:35.688: INFO: Container rules-configmap-reloader ready: true, restart count 0 May 14 21:34:35.688: INFO: fail-once-local-frcf7 started at 2021-05-14 21:26:40 +0000 UTC (0+1 container statuses recorded) May 14 21:34:35.688: INFO: Container c ready: false, restart count 0 May 14 21:34:35.688: INFO: kubernetes-metrics-scraper-678c97765c-pqnd6 started at 2021-05-14 19:59:31 +0000 UTC (0+1 container statuses recorded) May 14 21:34:35.688: INFO: Container kubernetes-metrics-scraper ready: true, restart count 1 May 14 21:34:35.688: INFO: node-feature-discovery-worker-nvg9t started at 2021-05-14 20:05:42 +0000 UTC (0+1 container statuses recorded) May 14 21:34:35.688: INFO: Container nfd-worker ready: true, restart count 0 May 14 21:34:35.688: INFO: cmk-9nqjc started at 2021-05-14 20:09:03 +0000 UTC (0+2 container statuses recorded) May 14 21:34:35.688: INFO: Container nodereport ready: true, restart count 0 May 14 21:34:35.688: INFO: Container reconcile ready: true, restart count 0 May 14 21:34:35.688: INFO: test-rolling-update-controller-frh58 started at 2021-05-14 21:30:26 +0000 UTC (0+1 container statuses recorded) May 14 21:34:35.688: INFO: Container httpd ready: false, restart count 0 May 14 21:34:35.688: INFO: kube-flannel-hj8sj started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 14 21:34:35.688: INFO: Init container install-cni ready: true, restart count 0 May 14 21:34:35.688: INFO: Container kube-flannel ready: true, restart count 1 May 14 21:34:35.688: INFO: prometheus-operator-5bb8cb9d8f-4lq8j started at 2021-05-14 20:09:49 +0000 UTC (0+2 container statuses recorded) May 14 21:34:35.688: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 14 21:34:35.688: INFO: Container prometheus-operator ready: true, restart count 0 May 14 21:34:35.688: INFO: collectd-qhp77 started at 2021-05-14 20:15:36 +0000 UTC (0+3 container statuses recorded) May 14 21:34:35.688: INFO: Container collectd ready: true, restart count 0 May 14 21:34:35.688: INFO: Container collectd-exporter ready: true, restart count 0 May 14 21:34:35.688: INFO: Container rbac-proxy ready: true, restart count 0 May 14 21:34:35.688: INFO: kube-proxy-l7697 started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 14 21:34:35.688: INFO: Container kube-proxy ready: true, restart count 2 May 14 21:34:35.688: INFO: kube-multus-ds-amd64-jhf4c started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 14 21:34:35.688: INFO: Container kube-multus ready: true, restart count 1 May 14 21:34:35.688: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-bw262 started at 2021-05-14 20:06:38 +0000 UTC (0+1 container statuses recorded) May 14 21:34:35.688: INFO: Container kube-sriovdp ready: true, restart count 0 May 14 21:34:35.688: INFO: nginx-proxy-node1 started at 2021-05-14 20:05:10 +0000 UTC (0+1 container statuses recorded) May 14 21:34:35.688: INFO: Container nginx-proxy ready: true, restart count 2 May 14 21:34:35.688: INFO: cmk-init-discover-node1-g6c6q started at 2021-05-14 20:08:21 +0000 UTC (0+3 container statuses recorded) May 14 21:34:35.688: INFO: Container discover ready: false, restart count 0 May 14 21:34:35.688: INFO: Container init ready: false, restart count 0 May 14 21:34:35.688: INFO: Container install ready: false, restart count 0 W0514 21:34:35.702134 35 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 14 21:34:35.745: INFO: Latency metrics for node node1 May 14 21:34:35.745: INFO: Logging node info for node node2 May 14 21:34:35.748: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 0bae98dc-2ebc-4849-b99e-7780a3bea71e 35489 0 2021-05-14 19:58:22 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"c6:18:ed:95:bb:1a"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-14 19:58:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-05-14 19:58:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-14 20:06:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-14 20:08:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-14 20:08:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269633024 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884632576 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:01:27 +0000 UTC,LastTransitionTime:2021-05-14 20:01:27 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-14 21:34:29 +0000 UTC,LastTransitionTime:2021-05-14 19:58:22 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-14 21:34:29 +0000 UTC,LastTransitionTime:2021-05-14 19:58:22 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-14 21:34:29 +0000 UTC,LastTransitionTime:2021-05-14 19:58:22 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-14 21:34:29 +0000 UTC,LastTransitionTime:2021-05-14 19:59:04 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a3f22fbf9e534ba1819f7a549414a8a6,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:166b6e45-ba8b-4b89-80b0-befc9a0152b8,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:869f7b3516c269b43448f1227c57d536e8a4cf723eeef3b5f8b8e224ecbcfd8e localhost:30500/barometer-collectd:stable],SizeBytes:1464261626,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[localhost:30500/cmk@sha256:f759b012c29126f880575ac543d09301d45f0b2b9d0f5329849ea40e65017dde localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:948a93bc3803d61dd66ab49f99d4cc657e87273682aec7dd5955a000fd17a7e5 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392645,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:e3157cfba16d361ffec06306dd0154c7dca1931cbc4569e3c5822e30e311948b localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:a43c7fdd150533238a300ad84ac906e551111f9b57273afcb8781ee675fd23b3 localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 14 21:34:35.749: INFO: Logging kubelet events for node node2 May 14 21:34:35.750: INFO: Logging pods the kubelet thinks is on node node2 May 14 21:34:35.764: INFO: nginx-proxy-node2 started at 2021-05-14 20:05:10 +0000 UTC (0+1 container statuses recorded) May 14 21:34:35.764: INFO: Container nginx-proxy ready: true, restart count 2 May 14 21:34:35.764: INFO: test-pod started at 2021-05-14 21:32:10 +0000 UTC (0+1 container statuses recorded) May 14 21:34:35.764: INFO: Container webserver ready: false, restart count 0 May 14 21:34:35.764: INFO: kube-flannel-rqcwp started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 14 21:34:35.764: INFO: Init container install-cni ready: true, restart count 1 May 14 21:34:35.764: INFO: Container kube-flannel ready: true, restart count 4 May 14 21:34:35.764: INFO: node-exporter-rnd5f started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 14 21:34:35.764: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 14 21:34:35.764: INFO: Container node-exporter ready: true, restart count 0 May 14 21:34:35.764: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-l5hlq started at 2021-05-14 20:12:48 +0000 UTC (0+2 container statuses recorded) May 14 21:34:35.764: INFO: Container tas-controller ready: true, restart count 0 May 14 21:34:35.764: INFO: Container tas-extender ready: true, restart count 0 May 14 21:34:35.764: INFO: collectd-xzrgs started at 2021-05-14 20:15:36 +0000 UTC (0+3 container statuses recorded) May 14 21:34:35.764: INFO: Container collectd ready: true, restart count 0 May 14 21:34:35.764: INFO: Container collectd-exporter ready: true, restart count 0 May 14 21:34:35.764: INFO: Container rbac-proxy ready: true, restart count 0 May 14 21:34:35.764: INFO: termination-message-container8932b662-890e-4f4e-906d-98ce498a9ad0 started at 2021-05-14 21:32:12 +0000 UTC (0+1 container statuses recorded) May 14 21:34:35.764: INFO: Container termination-message-container ready: false, restart count 0 May 14 21:34:35.764: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-2c2pw started at 2021-05-14 20:06:38 +0000 UTC (0+1 container statuses recorded) May 14 21:34:35.764: INFO: Container kube-sriovdp ready: true, restart count 0 May 14 21:34:35.764: INFO: var-expansion-3f04b15a-b3ba-4697-b39d-d1c4c590ed85 started at 2021-05-14 21:29:48 +0000 UTC (0+1 container statuses recorded) May 14 21:34:35.764: INFO: Container dapi-container ready: false, restart count 0 May 14 21:34:35.764: INFO: ss-0 started at 2021-05-14 21:27:08 +0000 UTC (0+1 container statuses recorded) May 14 21:34:35.764: INFO: Container webserver ready: false, restart count 0 May 14 21:34:35.764: INFO: node-feature-discovery-worker-76m6b started at 2021-05-14 20:05:42 +0000 UTC (0+1 container statuses recorded) May 14 21:34:35.764: INFO: Container nfd-worker ready: true, restart count 0 May 14 21:34:35.764: INFO: cmk-d2qwf started at 2021-05-14 20:09:04 +0000 UTC (0+2 container statuses recorded) May 14 21:34:35.764: INFO: Container nodereport ready: true, restart count 0 May 14 21:34:35.764: INFO: Container reconcile ready: true, restart count 0 May 14 21:34:35.764: INFO: ss-0 started at 2021-05-14 21:29:44 +0000 UTC (0+1 container statuses recorded) May 14 21:34:35.764: INFO: Container webserver ready: false, restart count 0 May 14 21:34:35.764: INFO: cmk-webhook-6c9d5f8578-pjgxh started at 2021-05-14 20:09:04 +0000 UTC (0+1 container statuses recorded) May 14 21:34:35.764: INFO: Container cmk-webhook ready: true, restart count 0 May 14 21:34:35.764: INFO: termination-message-container11bf89a0-20d3-4fea-ad10-4ed3a2ba10ae started at 2021-05-14 21:31:57 +0000 UTC (0+1 container statuses recorded) May 14 21:34:35.764: INFO: Container termination-message-container ready: false, restart count 0 May 14 21:34:35.764: INFO: cmk-init-discover-node2-j75ff started at 2021-05-14 20:08:41 +0000 UTC (0+3 container statuses recorded) May 14 21:34:35.764: INFO: Container discover ready: false, restart count 0 May 14 21:34:35.764: INFO: Container init ready: false, restart count 0 May 14 21:34:35.764: INFO: Container install ready: false, restart count 0 May 14 21:34:35.764: INFO: fail-once-local-vsfv6 started at 2021-05-14 21:26:40 +0000 UTC (0+1 container statuses recorded) May 14 21:34:35.764: INFO: Container c ready: false, restart count 0 May 14 21:34:35.764: INFO: kubernetes-dashboard-86c6f9df5b-ndntg started at 2021-05-14 19:59:31 +0000 UTC (0+1 container statuses recorded) May 14 21:34:35.764: INFO: Container kubernetes-dashboard ready: true, restart count 2 May 14 21:34:35.764: INFO: kube-proxy-t524z started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 14 21:34:35.764: INFO: Container kube-proxy ready: true, restart count 2 May 14 21:34:35.764: INFO: kube-multus-ds-amd64-n7cb2 started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 14 21:34:35.764: INFO: Container kube-multus ready: true, restart count 1 W0514 21:34:35.777540 35 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 14 21:34:35.815: INFO: Latency metrics for node node2 May 14 21:34:35.815: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "var-expansion-1740" for this suite. /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 May 14 21:37:30.556: Unexpected error: <*errors.errorString | 0xc000c60860>: { s: "service is not reachable within 2m0s timeout on endpoint 10.10.190.207:30822 over TCP protocol", } service is not reachable within 2m0s timeout on endpoint 10.10.190.207:30822 over TCP protocol occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:3511 [BeforeEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client May 14 21:35:18.175: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename services STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:782 [It] should be able to switch session affinity for NodePort service [LinuxOnly] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: creating service in namespace services-4537 STEP: creating service affinity-nodeport-transition in namespace services-4537 STEP: creating replication controller affinity-nodeport-transition in namespace services-4537 I0514 21:35:18.205805 35 runners.go:190] Created replication controller with name: affinity-nodeport-transition, namespace: services-4537, replica count: 3 I0514 21:35:21.256468 35 runners.go:190] affinity-nodeport-transition Pods: 3 out of 3 created, 1 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0514 21:35:24.256640 35 runners.go:190] affinity-nodeport-transition Pods: 3 out of 3 created, 3 running, 0 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady May 14 21:35:24.265: INFO: Creating new exec pod May 14 21:35:29.288: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 affinity-nodeport-transition 80' May 14 21:35:29.559: INFO: stderr: "+ nc -zv -t -w 2 affinity-nodeport-transition 80\nConnection to affinity-nodeport-transition 80 port [tcp/http] succeeded!\n" May 14 21:35:29.560: INFO: stdout: "" May 14 21:35:29.561: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.233.33.133 80' May 14 21:35:29.803: INFO: stderr: "+ nc -zv -t -w 2 10.233.33.133 80\nConnection to 10.233.33.133 80 port [tcp/http] succeeded!\n" May 14 21:35:29.803: INFO: stdout: "" May 14 21:35:29.803: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:35:30.028: INFO: rc: 1 May 14 21:35:30.028: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:35:31.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:35:31.304: INFO: rc: 1 May 14 21:35:31.304: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:35:32.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:35:32.363: INFO: rc: 1 May 14 21:35:32.363: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:35:33.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:35:33.290: INFO: rc: 1 May 14 21:35:33.290: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:35:34.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:35:34.307: INFO: rc: 1 May 14 21:35:34.307: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:35:35.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:35:35.260: INFO: rc: 1 May 14 21:35:35.260: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:35:36.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:35:36.283: INFO: rc: 1 May 14 21:35:36.283: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:35:37.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:35:37.265: INFO: rc: 1 May 14 21:35:37.265: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:35:38.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:35:38.307: INFO: rc: 1 May 14 21:35:38.307: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:35:39.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:35:39.282: INFO: rc: 1 May 14 21:35:39.282: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:35:40.030: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:35:40.298: INFO: rc: 1 May 14 21:35:40.298: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:35:41.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:35:41.292: INFO: rc: 1 May 14 21:35:41.293: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:35:42.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:35:42.308: INFO: rc: 1 May 14 21:35:42.308: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:35:43.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:35:43.321: INFO: rc: 1 May 14 21:35:43.321: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:35:44.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:35:44.295: INFO: rc: 1 May 14 21:35:44.295: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:35:45.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:35:45.297: INFO: rc: 1 May 14 21:35:45.297: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:35:46.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:35:46.323: INFO: rc: 1 May 14 21:35:46.323: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:35:47.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:35:47.301: INFO: rc: 1 May 14 21:35:47.301: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:35:48.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:35:48.295: INFO: rc: 1 May 14 21:35:48.295: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:35:49.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:35:49.309: INFO: rc: 1 May 14 21:35:49.310: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:35:50.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:35:50.285: INFO: rc: 1 May 14 21:35:50.285: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:35:51.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:35:51.305: INFO: rc: 1 May 14 21:35:51.305: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:35:52.030: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:35:52.288: INFO: rc: 1 May 14 21:35:52.288: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:35:53.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:35:53.300: INFO: rc: 1 May 14 21:35:53.300: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:35:54.030: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:35:54.337: INFO: rc: 1 May 14 21:35:54.337: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:35:55.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:35:55.305: INFO: rc: 1 May 14 21:35:55.305: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:35:56.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:35:56.299: INFO: rc: 1 May 14 21:35:56.299: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:35:57.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:35:57.301: INFO: rc: 1 May 14 21:35:57.301: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:35:58.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:35:58.288: INFO: rc: 1 May 14 21:35:58.288: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:35:59.030: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:35:59.298: INFO: rc: 1 May 14 21:35:59.298: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:36:00.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:36:00.297: INFO: rc: 1 May 14 21:36:00.297: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:36:01.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:36:01.300: INFO: rc: 1 May 14 21:36:01.300: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:36:02.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:36:02.284: INFO: rc: 1 May 14 21:36:02.284: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:36:03.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:36:03.303: INFO: rc: 1 May 14 21:36:03.303: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:36:04.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:36:04.313: INFO: rc: 1 May 14 21:36:04.313: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:36:05.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:36:05.298: INFO: rc: 1 May 14 21:36:05.298: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:36:06.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:36:06.293: INFO: rc: 1 May 14 21:36:06.293: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:36:07.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:36:07.307: INFO: rc: 1 May 14 21:36:07.307: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:36:08.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:36:08.305: INFO: rc: 1 May 14 21:36:08.305: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:36:09.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:36:09.289: INFO: rc: 1 May 14 21:36:09.289: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:36:10.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:36:10.309: INFO: rc: 1 May 14 21:36:10.309: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:36:11.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:36:11.315: INFO: rc: 1 May 14 21:36:11.315: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:36:12.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:36:12.301: INFO: rc: 1 May 14 21:36:12.301: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:36:13.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:36:13.313: INFO: rc: 1 May 14 21:36:13.313: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:36:14.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:36:14.321: INFO: rc: 1 May 14 21:36:14.321: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:36:15.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:36:15.313: INFO: rc: 1 May 14 21:36:15.313: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:36:16.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:36:16.291: INFO: rc: 1 May 14 21:36:16.291: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:36:17.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:36:17.309: INFO: rc: 1 May 14 21:36:17.309: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:36:18.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:36:18.300: INFO: rc: 1 May 14 21:36:18.300: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:36:19.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:36:19.290: INFO: rc: 1 May 14 21:36:19.290: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:36:20.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:36:20.319: INFO: rc: 1 May 14 21:36:20.319: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:36:21.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:36:21.297: INFO: rc: 1 May 14 21:36:21.297: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:36:22.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:36:22.270: INFO: rc: 1 May 14 21:36:22.270: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:36:23.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:36:23.302: INFO: rc: 1 May 14 21:36:23.302: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:36:24.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:36:24.285: INFO: rc: 1 May 14 21:36:24.285: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:36:25.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:36:25.309: INFO: rc: 1 May 14 21:36:25.309: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:36:26.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:36:26.288: INFO: rc: 1 May 14 21:36:26.288: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:36:27.028: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:36:27.297: INFO: rc: 1 May 14 21:36:27.297: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:36:28.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:36:28.280: INFO: rc: 1 May 14 21:36:28.280: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:36:29.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:36:29.303: INFO: rc: 1 May 14 21:36:29.303: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:36:30.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:36:30.298: INFO: rc: 1 May 14 21:36:30.298: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:36:31.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:36:31.309: INFO: rc: 1 May 14 21:36:31.309: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:36:32.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:36:32.304: INFO: rc: 1 May 14 21:36:32.304: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:36:33.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:36:33.295: INFO: rc: 1 May 14 21:36:33.295: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:36:34.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:36:34.332: INFO: rc: 1 May 14 21:36:34.332: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:36:35.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:36:35.295: INFO: rc: 1 May 14 21:36:35.295: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:36:36.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:36:36.277: INFO: rc: 1 May 14 21:36:36.277: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:36:37.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:36:37.307: INFO: rc: 1 May 14 21:36:37.307: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:36:38.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:36:38.303: INFO: rc: 1 May 14 21:36:38.303: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:36:39.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:36:39.280: INFO: rc: 1 May 14 21:36:39.280: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:36:40.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:36:40.288: INFO: rc: 1 May 14 21:36:40.288: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:36:41.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:36:41.298: INFO: rc: 1 May 14 21:36:41.298: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:36:42.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:36:42.306: INFO: rc: 1 May 14 21:36:42.306: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:36:43.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:36:43.285: INFO: rc: 1 May 14 21:36:43.285: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:36:44.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:36:44.293: INFO: rc: 1 May 14 21:36:44.293: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:36:45.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:36:45.296: INFO: rc: 1 May 14 21:36:45.296: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:36:46.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:36:46.311: INFO: rc: 1 May 14 21:36:46.311: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:36:47.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:36:47.306: INFO: rc: 1 May 14 21:36:47.307: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:36:48.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:36:48.295: INFO: rc: 1 May 14 21:36:48.295: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:36:49.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:36:49.409: INFO: rc: 1 May 14 21:36:49.409: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:36:50.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:36:50.283: INFO: rc: 1 May 14 21:36:50.283: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:36:51.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:36:51.322: INFO: rc: 1 May 14 21:36:51.322: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:36:52.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:36:52.312: INFO: rc: 1 May 14 21:36:52.312: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:36:53.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:36:53.284: INFO: rc: 1 May 14 21:36:53.284: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:36:54.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:36:54.292: INFO: rc: 1 May 14 21:36:54.292: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:36:55.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:36:55.325: INFO: rc: 1 May 14 21:36:55.325: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:36:56.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:36:56.303: INFO: rc: 1 May 14 21:36:56.304: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:36:57.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:36:57.301: INFO: rc: 1 May 14 21:36:57.301: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:36:58.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:36:58.293: INFO: rc: 1 May 14 21:36:58.293: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:36:59.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:36:59.456: INFO: rc: 1 May 14 21:36:59.456: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:37:00.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:37:00.297: INFO: rc: 1 May 14 21:37:00.297: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:37:01.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:37:01.307: INFO: rc: 1 May 14 21:37:01.307: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:37:02.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:37:02.281: INFO: rc: 1 May 14 21:37:02.281: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:37:03.028: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:37:03.288: INFO: rc: 1 May 14 21:37:03.288: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:37:04.028: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:37:04.302: INFO: rc: 1 May 14 21:37:04.302: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:37:05.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:37:05.288: INFO: rc: 1 May 14 21:37:05.288: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:37:06.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:37:06.283: INFO: rc: 1 May 14 21:37:06.283: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:37:07.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:37:07.285: INFO: rc: 1 May 14 21:37:07.285: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:37:08.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:37:08.289: INFO: rc: 1 May 14 21:37:08.289: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:37:09.030: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:37:09.302: INFO: rc: 1 May 14 21:37:09.302: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:37:10.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:37:10.277: INFO: rc: 1 May 14 21:37:10.277: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:37:11.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:37:11.299: INFO: rc: 1 May 14 21:37:11.299: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:37:12.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:37:12.298: INFO: rc: 1 May 14 21:37:12.298: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:37:13.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:37:13.311: INFO: rc: 1 May 14 21:37:13.311: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:37:14.030: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:37:14.312: INFO: rc: 1 May 14 21:37:14.312: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:37:15.030: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:37:15.606: INFO: rc: 1 May 14 21:37:15.606: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:37:16.030: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:37:16.284: INFO: rc: 1 May 14 21:37:16.284: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:37:17.030: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:37:17.302: INFO: rc: 1 May 14 21:37:17.302: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:37:18.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:37:18.285: INFO: rc: 1 May 14 21:37:18.285: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:37:19.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:37:19.300: INFO: rc: 1 May 14 21:37:19.300: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:37:20.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:37:20.279: INFO: rc: 1 May 14 21:37:20.279: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:37:21.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:37:21.539: INFO: rc: 1 May 14 21:37:21.539: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:37:22.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:37:22.312: INFO: rc: 1 May 14 21:37:22.312: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:37:23.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:37:23.319: INFO: rc: 1 May 14 21:37:23.319: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:37:24.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:37:24.358: INFO: rc: 1 May 14 21:37:24.358: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:37:25.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:37:25.360: INFO: rc: 1 May 14 21:37:25.360: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:37:26.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:37:26.293: INFO: rc: 1 May 14 21:37:26.293: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:37:27.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:37:27.297: INFO: rc: 1 May 14 21:37:27.297: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:37:28.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:37:28.303: INFO: rc: 1 May 14 21:37:28.303: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:37:29.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:37:29.363: INFO: rc: 1 May 14 21:37:29.363: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:37:30.029: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:37:30.285: INFO: rc: 1 May 14 21:37:30.285: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:37:30.285: INFO: Running '/usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822' May 14 21:37:30.556: INFO: rc: 1 May 14 21:37:30.556: INFO: Service reachability failing with error: error running /usr/local/bin/kubectl --kubeconfig=/root/.kube/config --namespace=services-4537 exec execpod-affinitygxlrf -- /bin/sh -x -c nc -zv -t -w 2 10.10.190.207 30822: Command stdout: stderr: + nc -zv -t -w 2 10.10.190.207 30822 nc: connect to 10.10.190.207 port 30822 (tcp) failed: Connection refused command terminated with exit code 1 error: exit status 1 Retrying... May 14 21:37:30.556: FAIL: Unexpected error: <*errors.errorString | 0xc000c60860>: { s: "service is not reachable within 2m0s timeout on endpoint 10.10.190.207:30822 over TCP protocol", } service is not reachable within 2m0s timeout on endpoint 10.10.190.207:30822 over TCP protocol occurred Full Stack Trace k8s.io/kubernetes/test/e2e/network.execAffinityTestForNonLBServiceWithOptionalTransition(0xc00191c000, 0x54075e0, 0xc000850580, 0xc000e32240, 0x1) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:3511 +0x62e k8s.io/kubernetes/test/e2e/network.execAffinityTestForNonLBServiceWithTransition(...) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:3466 k8s.io/kubernetes/test/e2e/network.glob..func24.30() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:2541 +0xa5 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc003896a80) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc003896a80) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc003896a80, 0x4de37a0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 May 14 21:37:30.557: INFO: Cleaning up the exec pod STEP: deleting ReplicationController affinity-nodeport-transition in namespace services-4537, will wait for the garbage collector to delete the pods May 14 21:37:30.634: INFO: Deleting ReplicationController affinity-nodeport-transition took: 5.104585ms May 14 21:37:30.735: INFO: Terminating ReplicationController affinity-nodeport-transition pods took: 100.407429ms [AfterEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "services-4537". STEP: Found 31 events. May 14 21:37:36.154: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for affinity-nodeport-transition-25mlm: { } Scheduled: Successfully assigned services-4537/affinity-nodeport-transition-25mlm to node2 May 14 21:37:36.154: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for affinity-nodeport-transition-6wl4c: { } Scheduled: Successfully assigned services-4537/affinity-nodeport-transition-6wl4c to node2 May 14 21:37:36.154: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for affinity-nodeport-transition-lczlc: { } Scheduled: Successfully assigned services-4537/affinity-nodeport-transition-lczlc to node1 May 14 21:37:36.154: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for execpod-affinitygxlrf: { } Scheduled: Successfully assigned services-4537/execpod-affinitygxlrf to node2 May 14 21:37:36.154: INFO: At 2021-05-14 21:35:18 +0000 UTC - event for affinity-nodeport-transition: {replication-controller } SuccessfulCreate: Created pod: affinity-nodeport-transition-25mlm May 14 21:37:36.154: INFO: At 2021-05-14 21:35:18 +0000 UTC - event for affinity-nodeport-transition: {replication-controller } SuccessfulCreate: Created pod: affinity-nodeport-transition-6wl4c May 14 21:37:36.154: INFO: At 2021-05-14 21:35:18 +0000 UTC - event for affinity-nodeport-transition: {replication-controller } SuccessfulCreate: Created pod: affinity-nodeport-transition-lczlc May 14 21:37:36.154: INFO: At 2021-05-14 21:35:19 +0000 UTC - event for affinity-nodeport-transition-6wl4c: {multus } AddedInterface: Add eth0 [10.244.4.183/24] May 14 21:37:36.154: INFO: At 2021-05-14 21:35:19 +0000 UTC - event for affinity-nodeport-transition-lczlc: {kubelet node1} Pulling: Pulling image "k8s.gcr.io/e2e-test-images/agnhost:2.20" May 14 21:37:36.154: INFO: At 2021-05-14 21:35:19 +0000 UTC - event for affinity-nodeport-transition-lczlc: {multus } AddedInterface: Add eth0 [10.244.3.134/24] May 14 21:37:36.154: INFO: At 2021-05-14 21:35:20 +0000 UTC - event for affinity-nodeport-transition-25mlm: {multus } AddedInterface: Add eth0 [10.244.4.184/24] May 14 21:37:36.154: INFO: At 2021-05-14 21:35:20 +0000 UTC - event for affinity-nodeport-transition-25mlm: {kubelet node2} Pulling: Pulling image "k8s.gcr.io/e2e-test-images/agnhost:2.20" May 14 21:37:36.154: INFO: At 2021-05-14 21:35:20 +0000 UTC - event for affinity-nodeport-transition-6wl4c: {kubelet node2} Pulling: Pulling image "k8s.gcr.io/e2e-test-images/agnhost:2.20" May 14 21:37:36.154: INFO: At 2021-05-14 21:35:20 +0000 UTC - event for affinity-nodeport-transition-6wl4c: {kubelet node2} Created: Created container affinity-nodeport-transition May 14 21:37:36.154: INFO: At 2021-05-14 21:35:20 +0000 UTC - event for affinity-nodeport-transition-6wl4c: {kubelet node2} Pulled: Successfully pulled image "k8s.gcr.io/e2e-test-images/agnhost:2.20" in 515.760272ms May 14 21:37:36.154: INFO: At 2021-05-14 21:35:20 +0000 UTC - event for affinity-nodeport-transition-lczlc: {kubelet node1} Created: Created container affinity-nodeport-transition May 14 21:37:36.154: INFO: At 2021-05-14 21:35:20 +0000 UTC - event for affinity-nodeport-transition-lczlc: {kubelet node1} Started: Started container affinity-nodeport-transition May 14 21:37:36.154: INFO: At 2021-05-14 21:35:20 +0000 UTC - event for affinity-nodeport-transition-lczlc: {kubelet node1} Pulled: Successfully pulled image "k8s.gcr.io/e2e-test-images/agnhost:2.20" in 464.445733ms May 14 21:37:36.154: INFO: At 2021-05-14 21:35:21 +0000 UTC - event for affinity-nodeport-transition-25mlm: {kubelet node2} Created: Created container affinity-nodeport-transition May 14 21:37:36.154: INFO: At 2021-05-14 21:35:21 +0000 UTC - event for affinity-nodeport-transition-25mlm: {kubelet node2} Started: Started container affinity-nodeport-transition May 14 21:37:36.154: INFO: At 2021-05-14 21:35:21 +0000 UTC - event for affinity-nodeport-transition-25mlm: {kubelet node2} Pulled: Successfully pulled image "k8s.gcr.io/e2e-test-images/agnhost:2.20" in 965.37852ms May 14 21:37:36.154: INFO: At 2021-05-14 21:35:21 +0000 UTC - event for affinity-nodeport-transition-6wl4c: {kubelet node2} Started: Started container affinity-nodeport-transition May 14 21:37:36.154: INFO: At 2021-05-14 21:35:25 +0000 UTC - event for execpod-affinitygxlrf: {multus } AddedInterface: Add eth0 [10.244.4.185/24] May 14 21:37:36.154: INFO: At 2021-05-14 21:35:25 +0000 UTC - event for execpod-affinitygxlrf: {kubelet node2} Pulling: Pulling image "k8s.gcr.io/e2e-test-images/agnhost:2.20" May 14 21:37:36.154: INFO: At 2021-05-14 21:35:26 +0000 UTC - event for execpod-affinitygxlrf: {kubelet node2} Started: Started container agnhost-container May 14 21:37:36.155: INFO: At 2021-05-14 21:35:26 +0000 UTC - event for execpod-affinitygxlrf: {kubelet node2} Pulled: Successfully pulled image "k8s.gcr.io/e2e-test-images/agnhost:2.20" in 529.630976ms May 14 21:37:36.155: INFO: At 2021-05-14 21:35:26 +0000 UTC - event for execpod-affinitygxlrf: {kubelet node2} Created: Created container agnhost-container May 14 21:37:36.155: INFO: At 2021-05-14 21:37:30 +0000 UTC - event for affinity-nodeport-transition-25mlm: {kubelet node2} Killing: Stopping container affinity-nodeport-transition May 14 21:37:36.155: INFO: At 2021-05-14 21:37:30 +0000 UTC - event for affinity-nodeport-transition-6wl4c: {kubelet node2} Killing: Stopping container affinity-nodeport-transition May 14 21:37:36.155: INFO: At 2021-05-14 21:37:30 +0000 UTC - event for affinity-nodeport-transition-lczlc: {kubelet node1} Killing: Stopping container affinity-nodeport-transition May 14 21:37:36.155: INFO: At 2021-05-14 21:37:30 +0000 UTC - event for execpod-affinitygxlrf: {kubelet node2} Killing: Stopping container agnhost-container May 14 21:37:36.157: INFO: POD NODE PHASE GRACE CONDITIONS May 14 21:37:36.157: INFO: May 14 21:37:36.161: INFO: Logging node info for node master1 May 14 21:37:36.163: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 8e20012e-a811-456d-9add-2ea316e23700 37175 0 2021-05-14 19:56:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"a6:a3:7b:a0:c9:75"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-14 19:56:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-14 19:56:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-14 19:59:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-05-14 20:06:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234763776 0} {<nil>} 196518324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324599808 0} {<nil>} 195629492Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:02:00 +0000 UTC,LastTransitionTime:2021-05-14 20:02:00 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-14 21:37:29 +0000 UTC,LastTransitionTime:2021-05-14 19:56:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-14 21:37:29 +0000 UTC,LastTransitionTime:2021-05-14 19:56:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-14 21:37:29 +0000 UTC,LastTransitionTime:2021-05-14 19:56:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-14 21:37:29 +0000 UTC,LastTransitionTime:2021-05-14 19:59:09 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a88b162033bc4931ba0342c7f78a28b9,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:ba5ed4e5-a8ef-4986-946f-e7e2d91395d2,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:e3157cfba16d361ffec06306dd0154c7dca1931cbc4569e3c5822e30e311948b tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:a43c7fdd150533238a300ad84ac906e551111f9b57273afcb8781ee675fd23b3 tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 14 21:37:36.164: INFO: Logging kubelet events for node master1 May 14 21:37:36.166: INFO: Logging pods the kubelet thinks is on node master1 May 14 21:37:36.176: INFO: kube-multus-ds-amd64-m54v2 started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 14 21:37:36.176: INFO: Container kube-multus ready: true, restart count 1 May 14 21:37:36.176: INFO: coredns-7677f9bb54-mlcmv started at 2021-05-14 19:59:27 +0000 UTC (0+1 container statuses recorded) May 14 21:37:36.176: INFO: Container coredns ready: true, restart count 1 May 14 21:37:36.176: INFO: docker-registry-docker-registry-56cbc7bc58-bjc5h started at 2021-05-14 20:02:43 +0000 UTC (0+2 container statuses recorded) May 14 21:37:36.176: INFO: Container docker-registry ready: true, restart count 0 May 14 21:37:36.176: INFO: Container nginx ready: true, restart count 0 May 14 21:37:36.176: INFO: node-feature-discovery-controller-5bf5c49849-27v77 started at 2021-05-14 20:05:52 +0000 UTC (0+1 container statuses recorded) May 14 21:37:36.176: INFO: Container nfd-controller ready: true, restart count 0 May 14 21:37:36.176: INFO: kube-apiserver-master1 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 14 21:37:36.176: INFO: Container kube-apiserver ready: true, restart count 0 May 14 21:37:36.176: INFO: kube-proxy-v2c76 started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 14 21:37:36.176: INFO: Container kube-proxy ready: true, restart count 2 May 14 21:37:36.176: INFO: kube-scheduler-master1 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 14 21:37:36.176: INFO: Container kube-scheduler ready: true, restart count 0 May 14 21:37:36.176: INFO: kube-controller-manager-master1 started at 2021-05-14 20:01:22 +0000 UTC (0+1 container statuses recorded) May 14 21:37:36.176: INFO: Container kube-controller-manager ready: true, restart count 2 May 14 21:37:36.176: INFO: kube-flannel-cx7s6 started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 14 21:37:36.176: INFO: Init container install-cni ready: true, restart count 0 May 14 21:37:36.176: INFO: Container kube-flannel ready: true, restart count 1 May 14 21:37:36.176: INFO: node-exporter-nvrxr started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 14 21:37:36.176: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 14 21:37:36.176: INFO: Container node-exporter ready: true, restart count 0 W0514 21:37:36.189728 35 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 14 21:37:36.213: INFO: Latency metrics for node master1 May 14 21:37:36.213: INFO: Logging node info for node master2 May 14 21:37:36.215: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 e8f1881f-5ded-4c6c-b7e6-eb354b7962e2 37168 0 2021-05-14 19:57:04 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"0a:97:9a:eb:9d:a8"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-14 19:57:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-14 19:57:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-14 19:59:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-14 19:59:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234763776 0} {<nil>} 196518324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324599808 0} {<nil>} 195629492Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:02:07 +0000 UTC,LastTransitionTime:2021-05-14 20:02:07 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-14 21:37:28 +0000 UTC,LastTransitionTime:2021-05-14 19:57:04 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-14 21:37:28 +0000 UTC,LastTransitionTime:2021-05-14 19:57:04 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-14 21:37:28 +0000 UTC,LastTransitionTime:2021-05-14 19:57:04 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-14 21:37:28 +0000 UTC,LastTransitionTime:2021-05-14 19:59:09 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:14c4cdd0613041bb923c5f9b84e0bcde,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:9bdca68c-a5fc-48f7-b392-63d2c04d224d,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 14 21:37:36.215: INFO: Logging kubelet events for node master2 May 14 21:37:36.217: INFO: Logging pods the kubelet thinks is on node master2 May 14 21:37:36.225: INFO: kube-multus-ds-amd64-bt5kr started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 14 21:37:36.225: INFO: Container kube-multus ready: true, restart count 1 May 14 21:37:36.225: INFO: dns-autoscaler-5b7b5c9b6f-fgzqp started at 2021-05-14 19:59:30 +0000 UTC (0+1 container statuses recorded) May 14 21:37:36.225: INFO: Container autoscaler ready: true, restart count 2 May 14 21:37:36.225: INFO: node-exporter-gjrtc started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 14 21:37:36.225: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 14 21:37:36.225: INFO: Container node-exporter ready: true, restart count 0 May 14 21:37:36.225: INFO: kube-apiserver-master2 started at 2021-05-14 20:05:10 +0000 UTC (0+1 container statuses recorded) May 14 21:37:36.225: INFO: Container kube-apiserver ready: true, restart count 0 May 14 21:37:36.225: INFO: kube-controller-manager-master2 started at 2021-05-14 20:01:22 +0000 UTC (0+1 container statuses recorded) May 14 21:37:36.225: INFO: Container kube-controller-manager ready: true, restart count 2 May 14 21:37:36.225: INFO: kube-scheduler-master2 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 14 21:37:36.225: INFO: Container kube-scheduler ready: true, restart count 2 May 14 21:37:36.225: INFO: kube-proxy-qcgpm started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 14 21:37:36.225: INFO: Container kube-proxy ready: true, restart count 2 May 14 21:37:36.226: INFO: kube-flannel-fc4sf started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 14 21:37:36.226: INFO: Init container install-cni ready: true, restart count 0 May 14 21:37:36.226: INFO: Container kube-flannel ready: true, restart count 1 W0514 21:37:36.237887 35 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 14 21:37:36.266: INFO: Latency metrics for node master2 May 14 21:37:36.266: INFO: Logging node info for node master3 May 14 21:37:36.269: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 29fd0a5d-1350-4e28-a4cb-b26dd82cd397 37299 0 2021-05-14 19:57:14 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:27:37:b7:ad:a5"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-14 19:57:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-14 19:57:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-14 19:59:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234767872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324603904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:01:03 +0000 UTC,LastTransitionTime:2021-05-14 20:01:03 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-14 21:37:36 +0000 UTC,LastTransitionTime:2021-05-14 19:57:14 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-14 21:37:36 +0000 UTC,LastTransitionTime:2021-05-14 19:57:14 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-14 21:37:36 +0000 UTC,LastTransitionTime:2021-05-14 19:57:14 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-14 21:37:36 +0000 UTC,LastTransitionTime:2021-05-14 20:00:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f3fe601830d34e59967ed389af552f25,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:56dd60e2-98fe-4d87-81d9-95db820e7426,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 14 21:37:36.269: INFO: Logging kubelet events for node master3 May 14 21:37:36.271: INFO: Logging pods the kubelet thinks is on node master3 May 14 21:37:36.279: INFO: node-exporter-4cgbq started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 14 21:37:36.279: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 14 21:37:36.279: INFO: Container node-exporter ready: true, restart count 0 May 14 21:37:36.279: INFO: kube-controller-manager-master3 started at 2021-05-14 20:00:41 +0000 UTC (0+1 container statuses recorded) May 14 21:37:36.279: INFO: Container kube-controller-manager ready: true, restart count 3 May 14 21:37:36.279: INFO: kube-scheduler-master3 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 14 21:37:36.279: INFO: Container kube-scheduler ready: true, restart count 3 May 14 21:37:36.279: INFO: kube-apiserver-master3 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 14 21:37:36.279: INFO: Container kube-apiserver ready: true, restart count 0 May 14 21:37:36.279: INFO: kube-proxy-2crs2 started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 14 21:37:36.279: INFO: Container kube-proxy ready: true, restart count 1 May 14 21:37:36.279: INFO: kube-flannel-cl8jf started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 14 21:37:36.279: INFO: Init container install-cni ready: true, restart count 0 May 14 21:37:36.279: INFO: Container kube-flannel ready: true, restart count 2 May 14 21:37:36.279: INFO: kube-multus-ds-amd64-hp6bp started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 14 21:37:36.279: INFO: Container kube-multus ready: true, restart count 1 May 14 21:37:36.279: INFO: coredns-7677f9bb54-qhzrv started at 2021-05-14 19:59:32 +0000 UTC (0+1 container statuses recorded) May 14 21:37:36.279: INFO: Container coredns ready: true, restart count 2 W0514 21:37:36.293797 35 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 14 21:37:36.318: INFO: Latency metrics for node master3 May 14 21:37:36.318: INFO: Logging node info for node node1 May 14 21:37:36.321: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 5e4c0fba-b5fa-4177-b834-f3e04c846ff3 37181 0 2021-05-14 19:58:21 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ba:ee:c6:a6:52:03"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-14 19:58:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-05-14 19:58:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-14 20:06:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-14 20:08:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-14 20:08:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269633024 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884632576 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:00:44 +0000 UTC,LastTransitionTime:2021-05-14 20:00:44 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-14 21:37:29 +0000 UTC,LastTransitionTime:2021-05-14 19:58:21 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-14 21:37:29 +0000 UTC,LastTransitionTime:2021-05-14 19:58:21 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-14 21:37:29 +0000 UTC,LastTransitionTime:2021-05-14 19:58:21 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-14 21:37:29 +0000 UTC,LastTransitionTime:2021-05-14 20:00:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:4b96d01fdbcb4fadb4a59fca2e1bf368,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:93c238b3-1895-423c-a1aa-193fbcf8b55f,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:869f7b3516c269b43448f1227c57d536e8a4cf723eeef3b5f8b8e224ecbcfd8e localhost:30500/barometer-collectd:stable],SizeBytes:1464261626,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:1002487751,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:ed5c574f653e2a39e784ff322033a2319aafde7366c803a88f20f7a2a8bc1efb opnfv/barometer-collectd:stable],SizeBytes:825413035,},ContainerImage{Names:[localhost:30500/cmk@sha256:f759b012c29126f880575ac543d09301d45f0b2b9d0f5329849ea40e65017dde cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[golang@sha256:1636899c10870ab66c48d960a9df620f4f9e86a0c72fbacf36032d27404e7e6c golang:alpine3.12],SizeBytes:301156062,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:948a93bc3803d61dd66ab49f99d4cc657e87273682aec7dd5955a000fd17a7e5 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392645,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:36553b10a4947067b9fbb7d532951066293a68eae893beba1d9235f7d11a20ad alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 14 21:37:36.322: INFO: Logging kubelet events for node node1 May 14 21:37:36.324: INFO: Logging pods the kubelet thinks is on node node1 May 14 21:37:36.339: INFO: node-exporter-r62rn started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 14 21:37:36.339: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 14 21:37:36.339: INFO: Container node-exporter ready: true, restart count 0 May 14 21:37:36.339: INFO: prometheus-k8s-0 started at 2021-05-14 20:09:58 +0000 UTC (0+5 container statuses recorded) May 14 21:37:36.339: INFO: Container custom-metrics-apiserver ready: true, restart count 0 May 14 21:37:36.339: INFO: Container grafana ready: true, restart count 0 May 14 21:37:36.339: INFO: Container prometheus ready: true, restart count 1 May 14 21:37:36.339: INFO: Container prometheus-config-reloader ready: true, restart count 0 May 14 21:37:36.339: INFO: Container rules-configmap-reloader ready: true, restart count 0 May 14 21:37:36.339: INFO: fail-once-local-frcf7 started at 2021-05-14 21:26:40 +0000 UTC (0+1 container statuses recorded) May 14 21:37:36.339: INFO: Container c ready: false, restart count 0 May 14 21:37:36.339: INFO: netserver-0 started at 2021-05-14 21:37:23 +0000 UTC (0+1 container statuses recorded) May 14 21:37:36.339: INFO: Container webserver ready: false, restart count 0 May 14 21:37:36.339: INFO: kubernetes-metrics-scraper-678c97765c-pqnd6 started at 2021-05-14 19:59:31 +0000 UTC (0+1 container statuses recorded) May 14 21:37:36.339: INFO: Container kubernetes-metrics-scraper ready: true, restart count 1 May 14 21:37:36.339: INFO: node-feature-discovery-worker-nvg9t started at 2021-05-14 20:05:42 +0000 UTC (0+1 container statuses recorded) May 14 21:37:36.339: INFO: Container nfd-worker ready: true, restart count 0 May 14 21:37:36.339: INFO: cmk-9nqjc started at 2021-05-14 20:09:03 +0000 UTC (0+2 container statuses recorded) May 14 21:37:36.339: INFO: Container nodereport ready: true, restart count 0 May 14 21:37:36.339: INFO: Container reconcile ready: true, restart count 0 May 14 21:37:36.339: INFO: kube-flannel-hj8sj started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 14 21:37:36.339: INFO: Init container install-cni ready: true, restart count 0 May 14 21:37:36.339: INFO: Container kube-flannel ready: true, restart count 1 May 14 21:37:36.339: INFO: prometheus-operator-5bb8cb9d8f-4lq8j started at 2021-05-14 20:09:49 +0000 UTC (0+2 container statuses recorded) May 14 21:37:36.339: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 14 21:37:36.339: INFO: Container prometheus-operator ready: true, restart count 0 May 14 21:37:36.339: INFO: collectd-qhp77 started at 2021-05-14 20:15:36 +0000 UTC (0+3 container statuses recorded) May 14 21:37:36.339: INFO: Container collectd ready: true, restart count 0 May 14 21:37:36.339: INFO: Container collectd-exporter ready: true, restart count 0 May 14 21:37:36.339: INFO: Container rbac-proxy ready: true, restart count 0 May 14 21:37:36.339: INFO: simpletest.deployment-5bc74fd66c-w5dv2 started at 2021-05-14 21:37:28 +0000 UTC (0+1 container statuses recorded) May 14 21:37:36.339: INFO: Container nginx ready: false, restart count 0 May 14 21:37:36.339: INFO: test-cleanup-controller-jwtlc started at 2021-05-14 21:37:31 +0000 UTC (0+1 container statuses recorded) May 14 21:37:36.339: INFO: Container httpd ready: false, restart count 0 May 14 21:37:36.339: INFO: kube-proxy-l7697 started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 14 21:37:36.339: INFO: Container kube-proxy ready: true, restart count 2 May 14 21:37:36.339: INFO: kube-multus-ds-amd64-jhf4c started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 14 21:37:36.339: INFO: Container kube-multus ready: true, restart count 1 May 14 21:37:36.339: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-bw262 started at 2021-05-14 20:06:38 +0000 UTC (0+1 container statuses recorded) May 14 21:37:36.339: INFO: Container kube-sriovdp ready: true, restart count 0 May 14 21:37:36.339: INFO: nginx-proxy-node1 started at 2021-05-14 20:05:10 +0000 UTC (0+1 container statuses recorded) May 14 21:37:36.339: INFO: Container nginx-proxy ready: true, restart count 2 May 14 21:37:36.339: INFO: cmk-init-discover-node1-g6c6q started at 2021-05-14 20:08:21 +0000 UTC (0+3 container statuses recorded) May 14 21:37:36.339: INFO: Container discover ready: false, restart count 0 May 14 21:37:36.339: INFO: Container init ready: false, restart count 0 May 14 21:37:36.339: INFO: Container install ready: false, restart count 0 W0514 21:37:36.352991 35 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 14 21:37:36.391: INFO: Latency metrics for node node1 May 14 21:37:36.391: INFO: Logging node info for node node2 May 14 21:37:36.395: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 0bae98dc-2ebc-4849-b99e-7780a3bea71e 37222 0 2021-05-14 19:58:22 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"c6:18:ed:95:bb:1a"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-14 19:58:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-05-14 19:58:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-14 20:06:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-14 20:08:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-14 20:08:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269633024 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884632576 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:01:27 +0000 UTC,LastTransitionTime:2021-05-14 20:01:27 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-14 21:37:31 +0000 UTC,LastTransitionTime:2021-05-14 19:58:22 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-14 21:37:31 +0000 UTC,LastTransitionTime:2021-05-14 19:58:22 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-14 21:37:31 +0000 UTC,LastTransitionTime:2021-05-14 19:58:22 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-14 21:37:31 +0000 UTC,LastTransitionTime:2021-05-14 19:59:04 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a3f22fbf9e534ba1819f7a549414a8a6,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:166b6e45-ba8b-4b89-80b0-befc9a0152b8,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:869f7b3516c269b43448f1227c57d536e8a4cf723eeef3b5f8b8e224ecbcfd8e localhost:30500/barometer-collectd:stable],SizeBytes:1464261626,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[localhost:30500/cmk@sha256:f759b012c29126f880575ac543d09301d45f0b2b9d0f5329849ea40e65017dde localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:948a93bc3803d61dd66ab49f99d4cc657e87273682aec7dd5955a000fd17a7e5 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392645,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:e3157cfba16d361ffec06306dd0154c7dca1931cbc4569e3c5822e30e311948b localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:a43c7fdd150533238a300ad84ac906e551111f9b57273afcb8781ee675fd23b3 localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 14 21:37:36.395: INFO: Logging kubelet events for node node2 May 14 21:37:36.399: INFO: Logging pods the kubelet thinks is on node node2 May 14 21:37:36.413: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-2c2pw started at 2021-05-14 20:06:38 +0000 UTC (0+1 container statuses recorded) May 14 21:37:36.413: INFO: Container kube-sriovdp ready: true, restart count 0 May 14 21:37:36.413: INFO: node-feature-discovery-worker-76m6b started at 2021-05-14 20:05:42 +0000 UTC (0+1 container statuses recorded) May 14 21:37:36.413: INFO: Container nfd-worker ready: true, restart count 0 May 14 21:37:36.413: INFO: cmk-d2qwf started at 2021-05-14 20:09:04 +0000 UTC (0+2 container statuses recorded) May 14 21:37:36.414: INFO: Container nodereport ready: true, restart count 0 May 14 21:37:36.414: INFO: Container reconcile ready: true, restart count 0 May 14 21:37:36.414: INFO: foo-p7v5c started at 2021-05-14 21:37:13 +0000 UTC (0+1 container statuses recorded) May 14 21:37:36.414: INFO: Container c ready: false, restart count 0 May 14 21:37:36.414: INFO: cmk-webhook-6c9d5f8578-pjgxh started at 2021-05-14 20:09:04 +0000 UTC (0+1 container statuses recorded) May 14 21:37:36.414: INFO: Container cmk-webhook ready: true, restart count 0 May 14 21:37:36.414: INFO: busybox-privileged-false-76610a26-a824-43a7-88c8-818b09512eda started at 2021-05-14 21:34:51 +0000 UTC (0+1 container statuses recorded) May 14 21:37:36.414: INFO: Container busybox-privileged-false-76610a26-a824-43a7-88c8-818b09512eda ready: false, restart count 0 May 14 21:37:36.414: INFO: ss-0 started at 2021-05-14 21:29:44 +0000 UTC (0+1 container statuses recorded) May 14 21:37:36.414: INFO: Container webserver ready: false, restart count 0 May 14 21:37:36.414: INFO: netserver-1 started at 2021-05-14 21:37:23 +0000 UTC (0+1 container statuses recorded) May 14 21:37:36.414: INFO: Container webserver ready: false, restart count 0 May 14 21:37:36.414: INFO: cmk-init-discover-node2-j75ff started at 2021-05-14 20:08:41 +0000 UTC (0+3 container statuses recorded) May 14 21:37:36.414: INFO: Container discover ready: false, restart count 0 May 14 21:37:36.414: INFO: Container init ready: false, restart count 0 May 14 21:37:36.414: INFO: Container install ready: false, restart count 0 May 14 21:37:36.414: INFO: fail-once-local-vsfv6 started at 2021-05-14 21:26:40 +0000 UTC (0+1 container statuses recorded) May 14 21:37:36.414: INFO: Container c ready: false, restart count 0 May 14 21:37:36.414: INFO: pod-init-821bd929-f761-4afd-8339-08d366c5fb03 started at 2021-05-14 21:35:31 +0000 UTC (2+1 container statuses recorded) May 14 21:37:36.414: INFO: Init container init1 ready: false, restart count 0 May 14 21:37:36.414: INFO: Init container init2 ready: false, restart count 0 May 14 21:37:36.414: INFO: Container run1 ready: false, restart count 0 May 14 21:37:36.414: INFO: kube-proxy-t524z started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 14 21:37:36.414: INFO: Container kube-proxy ready: true, restart count 2 May 14 21:37:36.414: INFO: kube-multus-ds-amd64-n7cb2 started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 14 21:37:36.414: INFO: Container kube-multus ready: true, restart count 1 May 14 21:37:36.414: INFO: kubernetes-dashboard-86c6f9df5b-ndntg started at 2021-05-14 19:59:31 +0000 UTC (0+1 container statuses recorded) May 14 21:37:36.414: INFO: Container kubernetes-dashboard ready: true, restart count 2 May 14 21:37:36.414: INFO: pod-subpath-test-downwardapi-d2qf started at 2021-05-14 21:37:19 +0000 UTC (0+1 container statuses recorded) May 14 21:37:36.414: INFO: Container test-container-subpath-downwardapi-d2qf ready: true, restart count 0 May 14 21:37:36.414: INFO: nginx-proxy-node2 started at 2021-05-14 20:05:10 +0000 UTC (0+1 container statuses recorded) May 14 21:37:36.414: INFO: Container nginx-proxy ready: true, restart count 2 May 14 21:37:36.414: INFO: foo-sgn27 started at 2021-05-14 21:37:13 +0000 UTC (0+1 container statuses recorded) May 14 21:37:36.414: INFO: Container c ready: false, restart count 0 May 14 21:37:36.414: INFO: kube-flannel-rqcwp started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 14 21:37:36.414: INFO: Init container install-cni ready: true, restart count 1 May 14 21:37:36.414: INFO: Container kube-flannel ready: true, restart count 4 May 14 21:37:36.414: INFO: node-exporter-rnd5f started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 14 21:37:36.414: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 14 21:37:36.414: INFO: Container node-exporter ready: true, restart count 0 May 14 21:37:36.414: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-l5hlq started at 2021-05-14 20:12:48 +0000 UTC (0+2 container statuses recorded) May 14 21:37:36.414: INFO: Container tas-controller ready: true, restart count 0 May 14 21:37:36.414: INFO: Container tas-extender ready: true, restart count 0 May 14 21:37:36.414: INFO: collectd-xzrgs started at 2021-05-14 20:15:36 +0000 UTC (0+3 container statuses recorded) May 14 21:37:36.414: INFO: Container collectd ready: true, restart count 0 May 14 21:37:36.414: INFO: Container collectd-exporter ready: true, restart count 0 May 14 21:37:36.414: INFO: Container rbac-proxy ready: true, restart count 0 May 14 21:37:36.414: INFO: simpletest.deployment-5bc74fd66c-vhlgp started at 2021-05-14 21:37:28 +0000 UTC (0+1 container statuses recorded) May 14 21:37:36.414: INFO: Container nginx ready: false, restart count 0 W0514 21:37:36.426245 35 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 14 21:37:36.457: INFO: Latency metrics for node node2 May 14 21:37:36.457: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "services-4537" for this suite. [AfterEach] [sig-network] Services /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:786 /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 May 14 21:44:05.053: Unexpected error: <*errors.errorString | 0xc004d335f0>: { s: "expected pod \"var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180\" success: Gave up after waiting 5m0s for pod \"var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180\" to be \"Succeeded or Failed\"", } expected pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180" success: Gave up after waiting 5m0s for pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180" to be "Succeeded or Failed" occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 [BeforeEach] [k8s.io] Variable Expansion /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client May 14 21:39:02.435: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename var-expansion STEP: Waiting for a default service account to be provisioned in namespace [It] should allow substituting values in a container's args [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating a pod to test substitution in container's args May 14 21:39:02.467: INFO: Waiting up to 5m0s for pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180" in namespace "var-expansion-8966" to be "Succeeded or Failed" May 14 21:39:02.469: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 1.754566ms May 14 21:39:04.471: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 2.004594255s May 14 21:39:06.475: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 4.007925803s May 14 21:39:08.478: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 6.010919177s May 14 21:39:10.482: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 8.015197411s May 14 21:39:12.486: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 10.019408225s May 14 21:39:14.489: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 12.022664482s May 14 21:39:16.494: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 14.027044086s May 14 21:39:18.499: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 16.031808751s May 14 21:39:20.502: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 18.035668132s May 14 21:39:22.506: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 20.039436298s May 14 21:39:24.509: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 22.042573993s May 14 21:39:26.512: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 24.045706916s May 14 21:39:28.515: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 26.048316366s May 14 21:39:30.518: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 28.050934081s May 14 21:39:32.521: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 30.054074532s May 14 21:39:34.525: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 32.058042832s May 14 21:39:36.527: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 34.060610373s May 14 21:39:38.532: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 36.065621674s May 14 21:39:40.536: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 38.068840392s May 14 21:39:42.539: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 40.072389654s May 14 21:39:44.542: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 42.075104881s May 14 21:39:46.546: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 44.07943938s May 14 21:39:48.550: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 46.082898527s May 14 21:39:50.553: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 48.086281963s May 14 21:39:52.556: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 50.089581795s May 14 21:39:54.559: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 52.092113102s May 14 21:39:56.563: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 54.096697451s May 14 21:39:58.568: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 56.101588156s May 14 21:40:00.572: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 58.104739769s May 14 21:40:02.575: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.108017305s May 14 21:40:04.578: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.110812669s May 14 21:40:06.582: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.114944417s May 14 21:40:08.591: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.124651626s May 14 21:40:10.595: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.127878429s May 14 21:40:12.597: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.130569167s May 14 21:40:14.600: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.133366544s May 14 21:40:16.603: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.136291422s May 14 21:40:18.607: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.139794622s May 14 21:40:20.611: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.143873111s May 14 21:40:22.614: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.147273167s May 14 21:40:24.618: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.150842279s May 14 21:40:26.621: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.154306479s May 14 21:40:28.625: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.157852391s May 14 21:40:30.630: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.163608024s May 14 21:40:32.634: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.16701975s May 14 21:40:34.640: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.173536229s May 14 21:40:36.644: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.17705044s May 14 21:40:38.648: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.180831697s May 14 21:40:40.652: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.185689873s May 14 21:40:42.656: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.188888259s May 14 21:40:44.659: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.192347475s May 14 21:40:46.664: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.196771138s May 14 21:40:48.666: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.199700611s May 14 21:40:50.669: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.202614954s May 14 21:40:52.672: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.205235738s May 14 21:40:54.675: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.208131808s May 14 21:40:56.679: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.211953898s May 14 21:40:58.683: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.216371084s May 14 21:41:00.686: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.219140486s May 14 21:41:02.690: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.223689843s May 14 21:41:04.694: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.226784515s May 14 21:41:06.698: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.230988571s May 14 21:41:08.702: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.234765889s May 14 21:41:10.705: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.238534479s May 14 21:41:12.709: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.241919978s May 14 21:41:14.713: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.245770552s May 14 21:41:16.716: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.249595515s May 14 21:41:18.720: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.253370481s May 14 21:41:20.724: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.257079802s May 14 21:41:22.727: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.260151541s May 14 21:41:24.730: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.263295337s May 14 21:41:26.734: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.266955331s May 14 21:41:28.738: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.270891747s May 14 21:41:30.742: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.275039659s May 14 21:41:32.745: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.27791307s May 14 21:41:34.749: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.281806605s May 14 21:41:36.752: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.285551429s May 14 21:41:38.756: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.289177989s May 14 21:41:40.759: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.292117792s May 14 21:41:42.762: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.294980787s May 14 21:41:44.765: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.298071773s May 14 21:41:46.768: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.301669467s May 14 21:41:48.772: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.304856162s May 14 21:41:50.776: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.308798204s May 14 21:41:52.779: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.312327267s May 14 21:41:54.782: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.315409231s May 14 21:41:56.786: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.319198008s May 14 21:41:58.790: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.323319201s May 14 21:42:00.794: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.326891509s May 14 21:42:02.797: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.330156968s May 14 21:42:04.801: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.334046484s May 14 21:42:06.804: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.337632687s May 14 21:42:08.821: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.354061162s May 14 21:42:10.824: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.357225289s May 14 21:42:12.827: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.360687129s May 14 21:42:14.833: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.365878552s May 14 21:42:16.841: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.374666656s May 14 21:42:18.846: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.379396965s May 14 21:42:20.851: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.384187377s May 14 21:42:22.854: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.387505165s May 14 21:42:24.857: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.390640725s May 14 21:42:26.861: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.393782129s May 14 21:42:28.865: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.397958798s May 14 21:42:30.869: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.402151304s May 14 21:42:32.873: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.405961718s May 14 21:42:34.877: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.410217401s May 14 21:42:36.882: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.414945313s May 14 21:42:38.886: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.418870091s May 14 21:42:40.890: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.423172604s May 14 21:42:42.894: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.427182628s May 14 21:42:44.898: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.431088809s May 14 21:42:46.902: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.435083894s May 14 21:42:48.907: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.439991484s May 14 21:42:50.912: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.444924918s May 14 21:42:52.915: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.448450836s May 14 21:42:54.919: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.452067709s May 14 21:42:56.923: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.456074213s May 14 21:42:58.928: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.460963512s May 14 21:43:00.932: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.464900365s May 14 21:43:02.935: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.468414799s May 14 21:43:04.938: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.471057947s May 14 21:43:06.941: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.474141705s May 14 21:43:08.944: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.477631084s May 14 21:43:10.948: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.481624499s May 14 21:43:12.952: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.485632442s May 14 21:43:14.956: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.489389086s May 14 21:43:16.961: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.494064853s May 14 21:43:18.964: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.496817407s May 14 21:43:20.967: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.50000492s May 14 21:43:22.970: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.503051354s May 14 21:43:24.973: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.505941562s May 14 21:43:26.976: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.509483384s May 14 21:43:28.980: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.512806425s May 14 21:43:30.982: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.515626494s May 14 21:43:32.986: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.519219272s May 14 21:43:34.990: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.523635936s May 14 21:43:36.995: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.528023424s May 14 21:43:38.998: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.53167744s May 14 21:43:41.002: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.535707273s May 14 21:43:43.005: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.53833492s May 14 21:43:45.009: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.542594374s May 14 21:43:47.012: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.545514503s May 14 21:43:49.015: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.548451275s May 14 21:43:51.019: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.551916447s May 14 21:43:53.022: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.554965401s May 14 21:43:55.026: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.558903647s May 14 21:43:57.029: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.561737677s May 14 21:43:59.032: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.565477877s May 14 21:44:01.035: INFO: Pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.568429271s May 14 21:44:03.043: INFO: Failed to get logs from node "node2" pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180" container "dapi-container": the server rejected our request for an unknown reason (get pods var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180) STEP: delete the pod May 14 21:44:03.047: INFO: Waiting for pod var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180 to disappear May 14 21:44:03.049: INFO: Pod var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180 still exists May 14 21:44:05.049: INFO: Waiting for pod var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180 to disappear May 14 21:44:05.052: INFO: Pod var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180 no longer exists May 14 21:44:05.053: FAIL: Unexpected error: <*errors.errorString | 0xc004d335f0>: { s: "expected pod \"var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180\" success: Gave up after waiting 5m0s for pod \"var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180\" to be \"Succeeded or Failed\"", } expected pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180" success: Gave up after waiting 5m0s for pod "var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180" to be "Succeeded or Failed" occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).testContainerOutputMatcher(0xc000460f20, 0x4c7212a, 0x20, 0xc002896800, 0x0, 0xc00526f1c8, 0x1, 0x1, 0x4de7488) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 +0x1ee k8s.io/kubernetes/test/e2e/framework.(*Framework).TestContainerOutput(...) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:525 k8s.io/kubernetes/test/e2e/common.glob..func9.3() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/expansion.go:99 +0x1fb k8s.io/kubernetes/test/e2e.RunE2ETests(0xc003896a80) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc003896a80) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc003896a80, 0x4de37a0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] Variable Expansion /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "var-expansion-8966". STEP: Found 7 events. May 14 21:44:05.057: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180: { } Scheduled: Successfully assigned var-expansion-8966/var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180 to node2 May 14 21:44:05.057: INFO: At 2021-05-14 21:39:04 +0000 UTC - event for var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180: {multus } AddedInterface: Add eth0 [10.244.4.216/24] May 14 21:44:05.057: INFO: At 2021-05-14 21:39:04 +0000 UTC - event for var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180: {kubelet node2} Pulling: Pulling image "docker.io/library/busybox:1.29" May 14 21:44:05.057: INFO: At 2021-05-14 21:39:05 +0000 UTC - event for var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180: {kubelet node2} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit May 14 21:44:05.057: INFO: At 2021-05-14 21:39:05 +0000 UTC - event for var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180: {kubelet node2} Failed: Error: ErrImagePull May 14 21:44:05.057: INFO: At 2021-05-14 21:39:06 +0000 UTC - event for var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180: {kubelet node2} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" May 14 21:44:05.057: INFO: At 2021-05-14 21:39:06 +0000 UTC - event for var-expansion-19c563a1-1d95-4965-85f4-a07dea8b7180: {kubelet node2} Failed: Error: ImagePullBackOff May 14 21:44:05.059: INFO: POD NODE PHASE GRACE CONDITIONS May 14 21:44:05.059: INFO: May 14 21:44:05.063: INFO: Logging node info for node master1 May 14 21:44:05.066: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 8e20012e-a811-456d-9add-2ea316e23700 41334 0 2021-05-14 19:56:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"a6:a3:7b:a0:c9:75"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-14 19:56:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-14 19:56:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-14 19:59:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-05-14 20:06:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234763776 0} {<nil>} 196518324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324599808 0} {<nil>} 195629492Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:02:00 +0000 UTC,LastTransitionTime:2021-05-14 20:02:00 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-14 21:44:00 +0000 UTC,LastTransitionTime:2021-05-14 19:56:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-14 21:44:00 +0000 UTC,LastTransitionTime:2021-05-14 19:56:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-14 21:44:00 +0000 UTC,LastTransitionTime:2021-05-14 19:56:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-14 21:44:00 +0000 UTC,LastTransitionTime:2021-05-14 19:59:09 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a88b162033bc4931ba0342c7f78a28b9,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:ba5ed4e5-a8ef-4986-946f-e7e2d91395d2,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:e3157cfba16d361ffec06306dd0154c7dca1931cbc4569e3c5822e30e311948b tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:a43c7fdd150533238a300ad84ac906e551111f9b57273afcb8781ee675fd23b3 tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 14 21:44:05.066: INFO: Logging kubelet events for node master1 May 14 21:44:05.070: INFO: Logging pods the kubelet thinks is on node master1 May 14 21:44:05.080: INFO: kube-controller-manager-master1 started at 2021-05-14 20:01:22 +0000 UTC (0+1 container statuses recorded) May 14 21:44:05.080: INFO: Container kube-controller-manager ready: true, restart count 2 May 14 21:44:05.080: INFO: kube-flannel-cx7s6 started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 14 21:44:05.080: INFO: Init container install-cni ready: true, restart count 0 May 14 21:44:05.080: INFO: Container kube-flannel ready: true, restart count 1 May 14 21:44:05.080: INFO: node-exporter-nvrxr started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 14 21:44:05.080: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 14 21:44:05.080: INFO: Container node-exporter ready: true, restart count 0 May 14 21:44:05.080: INFO: kube-scheduler-master1 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 14 21:44:05.080: INFO: Container kube-scheduler ready: true, restart count 0 May 14 21:44:05.080: INFO: coredns-7677f9bb54-mlcmv started at 2021-05-14 19:59:27 +0000 UTC (0+1 container statuses recorded) May 14 21:44:05.080: INFO: Container coredns ready: true, restart count 1 May 14 21:44:05.080: INFO: docker-registry-docker-registry-56cbc7bc58-bjc5h started at 2021-05-14 20:02:43 +0000 UTC (0+2 container statuses recorded) May 14 21:44:05.080: INFO: Container docker-registry ready: true, restart count 0 May 14 21:44:05.080: INFO: Container nginx ready: true, restart count 0 May 14 21:44:05.080: INFO: node-feature-discovery-controller-5bf5c49849-27v77 started at 2021-05-14 20:05:52 +0000 UTC (0+1 container statuses recorded) May 14 21:44:05.080: INFO: Container nfd-controller ready: true, restart count 0 May 14 21:44:05.080: INFO: kube-apiserver-master1 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 14 21:44:05.080: INFO: Container kube-apiserver ready: true, restart count 0 May 14 21:44:05.080: INFO: kube-proxy-v2c76 started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 14 21:44:05.080: INFO: Container kube-proxy ready: true, restart count 2 May 14 21:44:05.080: INFO: kube-multus-ds-amd64-m54v2 started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 14 21:44:05.080: INFO: Container kube-multus ready: true, restart count 1 W0514 21:44:05.094118 35 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 14 21:44:05.118: INFO: Latency metrics for node master1 May 14 21:44:05.118: INFO: Logging node info for node master2 May 14 21:44:05.121: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 e8f1881f-5ded-4c6c-b7e6-eb354b7962e2 41332 0 2021-05-14 19:57:04 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"0a:97:9a:eb:9d:a8"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-14 19:57:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-14 19:57:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-14 19:59:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-14 19:59:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234763776 0} {<nil>} 196518324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324599808 0} {<nil>} 195629492Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:02:07 +0000 UTC,LastTransitionTime:2021-05-14 20:02:07 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-14 21:44:00 +0000 UTC,LastTransitionTime:2021-05-14 19:57:04 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-14 21:44:00 +0000 UTC,LastTransitionTime:2021-05-14 19:57:04 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-14 21:44:00 +0000 UTC,LastTransitionTime:2021-05-14 19:57:04 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-14 21:44:00 +0000 UTC,LastTransitionTime:2021-05-14 19:59:09 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:14c4cdd0613041bb923c5f9b84e0bcde,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:9bdca68c-a5fc-48f7-b392-63d2c04d224d,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 14 21:44:05.121: INFO: Logging kubelet events for node master2 May 14 21:44:05.123: INFO: Logging pods the kubelet thinks is on node master2 May 14 21:44:05.131: INFO: node-exporter-gjrtc started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 14 21:44:05.131: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 14 21:44:05.131: INFO: Container node-exporter ready: true, restart count 0 May 14 21:44:05.131: INFO: kube-apiserver-master2 started at 2021-05-14 20:05:10 +0000 UTC (0+1 container statuses recorded) May 14 21:44:05.131: INFO: Container kube-apiserver ready: true, restart count 0 May 14 21:44:05.131: INFO: kube-controller-manager-master2 started at 2021-05-14 20:01:22 +0000 UTC (0+1 container statuses recorded) May 14 21:44:05.131: INFO: Container kube-controller-manager ready: true, restart count 2 May 14 21:44:05.131: INFO: kube-scheduler-master2 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 14 21:44:05.131: INFO: Container kube-scheduler ready: true, restart count 2 May 14 21:44:05.131: INFO: kube-proxy-qcgpm started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 14 21:44:05.131: INFO: Container kube-proxy ready: true, restart count 2 May 14 21:44:05.131: INFO: kube-flannel-fc4sf started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 14 21:44:05.131: INFO: Init container install-cni ready: true, restart count 0 May 14 21:44:05.131: INFO: Container kube-flannel ready: true, restart count 1 May 14 21:44:05.131: INFO: kube-multus-ds-amd64-bt5kr started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 14 21:44:05.131: INFO: Container kube-multus ready: true, restart count 1 May 14 21:44:05.131: INFO: dns-autoscaler-5b7b5c9b6f-fgzqp started at 2021-05-14 19:59:30 +0000 UTC (0+1 container statuses recorded) May 14 21:44:05.131: INFO: Container autoscaler ready: true, restart count 2 W0514 21:44:05.142857 35 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 14 21:44:05.170: INFO: Latency metrics for node master2 May 14 21:44:05.170: INFO: Logging node info for node master3 May 14 21:44:05.173: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 29fd0a5d-1350-4e28-a4cb-b26dd82cd397 41322 0 2021-05-14 19:57:14 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:27:37:b7:ad:a5"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-14 19:57:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-14 19:57:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-14 19:59:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234767872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324603904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:01:03 +0000 UTC,LastTransitionTime:2021-05-14 20:01:03 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-14 21:43:57 +0000 UTC,LastTransitionTime:2021-05-14 19:57:14 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-14 21:43:57 +0000 UTC,LastTransitionTime:2021-05-14 19:57:14 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-14 21:43:57 +0000 UTC,LastTransitionTime:2021-05-14 19:57:14 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-14 21:43:57 +0000 UTC,LastTransitionTime:2021-05-14 20:00:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f3fe601830d34e59967ed389af552f25,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:56dd60e2-98fe-4d87-81d9-95db820e7426,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 14 21:44:05.174: INFO: Logging kubelet events for node master3 May 14 21:44:05.176: INFO: Logging pods the kubelet thinks is on node master3 May 14 21:44:05.184: INFO: kube-scheduler-master3 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 14 21:44:05.184: INFO: Container kube-scheduler ready: true, restart count 3 May 14 21:44:05.184: INFO: kube-apiserver-master3 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 14 21:44:05.184: INFO: Container kube-apiserver ready: true, restart count 0 May 14 21:44:05.184: INFO: kube-proxy-2crs2 started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 14 21:44:05.184: INFO: Container kube-proxy ready: true, restart count 1 May 14 21:44:05.184: INFO: kube-flannel-cl8jf started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 14 21:44:05.184: INFO: Init container install-cni ready: true, restart count 0 May 14 21:44:05.184: INFO: Container kube-flannel ready: true, restart count 2 May 14 21:44:05.184: INFO: kube-multus-ds-amd64-hp6bp started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 14 21:44:05.184: INFO: Container kube-multus ready: true, restart count 1 May 14 21:44:05.184: INFO: coredns-7677f9bb54-qhzrv started at 2021-05-14 19:59:32 +0000 UTC (0+1 container statuses recorded) May 14 21:44:05.184: INFO: Container coredns ready: true, restart count 2 May 14 21:44:05.184: INFO: node-exporter-4cgbq started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 14 21:44:05.184: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 14 21:44:05.184: INFO: Container node-exporter ready: true, restart count 0 May 14 21:44:05.184: INFO: kube-controller-manager-master3 started at 2021-05-14 20:00:41 +0000 UTC (0+1 container statuses recorded) May 14 21:44:05.184: INFO: Container kube-controller-manager ready: true, restart count 3 W0514 21:44:05.198665 35 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 14 21:44:05.229: INFO: Latency metrics for node master3 May 14 21:44:05.229: INFO: Logging node info for node node1 May 14 21:44:05.232: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 5e4c0fba-b5fa-4177-b834-f3e04c846ff3 41340 0 2021-05-14 19:58:21 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ba:ee:c6:a6:52:03"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-14 19:58:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-05-14 19:58:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-14 20:06:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-14 20:08:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-14 20:08:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269633024 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884632576 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:00:44 +0000 UTC,LastTransitionTime:2021-05-14 20:00:44 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-14 21:44:01 +0000 UTC,LastTransitionTime:2021-05-14 19:58:21 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-14 21:44:01 +0000 UTC,LastTransitionTime:2021-05-14 19:58:21 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-14 21:44:01 +0000 UTC,LastTransitionTime:2021-05-14 19:58:21 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-14 21:44:01 +0000 UTC,LastTransitionTime:2021-05-14 20:00:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:4b96d01fdbcb4fadb4a59fca2e1bf368,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:93c238b3-1895-423c-a1aa-193fbcf8b55f,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:869f7b3516c269b43448f1227c57d536e8a4cf723eeef3b5f8b8e224ecbcfd8e localhost:30500/barometer-collectd:stable],SizeBytes:1464261626,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:1002487751,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:ed5c574f653e2a39e784ff322033a2319aafde7366c803a88f20f7a2a8bc1efb opnfv/barometer-collectd:stable],SizeBytes:825413035,},ContainerImage{Names:[localhost:30500/cmk@sha256:f759b012c29126f880575ac543d09301d45f0b2b9d0f5329849ea40e65017dde cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[golang@sha256:1636899c10870ab66c48d960a9df620f4f9e86a0c72fbacf36032d27404e7e6c golang:alpine3.12],SizeBytes:301156062,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:948a93bc3803d61dd66ab49f99d4cc657e87273682aec7dd5955a000fd17a7e5 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392645,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:36553b10a4947067b9fbb7d532951066293a68eae893beba1d9235f7d11a20ad alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 14 21:44:05.233: INFO: Logging kubelet events for node node1 May 14 21:44:05.235: INFO: Logging pods the kubelet thinks is on node node1 May 14 21:44:05.252: INFO: collectd-qhp77 started at 2021-05-14 20:15:36 +0000 UTC (0+3 container statuses recorded) May 14 21:44:05.252: INFO: Container collectd ready: true, restart count 0 May 14 21:44:05.253: INFO: Container collectd-exporter ready: true, restart count 0 May 14 21:44:05.253: INFO: Container rbac-proxy ready: true, restart count 0 May 14 21:44:05.253: INFO: kube-proxy-l7697 started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 14 21:44:05.253: INFO: Container kube-proxy ready: true, restart count 2 May 14 21:44:05.253: INFO: kube-multus-ds-amd64-jhf4c started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 14 21:44:05.253: INFO: Container kube-multus ready: true, restart count 1 May 14 21:44:05.253: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-bw262 started at 2021-05-14 20:06:38 +0000 UTC (0+1 container statuses recorded) May 14 21:44:05.253: INFO: Container kube-sriovdp ready: true, restart count 0 May 14 21:44:05.253: INFO: var-expansion-ed77f241-e337-4a28-b2ef-e2093122ec90 started at 2021-05-14 21:41:55 +0000 UTC (0+1 container statuses recorded) May 14 21:44:05.253: INFO: Container dapi-container ready: false, restart count 0 May 14 21:44:05.253: INFO: nginx-proxy-node1 started at 2021-05-14 20:05:10 +0000 UTC (0+1 container statuses recorded) May 14 21:44:05.253: INFO: Container nginx-proxy ready: true, restart count 2 May 14 21:44:05.253: INFO: cmk-init-discover-node1-g6c6q started at 2021-05-14 20:08:21 +0000 UTC (0+3 container statuses recorded) May 14 21:44:05.253: INFO: Container discover ready: false, restart count 0 May 14 21:44:05.253: INFO: Container init ready: false, restart count 0 May 14 21:44:05.253: INFO: Container install ready: false, restart count 0 May 14 21:44:05.253: INFO: pod-configmaps-a56d2c67-cef4-48ce-9891-bb9c16eefc40 started at 2021-05-14 21:40:34 +0000 UTC (0+1 container statuses recorded) May 14 21:44:05.253: INFO: Container env-test ready: false, restart count 0 May 14 21:44:05.253: INFO: node-exporter-r62rn started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 14 21:44:05.253: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 14 21:44:05.253: INFO: Container node-exporter ready: true, restart count 0 May 14 21:44:05.253: INFO: prometheus-k8s-0 started at 2021-05-14 20:09:58 +0000 UTC (0+5 container statuses recorded) May 14 21:44:05.253: INFO: Container custom-metrics-apiserver ready: true, restart count 0 May 14 21:44:05.253: INFO: Container grafana ready: true, restart count 0 May 14 21:44:05.253: INFO: Container prometheus ready: true, restart count 1 May 14 21:44:05.253: INFO: Container prometheus-config-reloader ready: true, restart count 0 May 14 21:44:05.253: INFO: Container rules-configmap-reloader ready: true, restart count 0 May 14 21:44:05.253: INFO: busybox-readonly-fs95521a0d-8d92-4c39-9efe-8b52e58ebe1f started at 2021-05-14 21:41:45 +0000 UTC (0+1 container statuses recorded) May 14 21:44:05.253: INFO: Container busybox-readonly-fs95521a0d-8d92-4c39-9efe-8b52e58ebe1f ready: false, restart count 0 May 14 21:44:05.253: INFO: kubernetes-metrics-scraper-678c97765c-pqnd6 started at 2021-05-14 19:59:31 +0000 UTC (0+1 container statuses recorded) May 14 21:44:05.253: INFO: Container kubernetes-metrics-scraper ready: true, restart count 1 May 14 21:44:05.253: INFO: node-feature-discovery-worker-nvg9t started at 2021-05-14 20:05:42 +0000 UTC (0+1 container statuses recorded) May 14 21:44:05.253: INFO: Container nfd-worker ready: true, restart count 0 May 14 21:44:05.253: INFO: cmk-9nqjc started at 2021-05-14 20:09:03 +0000 UTC (0+2 container statuses recorded) May 14 21:44:05.253: INFO: Container nodereport ready: true, restart count 0 May 14 21:44:05.253: INFO: Container reconcile ready: true, restart count 0 May 14 21:44:05.253: INFO: busybox-readonly-false-12b78e9f-4ce2-4bc9-a9b9-cece12f17e37 started at 2021-05-14 21:40:32 +0000 UTC (0+1 container statuses recorded) May 14 21:44:05.253: INFO: Container busybox-readonly-false-12b78e9f-4ce2-4bc9-a9b9-cece12f17e37 ready: false, restart count 0 May 14 21:44:05.253: INFO: kube-flannel-hj8sj started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 14 21:44:05.253: INFO: Init container install-cni ready: true, restart count 0 May 14 21:44:05.253: INFO: Container kube-flannel ready: true, restart count 1 May 14 21:44:05.253: INFO: prometheus-operator-5bb8cb9d8f-4lq8j started at 2021-05-14 20:09:49 +0000 UTC (0+2 container statuses recorded) May 14 21:44:05.253: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 14 21:44:05.253: INFO: Container prometheus-operator ready: true, restart count 0 May 14 21:44:05.253: INFO: pod-projected-secrets-f825075b-bc50-4e91-bb4f-76aa0250227b started at 2021-05-14 21:42:59 +0000 UTC (0+3 container statuses recorded) May 14 21:44:05.253: INFO: Container creates-volume-test ready: true, restart count 0 May 14 21:44:05.253: INFO: Container dels-volume-test ready: true, restart count 0 May 14 21:44:05.253: INFO: Container upds-volume-test ready: true, restart count 0 W0514 21:44:05.268558 35 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 14 21:44:05.321: INFO: Latency metrics for node node1 May 14 21:44:05.321: INFO: Logging node info for node node2 May 14 21:44:05.324: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 0bae98dc-2ebc-4849-b99e-7780a3bea71e 41348 0 2021-05-14 19:58:22 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"c6:18:ed:95:bb:1a"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-14 19:58:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-05-14 19:58:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-14 20:06:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-14 20:08:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-14 20:08:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269633024 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884632576 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:01:27 +0000 UTC,LastTransitionTime:2021-05-14 20:01:27 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-14 21:44:04 +0000 UTC,LastTransitionTime:2021-05-14 19:58:22 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-14 21:44:04 +0000 UTC,LastTransitionTime:2021-05-14 19:58:22 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-14 21:44:04 +0000 UTC,LastTransitionTime:2021-05-14 19:58:22 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-14 21:44:04 +0000 UTC,LastTransitionTime:2021-05-14 19:59:04 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a3f22fbf9e534ba1819f7a549414a8a6,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:166b6e45-ba8b-4b89-80b0-befc9a0152b8,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:869f7b3516c269b43448f1227c57d536e8a4cf723eeef3b5f8b8e224ecbcfd8e localhost:30500/barometer-collectd:stable],SizeBytes:1464261626,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[localhost:30500/cmk@sha256:f759b012c29126f880575ac543d09301d45f0b2b9d0f5329849ea40e65017dde localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:948a93bc3803d61dd66ab49f99d4cc657e87273682aec7dd5955a000fd17a7e5 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392645,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:e3157cfba16d361ffec06306dd0154c7dca1931cbc4569e3c5822e30e311948b localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:a43c7fdd150533238a300ad84ac906e551111f9b57273afcb8781ee675fd23b3 localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 14 21:44:05.325: INFO: Logging kubelet events for node node2 May 14 21:44:05.328: INFO: Logging pods the kubelet thinks is on node node2 May 14 21:44:05.341: INFO: foo-p7v5c started at 2021-05-14 21:37:13 +0000 UTC (0+1 container statuses recorded) May 14 21:44:05.341: INFO: Container c ready: false, restart count 0 May 14 21:44:05.341: INFO: node-feature-discovery-worker-76m6b started at 2021-05-14 20:05:42 +0000 UTC (0+1 container statuses recorded) May 14 21:44:05.341: INFO: Container nfd-worker ready: true, restart count 0 May 14 21:44:05.341: INFO: cmk-d2qwf started at 2021-05-14 20:09:04 +0000 UTC (0+2 container statuses recorded) May 14 21:44:05.341: INFO: Container nodereport ready: true, restart count 0 May 14 21:44:05.341: INFO: Container reconcile ready: true, restart count 0 May 14 21:44:05.341: INFO: client-envvars-be50a1fb-b455-4ffc-afa6-853b330836c8 started at 2021-05-14 21:39:26 +0000 UTC (0+1 container statuses recorded) May 14 21:44:05.341: INFO: Container env3cont ready: false, restart count 0 May 14 21:44:05.341: INFO: cmk-webhook-6c9d5f8578-pjgxh started at 2021-05-14 20:09:04 +0000 UTC (0+1 container statuses recorded) May 14 21:44:05.341: INFO: Container cmk-webhook ready: true, restart count 0 May 14 21:44:05.341: INFO: cmk-init-discover-node2-j75ff started at 2021-05-14 20:08:41 +0000 UTC (0+3 container statuses recorded) May 14 21:44:05.341: INFO: Container discover ready: false, restart count 0 May 14 21:44:05.341: INFO: Container init ready: false, restart count 0 May 14 21:44:05.341: INFO: Container install ready: false, restart count 0 May 14 21:44:05.341: INFO: kube-proxy-t524z started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 14 21:44:05.341: INFO: Container kube-proxy ready: true, restart count 2 May 14 21:44:05.341: INFO: kube-multus-ds-amd64-n7cb2 started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 14 21:44:05.341: INFO: Container kube-multus ready: true, restart count 1 May 14 21:44:05.341: INFO: kubernetes-dashboard-86c6f9df5b-ndntg started at 2021-05-14 19:59:31 +0000 UTC (0+1 container statuses recorded) May 14 21:44:05.341: INFO: Container kubernetes-dashboard ready: true, restart count 2 May 14 21:44:05.341: INFO: foo-sgn27 started at 2021-05-14 21:37:13 +0000 UTC (0+1 container statuses recorded) May 14 21:44:05.341: INFO: Container c ready: false, restart count 0 May 14 21:44:05.341: INFO: server-envvars-d9350368-6516-4cd8-b4ef-7d121efaa512 started at 2021-05-14 21:39:22 +0000 UTC (0+1 container statuses recorded) May 14 21:44:05.341: INFO: Container srv ready: true, restart count 0 May 14 21:44:05.341: INFO: nginx-proxy-node2 started at 2021-05-14 20:05:10 +0000 UTC (0+1 container statuses recorded) May 14 21:44:05.341: INFO: Container nginx-proxy ready: true, restart count 2 May 14 21:44:05.341: INFO: kube-flannel-rqcwp started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 14 21:44:05.341: INFO: Init container install-cni ready: true, restart count 1 May 14 21:44:05.341: INFO: Container kube-flannel ready: true, restart count 4 May 14 21:44:05.341: INFO: node-exporter-rnd5f started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 14 21:44:05.341: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 14 21:44:05.341: INFO: Container node-exporter ready: true, restart count 0 May 14 21:44:05.341: INFO: var-expansion-e55b542c-ffbb-44db-b637-ad22cd1cd7e2 started at 2021-05-14 21:42:06 +0000 UTC (0+1 container statuses recorded) May 14 21:44:05.341: INFO: Container dapi-container ready: false, restart count 0 May 14 21:44:05.341: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-l5hlq started at 2021-05-14 20:12:48 +0000 UTC (0+2 container statuses recorded) May 14 21:44:05.341: INFO: Container tas-controller ready: true, restart count 0 May 14 21:44:05.341: INFO: Container tas-extender ready: true, restart count 0 May 14 21:44:05.341: INFO: collectd-xzrgs started at 2021-05-14 20:15:36 +0000 UTC (0+3 container statuses recorded) May 14 21:44:05.341: INFO: Container collectd ready: true, restart count 0 May 14 21:44:05.341: INFO: Container collectd-exporter ready: true, restart count 0 May 14 21:44:05.341: INFO: Container rbac-proxy ready: true, restart count 0 May 14 21:44:05.341: INFO: pod-configmaps-8693fdcb-51a7-41e3-ad1a-8e0cd6f34b34 started at 2021-05-14 21:42:52 +0000 UTC (0+2 container statuses recorded) May 14 21:44:05.341: INFO: Container configmap-volume-binary-test ready: false, restart count 0 May 14 21:44:05.341: INFO: Container configmap-volume-data-test ready: true, restart count 0 May 14 21:44:05.341: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-2c2pw started at 2021-05-14 20:06:38 +0000 UTC (0+1 container statuses recorded) May 14 21:44:05.341: INFO: Container kube-sriovdp ready: true, restart count 0 W0514 21:44:05.353633 35 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 14 21:44:05.399: INFO: Latency metrics for node node2 May 14 21:44:05.399: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "var-expansion-8966" for this suite. /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 May 14 21:49:05.500: Timed out after 300.001s. Expected <*errors.errorString | 0xc0044a1240>: { s: "expected state to be terminated. Got pod status: {Phase:Pending Conditions:[{Type:Initialized Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2021-05-14 21:44:05 +0000 UTC Reason: Message:} {Type:Ready Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2021-05-14 21:44:05 +0000 UTC Reason:ContainersNotReady Message:containers with unready status: [bin-false64bba80c-7f39-4f30-a569-40153ab9c0b9]} {Type:ContainersReady Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2021-05-14 21:44:05 +0000 UTC Reason:ContainersNotReady Message:containers with unready status: [bin-false64bba80c-7f39-4f30-a569-40153ab9c0b9]} {Type:PodScheduled Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2021-05-14 21:44:05 +0000 UTC Reason: Message:}] Message: Reason: NominatedNodeName: HostIP:10.10.190.207 PodIP:10.244.3.177 PodIPs:[{IP:10.244.3.177}] StartTime:2021-05-14 21:44:05 +0000 UTC InitContainerStatuses:[] ContainerStatuses:[{Name:bin-false64bba80c-7f39-4f30-a569-40153ab9c0b9 State:{Waiting:&ContainerStateWaiting{Reason:ImagePullBackOff,Message:Back-off pulling image \"docker.io/library/busybox:1.29\",} Running:nil Terminated:nil} LastTerminationState:{Waiting:nil Running:nil Terminated:nil} Ready:false RestartCount:0 Image:docker.io/library/busybox:1.29 ImageID: ContainerID: Started:0xc001f219ec}] QOSClass:BestEffort EphemeralContainerStatuses:[]}", } to be nil /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/kubelet.go:124 [BeforeEach] [k8s.io] Kubelet /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client May 14 21:44:05.462: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename kubelet-test STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [k8s.io] Kubelet /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/kubelet.go:38 [BeforeEach] when scheduling a busybox command that always fails in a pod /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/kubelet.go:82 [It] should have an terminated reason [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 May 14 21:49:05.500: FAIL: Timed out after 300.001s. Expected <*errors.errorString | 0xc0044a1240>: { s: "expected state to be terminated. Got pod status: {Phase:Pending Conditions:[{Type:Initialized Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2021-05-14 21:44:05 +0000 UTC Reason: Message:} {Type:Ready Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2021-05-14 21:44:05 +0000 UTC Reason:ContainersNotReady Message:containers with unready status: [bin-false64bba80c-7f39-4f30-a569-40153ab9c0b9]} {Type:ContainersReady Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2021-05-14 21:44:05 +0000 UTC Reason:ContainersNotReady Message:containers with unready status: [bin-false64bba80c-7f39-4f30-a569-40153ab9c0b9]} {Type:PodScheduled Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2021-05-14 21:44:05 +0000 UTC Reason: Message:}] Message: Reason: NominatedNodeName: HostIP:10.10.190.207 PodIP:10.244.3.177 PodIPs:[{IP:10.244.3.177}] StartTime:2021-05-14 21:44:05 +0000 UTC InitContainerStatuses:[] ContainerStatuses:[{Name:bin-false64bba80c-7f39-4f30-a569-40153ab9c0b9 State:{Waiting:&ContainerStateWaiting{Reason:ImagePullBackOff,Message:Back-off pulling image \"docker.io/library/busybox:1.29\",} Running:nil Terminated:nil} LastTerminationState:{Waiting:nil Running:nil Terminated:nil} Ready:false RestartCount:0 Image:docker.io/library/busybox:1.29 ImageID: ContainerID: Started:0xc001f219ec}] QOSClass:BestEffort EphemeralContainerStatuses:[]}", } to be nil Full Stack Trace k8s.io/kubernetes/test/e2e/common.glob..func12.3.2() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/kubelet.go:124 +0x125 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc003896a80) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc003896a80) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc003896a80, 0x4de37a0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] Kubelet /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "kubelet-test-3824". STEP: Found 9 events. May 14 21:49:05.505: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for bin-false64bba80c-7f39-4f30-a569-40153ab9c0b9: { } Scheduled: Successfully assigned kubelet-test-3824/bin-false64bba80c-7f39-4f30-a569-40153ab9c0b9 to node1 May 14 21:49:05.505: INFO: At 2021-05-14 21:44:07 +0000 UTC - event for bin-false64bba80c-7f39-4f30-a569-40153ab9c0b9: {multus } AddedInterface: Add eth0 [10.244.3.176/24] May 14 21:49:05.505: INFO: At 2021-05-14 21:44:07 +0000 UTC - event for bin-false64bba80c-7f39-4f30-a569-40153ab9c0b9: {kubelet node1} Pulling: Pulling image "docker.io/library/busybox:1.29" May 14 21:49:05.505: INFO: At 2021-05-14 21:44:08 +0000 UTC - event for bin-false64bba80c-7f39-4f30-a569-40153ab9c0b9: {kubelet node1} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit May 14 21:49:05.505: INFO: At 2021-05-14 21:44:08 +0000 UTC - event for bin-false64bba80c-7f39-4f30-a569-40153ab9c0b9: {kubelet node1} Failed: Error: ErrImagePull May 14 21:49:05.505: INFO: At 2021-05-14 21:44:08 +0000 UTC - event for bin-false64bba80c-7f39-4f30-a569-40153ab9c0b9: {kubelet node1} SandboxChanged: Pod sandbox changed, it will be killed and re-created. May 14 21:49:05.505: INFO: At 2021-05-14 21:44:10 +0000 UTC - event for bin-false64bba80c-7f39-4f30-a569-40153ab9c0b9: {multus } AddedInterface: Add eth0 [10.244.3.177/24] May 14 21:49:05.505: INFO: At 2021-05-14 21:44:10 +0000 UTC - event for bin-false64bba80c-7f39-4f30-a569-40153ab9c0b9: {kubelet node1} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" May 14 21:49:05.505: INFO: At 2021-05-14 21:44:10 +0000 UTC - event for bin-false64bba80c-7f39-4f30-a569-40153ab9c0b9: {kubelet node1} Failed: Error: ImagePullBackOff May 14 21:49:05.507: INFO: POD NODE PHASE GRACE CONDITIONS May 14 21:49:05.507: INFO: bin-false64bba80c-7f39-4f30-a569-40153ab9c0b9 node1 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-05-14 21:44:05 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-05-14 21:44:05 +0000 UTC ContainersNotReady containers with unready status: [bin-false64bba80c-7f39-4f30-a569-40153ab9c0b9]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-05-14 21:44:05 +0000 UTC ContainersNotReady containers with unready status: [bin-false64bba80c-7f39-4f30-a569-40153ab9c0b9]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-05-14 21:44:05 +0000 UTC }] May 14 21:49:05.507: INFO: May 14 21:49:05.512: INFO: Logging node info for node master1 May 14 21:49:05.515: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 8e20012e-a811-456d-9add-2ea316e23700 43800 0 2021-05-14 19:56:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"a6:a3:7b:a0:c9:75"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-14 19:56:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-14 19:56:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-14 19:59:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-05-14 20:06:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234763776 0} {<nil>} 196518324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324599808 0} {<nil>} 195629492Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:02:00 +0000 UTC,LastTransitionTime:2021-05-14 20:02:00 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-14 21:49:01 +0000 UTC,LastTransitionTime:2021-05-14 19:56:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-14 21:49:01 +0000 UTC,LastTransitionTime:2021-05-14 19:56:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-14 21:49:01 +0000 UTC,LastTransitionTime:2021-05-14 19:56:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-14 21:49:01 +0000 UTC,LastTransitionTime:2021-05-14 19:59:09 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a88b162033bc4931ba0342c7f78a28b9,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:ba5ed4e5-a8ef-4986-946f-e7e2d91395d2,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:e3157cfba16d361ffec06306dd0154c7dca1931cbc4569e3c5822e30e311948b tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:a43c7fdd150533238a300ad84ac906e551111f9b57273afcb8781ee675fd23b3 tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 14 21:49:05.516: INFO: Logging kubelet events for node master1 May 14 21:49:05.519: INFO: Logging pods the kubelet thinks is on node master1 May 14 21:49:05.530: INFO: kube-proxy-v2c76 started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 14 21:49:05.530: INFO: Container kube-proxy ready: true, restart count 2 May 14 21:49:05.530: INFO: kube-multus-ds-amd64-m54v2 started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 14 21:49:05.530: INFO: Container kube-multus ready: true, restart count 1 May 14 21:49:05.530: INFO: coredns-7677f9bb54-mlcmv started at 2021-05-14 19:59:27 +0000 UTC (0+1 container statuses recorded) May 14 21:49:05.530: INFO: Container coredns ready: true, restart count 1 May 14 21:49:05.530: INFO: docker-registry-docker-registry-56cbc7bc58-bjc5h started at 2021-05-14 20:02:43 +0000 UTC (0+2 container statuses recorded) May 14 21:49:05.530: INFO: Container docker-registry ready: true, restart count 0 May 14 21:49:05.530: INFO: Container nginx ready: true, restart count 0 May 14 21:49:05.530: INFO: node-feature-discovery-controller-5bf5c49849-27v77 started at 2021-05-14 20:05:52 +0000 UTC (0+1 container statuses recorded) May 14 21:49:05.530: INFO: Container nfd-controller ready: true, restart count 0 May 14 21:49:05.530: INFO: kube-apiserver-master1 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 14 21:49:05.530: INFO: Container kube-apiserver ready: true, restart count 0 May 14 21:49:05.530: INFO: node-exporter-nvrxr started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 14 21:49:05.530: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 14 21:49:05.530: INFO: Container node-exporter ready: true, restart count 0 May 14 21:49:05.530: INFO: kube-scheduler-master1 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 14 21:49:05.530: INFO: Container kube-scheduler ready: true, restart count 0 May 14 21:49:05.530: INFO: kube-controller-manager-master1 started at 2021-05-14 20:01:22 +0000 UTC (0+1 container statuses recorded) May 14 21:49:05.530: INFO: Container kube-controller-manager ready: true, restart count 2 May 14 21:49:05.530: INFO: kube-flannel-cx7s6 started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 14 21:49:05.530: INFO: Init container install-cni ready: true, restart count 0 May 14 21:49:05.530: INFO: Container kube-flannel ready: true, restart count 1 W0514 21:49:05.544611 35 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 14 21:49:05.578: INFO: Latency metrics for node master1 May 14 21:49:05.578: INFO: Logging node info for node master2 May 14 21:49:05.580: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 e8f1881f-5ded-4c6c-b7e6-eb354b7962e2 43795 0 2021-05-14 19:57:04 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"0a:97:9a:eb:9d:a8"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-14 19:57:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-14 19:57:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-14 19:59:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-14 19:59:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234763776 0} {<nil>} 196518324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324599808 0} {<nil>} 195629492Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:02:07 +0000 UTC,LastTransitionTime:2021-05-14 20:02:07 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-14 21:49:01 +0000 UTC,LastTransitionTime:2021-05-14 19:57:04 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-14 21:49:01 +0000 UTC,LastTransitionTime:2021-05-14 19:57:04 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-14 21:49:01 +0000 UTC,LastTransitionTime:2021-05-14 19:57:04 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-14 21:49:01 +0000 UTC,LastTransitionTime:2021-05-14 19:59:09 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:14c4cdd0613041bb923c5f9b84e0bcde,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:9bdca68c-a5fc-48f7-b392-63d2c04d224d,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 14 21:49:05.581: INFO: Logging kubelet events for node master2 May 14 21:49:05.584: INFO: Logging pods the kubelet thinks is on node master2 May 14 21:49:05.591: INFO: kube-multus-ds-amd64-bt5kr started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 14 21:49:05.591: INFO: Container kube-multus ready: true, restart count 1 May 14 21:49:05.592: INFO: dns-autoscaler-5b7b5c9b6f-fgzqp started at 2021-05-14 19:59:30 +0000 UTC (0+1 container statuses recorded) May 14 21:49:05.592: INFO: Container autoscaler ready: true, restart count 2 May 14 21:49:05.592: INFO: node-exporter-gjrtc started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 14 21:49:05.592: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 14 21:49:05.592: INFO: Container node-exporter ready: true, restart count 0 May 14 21:49:05.592: INFO: kube-apiserver-master2 started at 2021-05-14 20:05:10 +0000 UTC (0+1 container statuses recorded) May 14 21:49:05.592: INFO: Container kube-apiserver ready: true, restart count 0 May 14 21:49:05.592: INFO: kube-controller-manager-master2 started at 2021-05-14 20:01:22 +0000 UTC (0+1 container statuses recorded) May 14 21:49:05.592: INFO: Container kube-controller-manager ready: true, restart count 2 May 14 21:49:05.592: INFO: kube-scheduler-master2 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 14 21:49:05.592: INFO: Container kube-scheduler ready: true, restart count 2 May 14 21:49:05.592: INFO: kube-proxy-qcgpm started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 14 21:49:05.592: INFO: Container kube-proxy ready: true, restart count 2 May 14 21:49:05.592: INFO: kube-flannel-fc4sf started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 14 21:49:05.592: INFO: Init container install-cni ready: true, restart count 0 May 14 21:49:05.592: INFO: Container kube-flannel ready: true, restart count 1 W0514 21:49:05.607022 35 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 14 21:49:05.640: INFO: Latency metrics for node master2 May 14 21:49:05.640: INFO: Logging node info for node master3 May 14 21:49:05.643: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 29fd0a5d-1350-4e28-a4cb-b26dd82cd397 43786 0 2021-05-14 19:57:14 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:27:37:b7:ad:a5"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-14 19:57:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-14 19:57:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-14 19:59:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234767872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324603904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:01:03 +0000 UTC,LastTransitionTime:2021-05-14 20:01:03 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-14 21:48:58 +0000 UTC,LastTransitionTime:2021-05-14 19:57:14 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-14 21:48:58 +0000 UTC,LastTransitionTime:2021-05-14 19:57:14 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-14 21:48:58 +0000 UTC,LastTransitionTime:2021-05-14 19:57:14 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-14 21:48:58 +0000 UTC,LastTransitionTime:2021-05-14 20:00:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f3fe601830d34e59967ed389af552f25,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:56dd60e2-98fe-4d87-81d9-95db820e7426,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 14 21:49:05.643: INFO: Logging kubelet events for node master3 May 14 21:49:05.645: INFO: Logging pods the kubelet thinks is on node master3 May 14 21:49:05.655: INFO: kube-flannel-cl8jf started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 14 21:49:05.655: INFO: Init container install-cni ready: true, restart count 0 May 14 21:49:05.655: INFO: Container kube-flannel ready: true, restart count 2 May 14 21:49:05.655: INFO: kube-multus-ds-amd64-hp6bp started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 14 21:49:05.655: INFO: Container kube-multus ready: true, restart count 1 May 14 21:49:05.655: INFO: coredns-7677f9bb54-qhzrv started at 2021-05-14 19:59:32 +0000 UTC (0+1 container statuses recorded) May 14 21:49:05.655: INFO: Container coredns ready: true, restart count 2 May 14 21:49:05.655: INFO: node-exporter-4cgbq started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 14 21:49:05.655: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 14 21:49:05.655: INFO: Container node-exporter ready: true, restart count 0 May 14 21:49:05.655: INFO: kube-controller-manager-master3 started at 2021-05-14 20:00:41 +0000 UTC (0+1 container statuses recorded) May 14 21:49:05.655: INFO: Container kube-controller-manager ready: true, restart count 3 May 14 21:49:05.655: INFO: kube-scheduler-master3 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 14 21:49:05.655: INFO: Container kube-scheduler ready: true, restart count 3 May 14 21:49:05.655: INFO: kube-apiserver-master3 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 14 21:49:05.655: INFO: Container kube-apiserver ready: true, restart count 0 May 14 21:49:05.655: INFO: kube-proxy-2crs2 started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 14 21:49:05.655: INFO: Container kube-proxy ready: true, restart count 1 W0514 21:49:05.670663 35 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 14 21:49:05.701: INFO: Latency metrics for node master3 May 14 21:49:05.701: INFO: Logging node info for node node1 May 14 21:49:05.705: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 5e4c0fba-b5fa-4177-b834-f3e04c846ff3 43806 0 2021-05-14 19:58:21 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ba:ee:c6:a6:52:03"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-14 19:58:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-05-14 19:58:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-14 20:06:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-14 20:08:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-14 20:08:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269633024 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884632576 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:00:44 +0000 UTC,LastTransitionTime:2021-05-14 20:00:44 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-14 21:49:03 +0000 UTC,LastTransitionTime:2021-05-14 19:58:21 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-14 21:49:03 +0000 UTC,LastTransitionTime:2021-05-14 19:58:21 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-14 21:49:03 +0000 UTC,LastTransitionTime:2021-05-14 19:58:21 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-14 21:49:03 +0000 UTC,LastTransitionTime:2021-05-14 20:00:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:4b96d01fdbcb4fadb4a59fca2e1bf368,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:93c238b3-1895-423c-a1aa-193fbcf8b55f,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:869f7b3516c269b43448f1227c57d536e8a4cf723eeef3b5f8b8e224ecbcfd8e localhost:30500/barometer-collectd:stable],SizeBytes:1464261626,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:1002487751,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:ed5c574f653e2a39e784ff322033a2319aafde7366c803a88f20f7a2a8bc1efb opnfv/barometer-collectd:stable],SizeBytes:825413035,},ContainerImage{Names:[localhost:30500/cmk@sha256:f759b012c29126f880575ac543d09301d45f0b2b9d0f5329849ea40e65017dde cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[golang@sha256:1636899c10870ab66c48d960a9df620f4f9e86a0c72fbacf36032d27404e7e6c golang:alpine3.12],SizeBytes:301156062,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:948a93bc3803d61dd66ab49f99d4cc657e87273682aec7dd5955a000fd17a7e5 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392645,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:36553b10a4947067b9fbb7d532951066293a68eae893beba1d9235f7d11a20ad alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 14 21:49:05.706: INFO: Logging kubelet events for node node1 May 14 21:49:05.709: INFO: Logging pods the kubelet thinks is on node node1 May 14 21:49:05.736: INFO: bin-false64bba80c-7f39-4f30-a569-40153ab9c0b9 started at 2021-05-14 21:44:05 +0000 UTC (0+1 container statuses recorded) May 14 21:49:05.736: INFO: Container bin-false64bba80c-7f39-4f30-a569-40153ab9c0b9 ready: false, restart count 0 May 14 21:49:05.736: INFO: client-envvars-be50a1fb-b455-4ffc-afa6-853b330836c8 started at 2021-05-14 21:44:28 +0000 UTC (0+1 container statuses recorded) May 14 21:49:05.736: INFO: Container env3cont ready: false, restart count 0 May 14 21:49:05.736: INFO: nginx-proxy-node1 started at 2021-05-14 20:05:10 +0000 UTC (0+1 container statuses recorded) May 14 21:49:05.736: INFO: Container nginx-proxy ready: true, restart count 2 May 14 21:49:05.736: INFO: cmk-init-discover-node1-g6c6q started at 2021-05-14 20:08:21 +0000 UTC (0+3 container statuses recorded) May 14 21:49:05.736: INFO: Container discover ready: false, restart count 0 May 14 21:49:05.736: INFO: Container init ready: false, restart count 0 May 14 21:49:05.737: INFO: Container install ready: false, restart count 0 May 14 21:49:05.737: INFO: downward-api-7fe7ba13-e01d-40c2-8450-52b1820f2203 started at 2021-05-14 21:48:40 +0000 UTC (0+1 container statuses recorded) May 14 21:49:05.737: INFO: Container dapi-container ready: false, restart count 0 May 14 21:49:05.737: INFO: node-exporter-r62rn started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 14 21:49:05.737: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 14 21:49:05.737: INFO: Container node-exporter ready: true, restart count 0 May 14 21:49:05.737: INFO: prometheus-k8s-0 started at 2021-05-14 20:09:58 +0000 UTC (0+5 container statuses recorded) May 14 21:49:05.737: INFO: Container custom-metrics-apiserver ready: true, restart count 0 May 14 21:49:05.737: INFO: Container grafana ready: true, restart count 0 May 14 21:49:05.737: INFO: Container prometheus ready: true, restart count 1 May 14 21:49:05.737: INFO: Container prometheus-config-reloader ready: true, restart count 0 May 14 21:49:05.737: INFO: Container rules-configmap-reloader ready: true, restart count 0 May 14 21:49:05.737: INFO: busybox-b097043f-a793-4e77-ae01-29c5148f6b87 started at 2021-05-14 21:45:49 +0000 UTC (0+1 container statuses recorded) May 14 21:49:05.737: INFO: Container busybox ready: false, restart count 0 May 14 21:49:05.737: INFO: kubernetes-metrics-scraper-678c97765c-pqnd6 started at 2021-05-14 19:59:31 +0000 UTC (0+1 container statuses recorded) May 14 21:49:05.737: INFO: Container kubernetes-metrics-scraper ready: true, restart count 1 May 14 21:49:05.737: INFO: node-feature-discovery-worker-nvg9t started at 2021-05-14 20:05:42 +0000 UTC (0+1 container statuses recorded) May 14 21:49:05.737: INFO: Container nfd-worker ready: true, restart count 0 May 14 21:49:05.737: INFO: cmk-9nqjc started at 2021-05-14 20:09:03 +0000 UTC (0+2 container statuses recorded) May 14 21:49:05.737: INFO: Container nodereport ready: true, restart count 0 May 14 21:49:05.737: INFO: Container reconcile ready: true, restart count 0 May 14 21:49:05.737: INFO: pod-init-81d6bb40-d37b-4efe-9536-bd7d8ccf0ee5 started at 2021-05-14 21:47:09 +0000 UTC (2+1 container statuses recorded) May 14 21:49:05.737: INFO: Init container init1 ready: false, restart count 0 May 14 21:49:05.737: INFO: Init container init2 ready: false, restart count 0 May 14 21:49:05.737: INFO: Container run1 ready: false, restart count 0 May 14 21:49:05.737: INFO: adopt-release-j65w5 started at 2021-05-14 21:45:12 +0000 UTC (0+1 container statuses recorded) May 14 21:49:05.737: INFO: Container c ready: false, restart count 0 May 14 21:49:05.737: INFO: kube-flannel-hj8sj started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 14 21:49:05.737: INFO: Init container install-cni ready: true, restart count 0 May 14 21:49:05.737: INFO: Container kube-flannel ready: true, restart count 1 May 14 21:49:05.737: INFO: prometheus-operator-5bb8cb9d8f-4lq8j started at 2021-05-14 20:09:49 +0000 UTC (0+2 container statuses recorded) May 14 21:49:05.737: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 14 21:49:05.737: INFO: Container prometheus-operator ready: true, restart count 0 May 14 21:49:05.737: INFO: pod-update-activedeadlineseconds-7af6676f-ceab-41d9-ba21-6e847344a937 started at 2021-05-14 21:46:10 +0000 UTC (0+1 container statuses recorded) May 14 21:49:05.737: INFO: Container nginx ready: false, restart count 0 May 14 21:49:05.737: INFO: collectd-qhp77 started at 2021-05-14 20:15:36 +0000 UTC (0+3 container statuses recorded) May 14 21:49:05.737: INFO: Container collectd ready: true, restart count 0 May 14 21:49:05.737: INFO: Container collectd-exporter ready: true, restart count 0 May 14 21:49:05.737: INFO: Container rbac-proxy ready: true, restart count 0 May 14 21:49:05.737: INFO: kube-proxy-l7697 started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 14 21:49:05.737: INFO: Container kube-proxy ready: true, restart count 2 May 14 21:49:05.737: INFO: kube-multus-ds-amd64-jhf4c started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 14 21:49:05.737: INFO: Container kube-multus ready: true, restart count 1 May 14 21:49:05.737: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-bw262 started at 2021-05-14 20:06:38 +0000 UTC (0+1 container statuses recorded) May 14 21:49:05.737: INFO: Container kube-sriovdp ready: true, restart count 0 W0514 21:49:05.751258 35 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 14 21:49:05.799: INFO: Latency metrics for node node1 May 14 21:49:05.799: INFO: Logging node info for node node2 May 14 21:49:05.802: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 0bae98dc-2ebc-4849-b99e-7780a3bea71e 43814 0 2021-05-14 19:58:22 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"c6:18:ed:95:bb:1a"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-14 19:58:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-05-14 19:58:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-14 20:06:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-14 20:08:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-14 20:08:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269633024 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884632576 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:01:27 +0000 UTC,LastTransitionTime:2021-05-14 20:01:27 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-14 21:49:05 +0000 UTC,LastTransitionTime:2021-05-14 19:58:22 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-14 21:49:05 +0000 UTC,LastTransitionTime:2021-05-14 19:58:22 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-14 21:49:05 +0000 UTC,LastTransitionTime:2021-05-14 19:58:22 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-14 21:49:05 +0000 UTC,LastTransitionTime:2021-05-14 19:59:04 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a3f22fbf9e534ba1819f7a549414a8a6,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:166b6e45-ba8b-4b89-80b0-befc9a0152b8,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:869f7b3516c269b43448f1227c57d536e8a4cf723eeef3b5f8b8e224ecbcfd8e localhost:30500/barometer-collectd:stable],SizeBytes:1464261626,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[localhost:30500/cmk@sha256:f759b012c29126f880575ac543d09301d45f0b2b9d0f5329849ea40e65017dde localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:948a93bc3803d61dd66ab49f99d4cc657e87273682aec7dd5955a000fd17a7e5 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392645,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:e3157cfba16d361ffec06306dd0154c7dca1931cbc4569e3c5822e30e311948b localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:a43c7fdd150533238a300ad84ac906e551111f9b57273afcb8781ee675fd23b3 localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 14 21:49:05.803: INFO: Logging kubelet events for node node2 May 14 21:49:05.806: INFO: Logging pods the kubelet thinks is on node node2 May 14 21:49:05.830: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-2c2pw started at 2021-05-14 20:06:38 +0000 UTC (0+1 container statuses recorded) May 14 21:49:05.830: INFO: Container kube-sriovdp ready: true, restart count 0 May 14 21:49:05.830: INFO: foo-p7v5c started at 2021-05-14 21:37:13 +0000 UTC (0+1 container statuses recorded) May 14 21:49:05.830: INFO: Container c ready: false, restart count 0 May 14 21:49:05.830: INFO: node-feature-discovery-worker-76m6b started at 2021-05-14 20:05:42 +0000 UTC (0+1 container statuses recorded) May 14 21:49:05.830: INFO: Container nfd-worker ready: true, restart count 0 May 14 21:49:05.830: INFO: cmk-d2qwf started at 2021-05-14 20:09:04 +0000 UTC (0+2 container statuses recorded) May 14 21:49:05.830: INFO: Container nodereport ready: true, restart count 0 May 14 21:49:05.830: INFO: Container reconcile ready: true, restart count 0 May 14 21:49:05.830: INFO: cmk-webhook-6c9d5f8578-pjgxh started at 2021-05-14 20:09:04 +0000 UTC (0+1 container statuses recorded) May 14 21:49:05.830: INFO: Container cmk-webhook ready: true, restart count 0 May 14 21:49:05.830: INFO: downward-api-da679d11-9a20-4ae1-8a2b-a1c64f047364 started at 2021-05-14 21:45:33 +0000 UTC (0+1 container statuses recorded) May 14 21:49:05.830: INFO: Container dapi-container ready: false, restart count 0 May 14 21:49:05.830: INFO: cmk-init-discover-node2-j75ff started at 2021-05-14 20:08:41 +0000 UTC (0+3 container statuses recorded) May 14 21:49:05.830: INFO: Container discover ready: false, restart count 0 May 14 21:49:05.830: INFO: Container init ready: false, restart count 0 May 14 21:49:05.830: INFO: Container install ready: false, restart count 0 May 14 21:49:05.830: INFO: pod-configmaps-ee6a98f6-3fa4-4197-a55d-97afde46361b started at 2021-05-14 21:46:49 +0000 UTC (0+1 container statuses recorded) May 14 21:49:05.830: INFO: Container env-test ready: false, restart count 0 May 14 21:49:05.830: INFO: kube-proxy-t524z started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 14 21:49:05.830: INFO: Container kube-proxy ready: true, restart count 2 May 14 21:49:05.830: INFO: kube-multus-ds-amd64-n7cb2 started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 14 21:49:05.830: INFO: Container kube-multus ready: true, restart count 1 May 14 21:49:05.830: INFO: kubernetes-dashboard-86c6f9df5b-ndntg started at 2021-05-14 19:59:31 +0000 UTC (0+1 container statuses recorded) May 14 21:49:05.830: INFO: Container kubernetes-dashboard ready: true, restart count 2 May 14 21:49:05.830: INFO: foo-sgn27 started at 2021-05-14 21:37:13 +0000 UTC (0+1 container statuses recorded) May 14 21:49:05.830: INFO: Container c ready: false, restart count 0 May 14 21:49:05.830: INFO: server-envvars-d9350368-6516-4cd8-b4ef-7d121efaa512 started at 2021-05-14 21:39:22 +0000 UTC (0+1 container statuses recorded) May 14 21:49:05.830: INFO: Container srv ready: true, restart count 0 May 14 21:49:05.830: INFO: nginx-proxy-node2 started at 2021-05-14 20:05:10 +0000 UTC (0+1 container statuses recorded) May 14 21:49:05.830: INFO: Container nginx-proxy ready: true, restart count 2 May 14 21:49:05.830: INFO: kube-flannel-rqcwp started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 14 21:49:05.830: INFO: Init container install-cni ready: true, restart count 1 May 14 21:49:05.830: INFO: Container kube-flannel ready: true, restart count 4 May 14 21:49:05.830: INFO: node-exporter-rnd5f started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 14 21:49:05.830: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 14 21:49:05.830: INFO: Container node-exporter ready: true, restart count 0 May 14 21:49:05.830: INFO: adopt-release-kfjkh started at 2021-05-14 21:45:12 +0000 UTC (0+1 container statuses recorded) May 14 21:49:05.830: INFO: Container c ready: false, restart count 0 May 14 21:49:05.830: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-l5hlq started at 2021-05-14 20:12:48 +0000 UTC (0+2 container statuses recorded) May 14 21:49:05.830: INFO: Container tas-controller ready: true, restart count 0 May 14 21:49:05.830: INFO: Container tas-extender ready: true, restart count 0 May 14 21:49:05.830: INFO: collectd-xzrgs started at 2021-05-14 20:15:36 +0000 UTC (0+3 container statuses recorded) May 14 21:49:05.830: INFO: Container collectd ready: true, restart count 0 May 14 21:49:05.830: INFO: Container collectd-exporter ready: true, restart count 0 May 14 21:49:05.830: INFO: Container rbac-proxy ready: true, restart count 0 W0514 21:49:05.845613 35 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 14 21:49:05.889: INFO: Latency metrics for node node2 May 14 21:49:05.889: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "kubelet-test-3824" for this suite. /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 May 14 21:55:20.350: Unexpected error: <*errors.errorString | 0xc0003001f0>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:103 [BeforeEach] [k8s.io] Pods /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client May 14 21:50:20.306: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename pods STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [k8s.io] Pods /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/pods.go:181 [It] should support remote command execution over websockets [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 May 14 21:50:20.326: INFO: >>> kubeConfig: /root/.kube/config STEP: creating the pod STEP: submitting the pod to kubernetes May 14 21:55:20.350: FAIL: Unexpected error: <*errors.errorString | 0xc0003001f0>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*PodClient).CreateSync(0xc0043562c0, 0xc003bee000, 0x0) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:103 +0xfe k8s.io/kubernetes/test/e2e/common.glob..func18.7() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/pods.go:560 +0x48c k8s.io/kubernetes/test/e2e.RunE2ETests(0xc003896a80) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc003896a80) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc003896a80, 0x4de37a0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] Pods /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "pods-6423". STEP: Found 9 events. May 14 21:55:20.355: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for pod-exec-websocket-ee117cf4-5eb1-4920-bfc1-0c98ee0296a7: { } Scheduled: Successfully assigned pods-6423/pod-exec-websocket-ee117cf4-5eb1-4920-bfc1-0c98ee0296a7 to node1 May 14 21:55:20.355: INFO: At 2021-05-14 21:50:21 +0000 UTC - event for pod-exec-websocket-ee117cf4-5eb1-4920-bfc1-0c98ee0296a7: {multus } AddedInterface: Add eth0 [10.244.3.201/24] May 14 21:55:20.355: INFO: At 2021-05-14 21:50:21 +0000 UTC - event for pod-exec-websocket-ee117cf4-5eb1-4920-bfc1-0c98ee0296a7: {kubelet node1} Pulling: Pulling image "docker.io/library/busybox:1.29" May 14 21:55:20.355: INFO: At 2021-05-14 21:50:22 +0000 UTC - event for pod-exec-websocket-ee117cf4-5eb1-4920-bfc1-0c98ee0296a7: {kubelet node1} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit May 14 21:55:20.355: INFO: At 2021-05-14 21:50:22 +0000 UTC - event for pod-exec-websocket-ee117cf4-5eb1-4920-bfc1-0c98ee0296a7: {kubelet node1} Failed: Error: ErrImagePull May 14 21:55:20.355: INFO: At 2021-05-14 21:50:22 +0000 UTC - event for pod-exec-websocket-ee117cf4-5eb1-4920-bfc1-0c98ee0296a7: {kubelet node1} SandboxChanged: Pod sandbox changed, it will be killed and re-created. May 14 21:55:20.355: INFO: At 2021-05-14 21:50:24 +0000 UTC - event for pod-exec-websocket-ee117cf4-5eb1-4920-bfc1-0c98ee0296a7: {multus } AddedInterface: Add eth0 [10.244.3.202/24] May 14 21:55:20.355: INFO: At 2021-05-14 21:50:24 +0000 UTC - event for pod-exec-websocket-ee117cf4-5eb1-4920-bfc1-0c98ee0296a7: {kubelet node1} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" May 14 21:55:20.355: INFO: At 2021-05-14 21:50:24 +0000 UTC - event for pod-exec-websocket-ee117cf4-5eb1-4920-bfc1-0c98ee0296a7: {kubelet node1} Failed: Error: ImagePullBackOff May 14 21:55:20.357: INFO: POD NODE PHASE GRACE CONDITIONS May 14 21:55:20.358: INFO: pod-exec-websocket-ee117cf4-5eb1-4920-bfc1-0c98ee0296a7 node1 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-05-14 21:50:20 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-05-14 21:50:20 +0000 UTC ContainersNotReady containers with unready status: [main]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-05-14 21:50:20 +0000 UTC ContainersNotReady containers with unready status: [main]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-05-14 21:50:20 +0000 UTC }] May 14 21:55:20.358: INFO: May 14 21:55:20.362: INFO: Logging node info for node master1 May 14 21:55:20.364: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 8e20012e-a811-456d-9add-2ea316e23700 46591 0 2021-05-14 19:56:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"a6:a3:7b:a0:c9:75"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-14 19:56:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-14 19:56:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-14 19:59:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-05-14 20:06:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234763776 0} {<nil>} 196518324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324599808 0} {<nil>} 195629492Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:02:00 +0000 UTC,LastTransitionTime:2021-05-14 20:02:00 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-14 21:55:13 +0000 UTC,LastTransitionTime:2021-05-14 19:56:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-14 21:55:13 +0000 UTC,LastTransitionTime:2021-05-14 19:56:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-14 21:55:13 +0000 UTC,LastTransitionTime:2021-05-14 19:56:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-14 21:55:13 +0000 UTC,LastTransitionTime:2021-05-14 19:59:09 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a88b162033bc4931ba0342c7f78a28b9,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:ba5ed4e5-a8ef-4986-946f-e7e2d91395d2,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:e3157cfba16d361ffec06306dd0154c7dca1931cbc4569e3c5822e30e311948b tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:a43c7fdd150533238a300ad84ac906e551111f9b57273afcb8781ee675fd23b3 tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 14 21:55:20.365: INFO: Logging kubelet events for node master1 May 14 21:55:20.367: INFO: Logging pods the kubelet thinks is on node master1 May 14 21:55:20.376: INFO: node-exporter-nvrxr started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 14 21:55:20.376: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 14 21:55:20.376: INFO: Container node-exporter ready: true, restart count 0 May 14 21:55:20.376: INFO: kube-scheduler-master1 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 14 21:55:20.376: INFO: Container kube-scheduler ready: true, restart count 0 May 14 21:55:20.376: INFO: kube-controller-manager-master1 started at 2021-05-14 20:01:22 +0000 UTC (0+1 container statuses recorded) May 14 21:55:20.376: INFO: Container kube-controller-manager ready: true, restart count 2 May 14 21:55:20.376: INFO: kube-flannel-cx7s6 started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 14 21:55:20.376: INFO: Init container install-cni ready: true, restart count 0 May 14 21:55:20.376: INFO: Container kube-flannel ready: true, restart count 1 May 14 21:55:20.376: INFO: kube-proxy-v2c76 started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 14 21:55:20.376: INFO: Container kube-proxy ready: true, restart count 2 May 14 21:55:20.376: INFO: kube-multus-ds-amd64-m54v2 started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 14 21:55:20.376: INFO: Container kube-multus ready: true, restart count 1 May 14 21:55:20.376: INFO: coredns-7677f9bb54-mlcmv started at 2021-05-14 19:59:27 +0000 UTC (0+1 container statuses recorded) May 14 21:55:20.376: INFO: Container coredns ready: true, restart count 1 May 14 21:55:20.376: INFO: docker-registry-docker-registry-56cbc7bc58-bjc5h started at 2021-05-14 20:02:43 +0000 UTC (0+2 container statuses recorded) May 14 21:55:20.376: INFO: Container docker-registry ready: true, restart count 0 May 14 21:55:20.376: INFO: Container nginx ready: true, restart count 0 May 14 21:55:20.376: INFO: node-feature-discovery-controller-5bf5c49849-27v77 started at 2021-05-14 20:05:52 +0000 UTC (0+1 container statuses recorded) May 14 21:55:20.376: INFO: Container nfd-controller ready: true, restart count 0 May 14 21:55:20.376: INFO: kube-apiserver-master1 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 14 21:55:20.376: INFO: Container kube-apiserver ready: true, restart count 0 W0514 21:55:20.390846 35 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 14 21:55:20.415: INFO: Latency metrics for node master1 May 14 21:55:20.416: INFO: Logging node info for node master2 May 14 21:55:20.417: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 e8f1881f-5ded-4c6c-b7e6-eb354b7962e2 46590 0 2021-05-14 19:57:04 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"0a:97:9a:eb:9d:a8"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-14 19:57:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-14 19:57:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-14 19:59:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-14 19:59:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234763776 0} {<nil>} 196518324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324599808 0} {<nil>} 195629492Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:02:07 +0000 UTC,LastTransitionTime:2021-05-14 20:02:07 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-14 21:55:13 +0000 UTC,LastTransitionTime:2021-05-14 19:57:04 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-14 21:55:13 +0000 UTC,LastTransitionTime:2021-05-14 19:57:04 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-14 21:55:13 +0000 UTC,LastTransitionTime:2021-05-14 19:57:04 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-14 21:55:13 +0000 UTC,LastTransitionTime:2021-05-14 19:59:09 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:14c4cdd0613041bb923c5f9b84e0bcde,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:9bdca68c-a5fc-48f7-b392-63d2c04d224d,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 14 21:55:20.418: INFO: Logging kubelet events for node master2 May 14 21:55:20.421: INFO: Logging pods the kubelet thinks is on node master2 May 14 21:55:20.429: INFO: kube-controller-manager-master2 started at 2021-05-14 20:01:22 +0000 UTC (0+1 container statuses recorded) May 14 21:55:20.429: INFO: Container kube-controller-manager ready: true, restart count 2 May 14 21:55:20.429: INFO: kube-scheduler-master2 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 14 21:55:20.429: INFO: Container kube-scheduler ready: true, restart count 2 May 14 21:55:20.429: INFO: kube-proxy-qcgpm started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 14 21:55:20.429: INFO: Container kube-proxy ready: true, restart count 2 May 14 21:55:20.429: INFO: kube-flannel-fc4sf started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 14 21:55:20.429: INFO: Init container install-cni ready: true, restart count 0 May 14 21:55:20.429: INFO: Container kube-flannel ready: true, restart count 1 May 14 21:55:20.429: INFO: kube-multus-ds-amd64-bt5kr started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 14 21:55:20.429: INFO: Container kube-multus ready: true, restart count 1 May 14 21:55:20.429: INFO: dns-autoscaler-5b7b5c9b6f-fgzqp started at 2021-05-14 19:59:30 +0000 UTC (0+1 container statuses recorded) May 14 21:55:20.429: INFO: Container autoscaler ready: true, restart count 2 May 14 21:55:20.429: INFO: node-exporter-gjrtc started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 14 21:55:20.429: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 14 21:55:20.429: INFO: Container node-exporter ready: true, restart count 0 May 14 21:55:20.429: INFO: kube-apiserver-master2 started at 2021-05-14 20:05:10 +0000 UTC (0+1 container statuses recorded) May 14 21:55:20.429: INFO: Container kube-apiserver ready: true, restart count 0 W0514 21:55:20.443723 35 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 14 21:55:20.475: INFO: Latency metrics for node master2 May 14 21:55:20.475: INFO: Logging node info for node master3 May 14 21:55:20.477: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 29fd0a5d-1350-4e28-a4cb-b26dd82cd397 46611 0 2021-05-14 19:57:14 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:27:37:b7:ad:a5"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-14 19:57:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-14 19:57:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-14 19:59:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234767872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324603904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:01:03 +0000 UTC,LastTransitionTime:2021-05-14 20:01:03 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-14 21:55:20 +0000 UTC,LastTransitionTime:2021-05-14 19:57:14 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-14 21:55:20 +0000 UTC,LastTransitionTime:2021-05-14 19:57:14 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-14 21:55:20 +0000 UTC,LastTransitionTime:2021-05-14 19:57:14 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-14 21:55:20 +0000 UTC,LastTransitionTime:2021-05-14 20:00:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f3fe601830d34e59967ed389af552f25,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:56dd60e2-98fe-4d87-81d9-95db820e7426,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 14 21:55:20.478: INFO: Logging kubelet events for node master3 May 14 21:55:20.480: INFO: Logging pods the kubelet thinks is on node master3 May 14 21:55:20.489: INFO: kube-multus-ds-amd64-hp6bp started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 14 21:55:20.489: INFO: Container kube-multus ready: true, restart count 1 May 14 21:55:20.489: INFO: coredns-7677f9bb54-qhzrv started at 2021-05-14 19:59:32 +0000 UTC (0+1 container statuses recorded) May 14 21:55:20.489: INFO: Container coredns ready: true, restart count 2 May 14 21:55:20.489: INFO: node-exporter-4cgbq started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 14 21:55:20.489: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 14 21:55:20.489: INFO: Container node-exporter ready: true, restart count 0 May 14 21:55:20.490: INFO: kube-controller-manager-master3 started at 2021-05-14 20:00:41 +0000 UTC (0+1 container statuses recorded) May 14 21:55:20.490: INFO: Container kube-controller-manager ready: true, restart count 3 May 14 21:55:20.490: INFO: kube-scheduler-master3 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 14 21:55:20.490: INFO: Container kube-scheduler ready: true, restart count 3 May 14 21:55:20.490: INFO: kube-apiserver-master3 started at 2021-05-14 19:57:39 +0000 UTC (0+1 container statuses recorded) May 14 21:55:20.490: INFO: Container kube-apiserver ready: true, restart count 0 May 14 21:55:20.490: INFO: kube-proxy-2crs2 started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 14 21:55:20.490: INFO: Container kube-proxy ready: true, restart count 1 May 14 21:55:20.490: INFO: kube-flannel-cl8jf started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 14 21:55:20.490: INFO: Init container install-cni ready: true, restart count 0 May 14 21:55:20.490: INFO: Container kube-flannel ready: true, restart count 2 W0514 21:55:20.501992 35 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 14 21:55:20.525: INFO: Latency metrics for node master3 May 14 21:55:20.525: INFO: Logging node info for node node1 May 14 21:55:20.530: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 5e4c0fba-b5fa-4177-b834-f3e04c846ff3 46599 0 2021-05-14 19:58:21 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ba:ee:c6:a6:52:03"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-14 19:58:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-05-14 19:58:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-14 20:06:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-14 20:08:24 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-14 20:08:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269633024 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884632576 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:00:44 +0000 UTC,LastTransitionTime:2021-05-14 20:00:44 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-14 21:55:15 +0000 UTC,LastTransitionTime:2021-05-14 19:58:21 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-14 21:55:15 +0000 UTC,LastTransitionTime:2021-05-14 19:58:21 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-14 21:55:15 +0000 UTC,LastTransitionTime:2021-05-14 19:58:21 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-14 21:55:15 +0000 UTC,LastTransitionTime:2021-05-14 20:00:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:4b96d01fdbcb4fadb4a59fca2e1bf368,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:93c238b3-1895-423c-a1aa-193fbcf8b55f,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:869f7b3516c269b43448f1227c57d536e8a4cf723eeef3b5f8b8e224ecbcfd8e localhost:30500/barometer-collectd:stable],SizeBytes:1464261626,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:1002487751,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:ed5c574f653e2a39e784ff322033a2319aafde7366c803a88f20f7a2a8bc1efb opnfv/barometer-collectd:stable],SizeBytes:825413035,},ContainerImage{Names:[localhost:30500/cmk@sha256:f759b012c29126f880575ac543d09301d45f0b2b9d0f5329849ea40e65017dde cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[golang@sha256:1636899c10870ab66c48d960a9df620f4f9e86a0c72fbacf36032d27404e7e6c golang:alpine3.12],SizeBytes:301156062,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:948a93bc3803d61dd66ab49f99d4cc657e87273682aec7dd5955a000fd17a7e5 nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392645,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:36553b10a4947067b9fbb7d532951066293a68eae893beba1d9235f7d11a20ad alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 14 21:55:20.531: INFO: Logging kubelet events for node node1 May 14 21:55:20.533: INFO: Logging pods the kubelet thinks is on node node1 May 14 21:55:20.548: INFO: prometheus-operator-5bb8cb9d8f-4lq8j started at 2021-05-14 20:09:49 +0000 UTC (0+2 container statuses recorded) May 14 21:55:20.549: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 14 21:55:20.549: INFO: Container prometheus-operator ready: true, restart count 0 May 14 21:55:20.549: INFO: adopt-release-j65w5 started at 2021-05-14 21:45:12 +0000 UTC (0+1 container statuses recorded) May 14 21:55:20.549: INFO: Container c ready: false, restart count 0 May 14 21:55:20.549: INFO: kube-flannel-hj8sj started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 14 21:55:20.549: INFO: Init container install-cni ready: true, restart count 0 May 14 21:55:20.549: INFO: Container kube-flannel ready: true, restart count 1 May 14 21:55:20.549: INFO: kube-multus-ds-amd64-jhf4c started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 14 21:55:20.549: INFO: Container kube-multus ready: true, restart count 1 May 14 21:55:20.549: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-bw262 started at 2021-05-14 20:06:38 +0000 UTC (0+1 container statuses recorded) May 14 21:55:20.549: INFO: Container kube-sriovdp ready: true, restart count 0 May 14 21:55:20.549: INFO: collectd-qhp77 started at 2021-05-14 20:15:36 +0000 UTC (0+3 container statuses recorded) May 14 21:55:20.549: INFO: Container collectd ready: true, restart count 0 May 14 21:55:20.549: INFO: Container collectd-exporter ready: true, restart count 0 May 14 21:55:20.549: INFO: Container rbac-proxy ready: true, restart count 0 May 14 21:55:20.549: INFO: pod-exec-websocket-ee117cf4-5eb1-4920-bfc1-0c98ee0296a7 started at 2021-05-14 21:50:20 +0000 UTC (0+1 container statuses recorded) May 14 21:55:20.549: INFO: Container main ready: false, restart count 0 May 14 21:55:20.549: INFO: kube-proxy-l7697 started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 14 21:55:20.549: INFO: Container kube-proxy ready: true, restart count 2 May 14 21:55:20.549: INFO: cmk-init-discover-node1-g6c6q started at 2021-05-14 20:08:21 +0000 UTC (0+3 container statuses recorded) May 14 21:55:20.549: INFO: Container discover ready: false, restart count 0 May 14 21:55:20.549: INFO: Container init ready: false, restart count 0 May 14 21:55:20.549: INFO: Container install ready: false, restart count 0 May 14 21:55:20.549: INFO: nginx-proxy-node1 started at 2021-05-14 20:05:10 +0000 UTC (0+1 container statuses recorded) May 14 21:55:20.549: INFO: Container nginx-proxy ready: true, restart count 2 May 14 21:55:20.549: INFO: node-feature-discovery-worker-nvg9t started at 2021-05-14 20:05:42 +0000 UTC (0+1 container statuses recorded) May 14 21:55:20.549: INFO: Container nfd-worker ready: true, restart count 0 May 14 21:55:20.549: INFO: cmk-9nqjc started at 2021-05-14 20:09:03 +0000 UTC (0+2 container statuses recorded) May 14 21:55:20.549: INFO: Container nodereport ready: true, restart count 0 May 14 21:55:20.549: INFO: Container reconcile ready: true, restart count 0 May 14 21:55:20.549: INFO: node-exporter-r62rn started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 14 21:55:20.549: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 14 21:55:20.549: INFO: Container node-exporter ready: true, restart count 0 May 14 21:55:20.549: INFO: prometheus-k8s-0 started at 2021-05-14 20:09:58 +0000 UTC (0+5 container statuses recorded) May 14 21:55:20.549: INFO: Container custom-metrics-apiserver ready: true, restart count 0 May 14 21:55:20.549: INFO: Container grafana ready: true, restart count 0 May 14 21:55:20.549: INFO: Container prometheus ready: true, restart count 1 May 14 21:55:20.549: INFO: Container prometheus-config-reloader ready: true, restart count 0 May 14 21:55:20.549: INFO: Container rules-configmap-reloader ready: true, restart count 0 May 14 21:55:20.549: INFO: kubernetes-metrics-scraper-678c97765c-pqnd6 started at 2021-05-14 19:59:31 +0000 UTC (0+1 container statuses recorded) May 14 21:55:20.549: INFO: Container kubernetes-metrics-scraper ready: true, restart count 1 W0514 21:55:20.563642 35 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 14 21:55:20.597: INFO: Latency metrics for node node1 May 14 21:55:20.597: INFO: Logging node info for node node2 May 14 21:55:20.600: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 0bae98dc-2ebc-4849-b99e-7780a3bea71e 46604 0 2021-05-14 19:58:22 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"c6:18:ed:95:bb:1a"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-14 19:58:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-05-14 19:58:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-14 19:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-14 20:06:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-14 20:08:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-14 20:08:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269633024 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884632576 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-14 20:01:27 +0000 UTC,LastTransitionTime:2021-05-14 20:01:27 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-14 21:55:18 +0000 UTC,LastTransitionTime:2021-05-14 19:58:22 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-14 21:55:18 +0000 UTC,LastTransitionTime:2021-05-14 19:58:22 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-14 21:55:18 +0000 UTC,LastTransitionTime:2021-05-14 19:58:22 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-14 21:55:18 +0000 UTC,LastTransitionTime:2021-05-14 19:59:04 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a3f22fbf9e534ba1819f7a549414a8a6,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:166b6e45-ba8b-4b89-80b0-befc9a0152b8,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:869f7b3516c269b43448f1227c57d536e8a4cf723eeef3b5f8b8e224ecbcfd8e localhost:30500/barometer-collectd:stable],SizeBytes:1464261626,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[localhost:30500/cmk@sha256:f759b012c29126f880575ac543d09301d45f0b2b9d0f5329849ea40e65017dde localhost:30500/cmk:v1.5.1],SizeBytes:726663003,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:948a93bc3803d61dd66ab49f99d4cc657e87273682aec7dd5955a000fd17a7e5 localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392645,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:e3157cfba16d361ffec06306dd0154c7dca1931cbc4569e3c5822e30e311948b localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:a43c7fdd150533238a300ad84ac906e551111f9b57273afcb8781ee675fd23b3 localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 14 21:55:20.601: INFO: Logging kubelet events for node node2 May 14 21:55:20.603: INFO: Logging pods the kubelet thinks is on node node2 May 14 21:55:20.616: INFO: kube-proxy-t524z started at 2021-05-14 19:58:24 +0000 UTC (0+1 container statuses recorded) May 14 21:55:20.616: INFO: Container kube-proxy ready: true, restart count 2 May 14 21:55:20.616: INFO: kube-multus-ds-amd64-n7cb2 started at 2021-05-14 19:59:07 +0000 UTC (0+1 container statuses recorded) May 14 21:55:20.616: INFO: Container kube-multus ready: true, restart count 1 May 14 21:55:20.616: INFO: kubernetes-dashboard-86c6f9df5b-ndntg started at 2021-05-14 19:59:31 +0000 UTC (0+1 container statuses recorded) May 14 21:55:20.616: INFO: Container kubernetes-dashboard ready: true, restart count 2 May 14 21:55:20.616: INFO: pod-logs-websocket-43258866-9913-45df-a3a5-04825bf35f0b started at 2021-05-14 21:52:50 +0000 UTC (0+1 container statuses recorded) May 14 21:55:20.616: INFO: Container main ready: false, restart count 0 May 14 21:55:20.616: INFO: nginx-proxy-node2 started at 2021-05-14 20:05:10 +0000 UTC (0+1 container statuses recorded) May 14 21:55:20.616: INFO: Container nginx-proxy ready: true, restart count 2 May 14 21:55:20.616: INFO: kube-flannel-rqcwp started at 2021-05-14 19:58:58 +0000 UTC (1+1 container statuses recorded) May 14 21:55:20.616: INFO: Init container install-cni ready: true, restart count 1 May 14 21:55:20.616: INFO: Container kube-flannel ready: true, restart count 4 May 14 21:55:20.616: INFO: node-exporter-rnd5f started at 2021-05-14 20:09:56 +0000 UTC (0+2 container statuses recorded) May 14 21:55:20.616: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 14 21:55:20.616: INFO: Container node-exporter ready: true, restart count 0 May 14 21:55:20.616: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-l5hlq started at 2021-05-14 20:12:48 +0000 UTC (0+2 container statuses recorded) May 14 21:55:20.616: INFO: Container tas-controller ready: true, restart count 0 May 14 21:55:20.616: INFO: Container tas-extender ready: true, restart count 0 May 14 21:55:20.616: INFO: collectd-xzrgs started at 2021-05-14 20:15:36 +0000 UTC (0+3 container statuses recorded) May 14 21:55:20.616: INFO: Container collectd ready: true, restart count 0 May 14 21:55:20.616: INFO: Container collectd-exporter ready: true, restart count 0 May 14 21:55:20.616: INFO: Container rbac-proxy ready: true, restart count 0 May 14 21:55:20.616: INFO: pod-configmaps-8e4ed820-abd6-4c7a-ba94-4e31eb194bb4 started at 2021-05-14 21:53:20 +0000 UTC (0+1 container statuses recorded) May 14 21:55:20.616: INFO: Container env-test ready: false, restart count 0 May 14 21:55:20.616: INFO: adopt-release-kfjkh started at 2021-05-14 21:45:12 +0000 UTC (0+1 container statuses recorded) May 14 21:55:20.617: INFO: Container c ready: false, restart count 0 May 14 21:55:20.617: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-2c2pw started at 2021-05-14 20:06:38 +0000 UTC (0+1 container statuses recorded) May 14 21:55:20.617: INFO: Container kube-sriovdp ready: true, restart count 0 May 14 21:55:20.617: INFO: ss2-0 started at 2021-05-14 21:50:46 +0000 UTC (0+1 container statuses recorded) May 14 21:55:20.617: INFO: Container webserver ready: false, restart count 0 May 14 21:55:20.617: INFO: node-feature-discovery-worker-76m6b started at 2021-05-14 20:05:42 +0000 UTC (0+1 container statuses recorded) May 14 21:55:20.617: INFO: Container nfd-worker ready: true, restart count 0 May 14 21:55:20.617: INFO: cmk-d2qwf started at 2021-05-14 20:09:04 +0000 UTC (0+2 container statuses recorded) May 14 21:55:20.617: INFO: Container nodereport ready: true, restart count 0 May 14 21:55:20.617: INFO: Container reconcile ready: true, restart count 0 May 14 21:55:20.617: INFO: cmk-webhook-6c9d5f8578-pjgxh started at 2021-05-14 20:09:04 +0000 UTC (0+1 container statuses recorded) May 14 21:55:20.617: INFO: Container cmk-webhook ready: true, restart count 0 May 14 21:55:20.617: INFO: cmk-init-discover-node2-j75ff started at 2021-05-14 20:08:41 +0000 UTC (0+3 container statuses recorded) May 14 21:55:20.617: INFO: Container discover ready: false, restart count 0 May 14 21:55:20.617: INFO: Container init ready: false, restart count 0 May 14 21:55:20.617: INFO: Container install ready: false, restart count 0 May 14 21:55:20.617: INFO: pod-adoption-release started at 2021-05-14 21:51:21 +0000 UTC (0+1 container statuses recorded) May 14 21:55:20.617: INFO: Container pod-adoption-release ready: false, restart count 0 W0514 21:55:20.633318 35 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 14 21:55:20.682: INFO: Latency metrics for node node2 May 14 21:55:20.682: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "pods-6423" for this suite.