/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 May 21 21:20:02.943: Unexpected error: <*errors.errorString | 0xc0002c4200>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:103 [BeforeEach] [sig-apps] ReplicaSet /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client May 21 21:15:02.902: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename replicaset STEP: Waiting for a default service account to be provisioned in namespace [It] should adopt matching pods on creation and release no longer matching pods [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Given a Pod with a 'name' label pod-adoption-release is created May 21 21:20:02.943: FAIL: Unexpected error: <*errors.errorString | 0xc0002c4200>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*PodClient).CreateSync(0xc003adf820, 0xc003d22000, 0x4be824b) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:103 +0xfe k8s.io/kubernetes/test/e2e/apps.testRSAdoptMatchingAndReleaseNotMatching(0xc0015b54a0) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/replica_set.go:264 +0x233 k8s.io/kubernetes/test/e2e/apps.glob..func9.4() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/replica_set.go:115 +0x2a k8s.io/kubernetes/test/e2e.RunE2ETests(0xc001902480) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc001902480) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc001902480, 0x4de37a0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [sig-apps] ReplicaSet /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "replicaset-1060". STEP: Found 9 events. May 21 21:20:02.947: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for pod-adoption-release: { } Scheduled: Successfully assigned replicaset-1060/pod-adoption-release to node1 May 21 21:20:02.947: INFO: At 2021-05-21 21:15:04 +0000 UTC - event for pod-adoption-release: {multus } AddedInterface: Add eth0 [10.244.3.46/24] May 21 21:20:02.947: INFO: At 2021-05-21 21:15:04 +0000 UTC - event for pod-adoption-release: {kubelet node1} Pulling: Pulling image "docker.io/library/httpd:2.4.38-alpine" May 21 21:20:02.947: INFO: At 2021-05-21 21:15:05 +0000 UTC - event for pod-adoption-release: {kubelet node1} Failed: Failed to pull image "docker.io/library/httpd:2.4.38-alpine": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit May 21 21:20:02.947: INFO: At 2021-05-21 21:15:05 +0000 UTC - event for pod-adoption-release: {kubelet node1} Failed: Error: ErrImagePull May 21 21:20:02.947: INFO: At 2021-05-21 21:15:06 +0000 UTC - event for pod-adoption-release: {kubelet node1} SandboxChanged: Pod sandbox changed, it will be killed and re-created. May 21 21:20:02.947: INFO: At 2021-05-21 21:15:07 +0000 UTC - event for pod-adoption-release: {multus } AddedInterface: Add eth0 [10.244.3.47/24] May 21 21:20:02.947: INFO: At 2021-05-21 21:15:07 +0000 UTC - event for pod-adoption-release: {kubelet node1} BackOff: Back-off pulling image "docker.io/library/httpd:2.4.38-alpine" May 21 21:20:02.947: INFO: At 2021-05-21 21:15:07 +0000 UTC - event for pod-adoption-release: {kubelet node1} Failed: Error: ImagePullBackOff May 21 21:20:02.950: INFO: POD NODE PHASE GRACE CONDITIONS May 21 21:20:02.950: INFO: pod-adoption-release node1 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-05-21 21:15:02 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-05-21 21:15:02 +0000 UTC ContainersNotReady containers with unready status: [pod-adoption-release]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-05-21 21:15:02 +0000 UTC ContainersNotReady containers with unready status: [pod-adoption-release]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-05-21 21:15:02 +0000 UTC }] May 21 21:20:02.950: INFO: May 21 21:20:02.954: INFO: Logging node info for node master1 May 21 21:20:02.957: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 18cf10c1-c08b-4d36-bbe6-5aa86f02296e 25314 0 2021-05-21 19:55:07 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"d2:e0:bb:d8:54:80"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-21 19:55:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-21 19:55:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-21 19:57:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-21 19:57:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-05-21 20:04:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234763776 0} {<nil>} 196518324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324599808 0} {<nil>} 195629492Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-21 19:59:55 +0000 UTC,LastTransitionTime:2021-05-21 19:59:55 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-21 21:20:01 +0000 UTC,LastTransitionTime:2021-05-21 19:55:07 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-21 21:20:01 +0000 UTC,LastTransitionTime:2021-05-21 19:55:07 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-21 21:20:01 +0000 UTC,LastTransitionTime:2021-05-21 19:55:07 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-21 21:20:01 +0000 UTC,LastTransitionTime:2021-05-21 19:59:16 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0b916e2f445c4d05b6a9058a788d9410,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:ab86499b-409f-44c9-86ff-e9bc113e4112,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:f013255695f4515c5b21b11281c7e0fb491082d15ec5a96adb8217e015a9c422 tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:50746f542c19fda01d88ae124ce58c5a326dad7cd24d3c2d19fdf959cc7f0c49 tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 21 21:20:02.958: INFO: Logging kubelet events for node master1 May 21 21:20:02.961: INFO: Logging pods the kubelet thinks is on node master1 May 21 21:20:02.986: INFO: node-feature-discovery-controller-5bf5c49849-ktcdq started at 2021-05-21 20:03:57 +0000 UTC (0+1 container statuses recorded) May 21 21:20:02.986: INFO: Container nfd-controller ready: true, restart count 0 May 21 21:20:02.986: INFO: node-exporter-m7jht started at 2021-05-21 20:07:54 +0000 UTC (0+2 container statuses recorded) May 21 21:20:02.986: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:20:02.986: INFO: Container node-exporter ready: true, restart count 0 May 21 21:20:02.986: INFO: kube-scheduler-master1 started at 2021-05-21 19:59:16 +0000 UTC (0+1 container statuses recorded) May 21 21:20:02.986: INFO: Container kube-scheduler ready: true, restart count 0 May 21 21:20:02.986: INFO: kube-apiserver-master1 started at 2021-05-21 20:03:10 +0000 UTC (0+1 container statuses recorded) May 21 21:20:02.986: INFO: Container kube-apiserver ready: true, restart count 0 May 21 21:20:02.986: INFO: kube-controller-manager-master1 started at 2021-05-21 19:59:16 +0000 UTC (0+1 container statuses recorded) May 21 21:20:02.986: INFO: Container kube-controller-manager ready: true, restart count 3 May 21 21:20:02.986: INFO: kube-multus-ds-amd64-z8khx started at 2021-05-21 19:57:42 +0000 UTC (0+1 container statuses recorded) May 21 21:20:02.986: INFO: Container kube-multus ready: true, restart count 1 May 21 21:20:02.986: INFO: docker-registry-docker-registry-56cbc7bc58-mft7s started at 2021-05-21 20:00:26 +0000 UTC (0+2 container statuses recorded) May 21 21:20:02.986: INFO: Container docker-registry ready: true, restart count 0 May 21 21:20:02.986: INFO: Container nginx ready: true, restart count 0 May 21 21:20:02.986: INFO: kube-proxy-zv2rb started at 2021-05-21 19:57:00 +0000 UTC (0+1 container statuses recorded) May 21 21:20:02.986: INFO: Container kube-proxy ready: true, restart count 2 May 21 21:20:02.986: INFO: kube-flannel-5lkd2 started at 2021-05-21 19:57:34 +0000 UTC (1+1 container statuses recorded) May 21 21:20:02.986: INFO: Init container install-cni ready: true, restart count 0 May 21 21:20:02.986: INFO: Container kube-flannel ready: true, restart count 2 W0521 21:20:02.998410 25 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 21 21:20:03.021: INFO: Latency metrics for node master1 May 21 21:20:03.021: INFO: Logging node info for node master2 May 21 21:20:03.023: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 d439093b-ce44-47e7-8b41-5739b7c49ca5 25291 0 2021-05-21 19:55:46 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"62:5a:fb:0b:f8:b0"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-21 19:55:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-21 19:55:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-21 19:57:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-21 19:57:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234763776 0} {<nil>} 196518324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324599808 0} {<nil>} 195629492Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-21 20:00:49 +0000 UTC,LastTransitionTime:2021-05-21 20:00:49 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-21 21:19:55 +0000 UTC,LastTransitionTime:2021-05-21 19:55:46 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-21 21:19:55 +0000 UTC,LastTransitionTime:2021-05-21 19:55:46 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-21 21:19:55 +0000 UTC,LastTransitionTime:2021-05-21 19:55:46 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-21 21:19:55 +0000 UTC,LastTransitionTime:2021-05-21 19:57:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:495d1cf47bdb4c7e982c636c95de5648,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:cca785c0-d61e-403e-91fd-d0d4f3fa573c,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 21 21:20:03.024: INFO: Logging kubelet events for node master2 May 21 21:20:03.025: INFO: Logging pods the kubelet thinks is on node master2 May 21 21:20:03.038: INFO: kube-apiserver-master2 started at 2021-05-21 20:03:00 +0000 UTC (0+1 container statuses recorded) May 21 21:20:03.038: INFO: Container kube-apiserver ready: true, restart count 0 May 21 21:20:03.038: INFO: coredns-7677f9bb54-lv5gk started at 2021-05-21 19:58:07 +0000 UTC (0+1 container statuses recorded) May 21 21:20:03.038: INFO: Container coredns ready: true, restart count 1 May 21 21:20:03.038: INFO: kube-proxy-shdjd started at 2021-05-21 19:57:00 +0000 UTC (0+1 container statuses recorded) May 21 21:20:03.038: INFO: Container kube-proxy ready: true, restart count 1 May 21 21:20:03.038: INFO: kube-flannel-tnf5x started at 2021-05-21 19:57:34 +0000 UTC (1+1 container statuses recorded) May 21 21:20:03.038: INFO: Init container install-cni ready: true, restart count 0 May 21 21:20:03.038: INFO: Container kube-flannel ready: true, restart count 1 May 21 21:20:03.038: INFO: kube-multus-ds-amd64-lwzkr started at 2021-05-21 19:57:42 +0000 UTC (0+1 container statuses recorded) May 21 21:20:03.038: INFO: Container kube-multus ready: true, restart count 1 May 21 21:20:03.038: INFO: dns-autoscaler-5b7b5c9b6f-dvlvw started at 2021-05-21 19:58:05 +0000 UTC (0+1 container statuses recorded) May 21 21:20:03.038: INFO: Container autoscaler ready: true, restart count 2 May 21 21:20:03.038: INFO: node-exporter-q52l5 started at 2021-05-21 20:07:54 +0000 UTC (0+2 container statuses recorded) May 21 21:20:03.038: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:20:03.038: INFO: Container node-exporter ready: true, restart count 0 May 21 21:20:03.038: INFO: kube-controller-manager-master2 started at 2021-05-21 19:59:58 +0000 UTC (0+1 container statuses recorded) May 21 21:20:03.038: INFO: Container kube-controller-manager ready: true, restart count 2 May 21 21:20:03.038: INFO: kube-scheduler-master2 started at 2021-05-21 20:00:08 +0000 UTC (0+1 container statuses recorded) May 21 21:20:03.038: INFO: Container kube-scheduler ready: true, restart count 2 W0521 21:20:03.048951 25 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 21 21:20:03.071: INFO: Latency metrics for node master2 May 21 21:20:03.071: INFO: Logging node info for node master3 May 21 21:20:03.076: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 23066049-f3f1-42a7-9cea-19e20ed4ccec 25320 0 2021-05-21 19:55:56 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:a6:e4:e7:ba:02"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-21 19:55:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-21 19:55:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-21 19:57:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-21 19:57:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234767872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324603904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-21 20:00:41 +0000 UTC,LastTransitionTime:2021-05-21 20:00:41 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-21 21:20:02 +0000 UTC,LastTransitionTime:2021-05-21 19:55:56 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-21 21:20:02 +0000 UTC,LastTransitionTime:2021-05-21 19:55:56 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-21 21:20:02 +0000 UTC,LastTransitionTime:2021-05-21 19:55:56 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-21 21:20:02 +0000 UTC,LastTransitionTime:2021-05-21 19:57:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:660844f5cb0944868621042562b928e3,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:02066ff3-4833-4130-ba94-138c581e4cc0,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 21 21:20:03.077: INFO: Logging kubelet events for node master3 May 21 21:20:03.079: INFO: Logging pods the kubelet thinks is on node master3 May 21 21:20:03.092: INFO: coredns-7677f9bb54-gjt42 started at 2021-05-21 19:58:03 +0000 UTC (0+1 container statuses recorded) May 21 21:20:03.092: INFO: Container coredns ready: true, restart count 1 May 21 21:20:03.092: INFO: node-exporter-s74rx started at 2021-05-21 20:07:54 +0000 UTC (0+2 container statuses recorded) May 21 21:20:03.092: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:20:03.092: INFO: Container node-exporter ready: true, restart count 0 May 21 21:20:03.092: INFO: kube-controller-manager-master3 started at 2021-05-21 20:03:00 +0000 UTC (0+1 container statuses recorded) May 21 21:20:03.092: INFO: Container kube-controller-manager ready: true, restart count 1 May 21 21:20:03.092: INFO: kube-scheduler-master3 started at 2021-05-21 20:03:10 +0000 UTC (0+1 container statuses recorded) May 21 21:20:03.092: INFO: Container kube-scheduler ready: true, restart count 1 May 21 21:20:03.092: INFO: kube-apiserver-master3 started at 2021-05-21 20:03:20 +0000 UTC (0+1 container statuses recorded) May 21 21:20:03.092: INFO: Container kube-apiserver ready: true, restart count 0 May 21 21:20:03.092: INFO: kube-proxy-hwwxt started at 2021-05-21 19:57:00 +0000 UTC (0+1 container statuses recorded) May 21 21:20:03.092: INFO: Container kube-proxy ready: true, restart count 2 May 21 21:20:03.092: INFO: kube-flannel-8sd6n started at 2021-05-21 19:57:34 +0000 UTC (1+1 container statuses recorded) May 21 21:20:03.092: INFO: Init container install-cni ready: true, restart count 0 May 21 21:20:03.092: INFO: Container kube-flannel ready: true, restart count 1 May 21 21:20:03.092: INFO: kube-multus-ds-amd64-zgdbl started at 2021-05-21 19:57:42 +0000 UTC (0+1 container statuses recorded) May 21 21:20:03.092: INFO: Container kube-multus ready: true, restart count 1 W0521 21:20:03.105226 25 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 21 21:20:03.128: INFO: Latency metrics for node master3 May 21 21:20:03.128: INFO: Logging node info for node node1 May 21 21:20:03.130: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 62cfecb3-af08-42a4-ab85-25a317061b61 25305 0 2021-05-21 19:56:58 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"22:2e:2b:06:83:4a"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-21 19:56:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-05-21 19:56:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-21 19:57:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-21 20:04:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-21 20:06:20 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-21 20:06:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269628928 0} {<nil>} 196552372Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884628480 0} {<nil>} 174692020Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-21 20:00:36 +0000 UTC,LastTransitionTime:2021-05-21 20:00:36 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-21 21:19:59 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-21 21:19:59 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-21 21:19:59 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-21 21:19:59 +0000 UTC,LastTransitionTime:2021-05-21 19:57:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:94b7bb79c41d4a0492f63fb5fb3c5cc0,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:1e94d819-8d68-4948-b171-5fd2d8fc7ff5,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:2b114e08442070e7232fcffc4cb89529bd5c9effe733ed690277a33772bf2d00 localhost:30500/barometer-collectd:stable],SizeBytes:1464382814,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:1002487865,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:ed5c574f653e2a39e784ff322033a2319aafde7366c803a88f20f7a2a8bc1efb opnfv/barometer-collectd:stable],SizeBytes:825413035,},ContainerImage{Names:[localhost:30500/cmk@sha256:1d865c665dfeeec5a879dca7b9945cc49f55f10921b4e729f0da0cdec7dedbf7 cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[golang@sha256:1636899c10870ab66c48d960a9df620f4f9e86a0c72fbacf36032d27404e7e6c golang:alpine3.12],SizeBytes:301156062,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:a4dc6d912ce1a8dd4c3a51b1cfb52454080ed36db95bf824895d5ecb7175199f nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392673,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:36553b10a4947067b9fbb7d532951066293a68eae893beba1d9235f7d11a20ad alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 21 21:20:03.131: INFO: Logging kubelet events for node node1 May 21 21:20:03.133: INFO: Logging pods the kubelet thinks is on node node1 May 21 21:20:03.149: INFO: node-feature-discovery-worker-lh5hz started at 2021-05-21 20:03:47 +0000 UTC (0+1 container statuses recorded) May 21 21:20:03.149: INFO: Container nfd-worker ready: true, restart count 0 May 21 21:20:03.149: INFO: pod-adoption-release started at 2021-05-21 21:15:02 +0000 UTC (0+1 container statuses recorded) May 21 21:20:03.149: INFO: Container pod-adoption-release ready: false, restart count 0 May 21 21:20:03.150: INFO: kubernetes-dashboard-86c6f9df5b-8rsws started at 2021-05-21 19:58:07 +0000 UTC (0+1 container statuses recorded) May 21 21:20:03.150: INFO: Container kubernetes-dashboard ready: true, restart count 1 May 21 21:20:03.150: INFO: kubernetes-metrics-scraper-678c97765c-nnrtl started at 2021-05-21 19:58:07 +0000 UTC (0+1 container statuses recorded) May 21 21:20:03.150: INFO: Container kubernetes-metrics-scraper ready: true, restart count 2 May 21 21:20:03.150: INFO: prometheus-operator-5bb8cb9d8f-mzlrf started at 2021-05-21 20:07:47 +0000 UTC (0+2 container statuses recorded) May 21 21:20:03.150: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:20:03.150: INFO: Container prometheus-operator ready: true, restart count 0 May 21 21:20:03.150: INFO: node-exporter-l5k2r started at 2021-05-21 20:07:54 +0000 UTC (0+2 container statuses recorded) May 21 21:20:03.150: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:20:03.150: INFO: Container node-exporter ready: true, restart count 0 May 21 21:20:03.150: INFO: kube-multus-ds-amd64-wlmhr started at 2021-05-21 19:57:42 +0000 UTC (0+1 container statuses recorded) May 21 21:20:03.150: INFO: Container kube-multus ready: true, restart count 1 May 21 21:20:03.150: INFO: pod-update-fd09fc2c-3e6f-44f8-9eb3-5248c2fbd1a3 started at 2021-05-21 21:15:36 +0000 UTC (0+1 container statuses recorded) May 21 21:20:03.150: INFO: Container nginx ready: false, restart count 0 May 21 21:20:03.150: INFO: cmk-h8jxp started at 2021-05-21 20:07:00 +0000 UTC (0+2 container statuses recorded) May 21 21:20:03.150: INFO: Container nodereport ready: true, restart count 0 May 21 21:20:03.150: INFO: Container reconcile ready: true, restart count 0 May 21 21:20:03.150: INFO: prometheus-k8s-0 started at 2021-05-21 20:08:06 +0000 UTC (0+5 container statuses recorded) May 21 21:20:03.150: INFO: Container custom-metrics-apiserver ready: true, restart count 0 May 21 21:20:03.150: INFO: Container grafana ready: true, restart count 0 May 21 21:20:03.150: INFO: Container prometheus ready: true, restart count 1 May 21 21:20:03.150: INFO: Container prometheus-config-reloader ready: true, restart count 0 May 21 21:20:03.150: INFO: Container rules-configmap-reloader ready: true, restart count 0 May 21 21:20:03.150: INFO: nginx-proxy-node1 started at 2021-05-21 20:03:00 +0000 UTC (0+1 container statuses recorded) May 21 21:20:03.150: INFO: Container nginx-proxy ready: true, restart count 1 May 21 21:20:03.150: INFO: server-envvars-71ee385c-8848-4254-9b4d-2a1fe8ea0807 started at 2021-05-21 21:14:55 +0000 UTC (0+1 container statuses recorded) May 21 21:20:03.150: INFO: Container srv ready: true, restart count 0 May 21 21:20:03.150: INFO: pod-configmaps-f8ff46e8-e011-4bc2-bd13-017b7dcdfb9a started at 2021-05-21 21:17:48 +0000 UTC (0+1 container statuses recorded) May 21 21:20:03.150: INFO: Container env-test ready: false, restart count 0 May 21 21:20:03.150: INFO: tester started at 2021-05-21 21:17:51 +0000 UTC (0+1 container statuses recorded) May 21 21:20:03.150: INFO: Container tester ready: false, restart count 0 May 21 21:20:03.150: INFO: kube-flannel-k6mr4 started at 2021-05-21 19:57:34 +0000 UTC (1+1 container statuses recorded) May 21 21:20:03.150: INFO: Init container install-cni ready: true, restart count 1 May 21 21:20:03.150: INFO: Container kube-flannel ready: true, restart count 1 May 21 21:20:03.150: INFO: collectd-mc5kl started at 2021-05-21 20:13:40 +0000 UTC (0+3 container statuses recorded) May 21 21:20:03.150: INFO: Container collectd ready: true, restart count 0 May 21 21:20:03.150: INFO: Container collectd-exporter ready: true, restart count 0 May 21 21:20:03.150: INFO: Container rbac-proxy ready: true, restart count 0 May 21 21:20:03.150: INFO: cmk-webhook-6c9d5f8578-8pz6w started at 2021-05-21 20:07:00 +0000 UTC (0+1 container statuses recorded) May 21 21:20:03.150: INFO: Container cmk-webhook ready: true, restart count 0 May 21 21:20:03.150: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-czhnm started at 2021-05-21 20:04:29 +0000 UTC (0+1 container statuses recorded) May 21 21:20:03.150: INFO: Container kube-sriovdp ready: true, restart count 0 May 21 21:20:03.150: INFO: cmk-init-discover-node1-48g7j started at 2021-05-21 20:06:17 +0000 UTC (0+3 container statuses recorded) May 21 21:20:03.150: INFO: Container discover ready: false, restart count 0 May 21 21:20:03.150: INFO: Container init ready: false, restart count 0 May 21 21:20:03.150: INFO: Container install ready: false, restart count 0 May 21 21:20:03.150: INFO: pod-service-account-9063e557-907a-493a-b7cd-825f7ed4c069 started at 2021-05-21 21:16:26 +0000 UTC (0+1 container statuses recorded) May 21 21:20:03.150: INFO: Container test ready: false, restart count 0 May 21 21:20:03.150: INFO: kube-proxy-h5k9s started at 2021-05-21 19:57:00 +0000 UTC (0+1 container statuses recorded) May 21 21:20:03.150: INFO: Container kube-proxy ready: true, restart count 1 W0521 21:20:03.160166 25 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 21 21:20:03.188: INFO: Latency metrics for node node1 May 21 21:20:03.188: INFO: Logging node info for node node2 May 21 21:20:03.190: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 3f64ce47-e96b-43b8-9c91-df57a4e26826 25288 0 2021-05-21 19:56:58 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"4e:d8:e9:66:bc:b7"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-21 19:56:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-05-21 19:56:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-21 19:57:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-21 20:04:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-21 20:06:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-21 20:06:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269633024 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884632576 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-21 20:00:39 +0000 UTC,LastTransitionTime:2021-05-21 20:00:39 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-21 21:19:54 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-21 21:19:54 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-21 21:19:54 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-21 21:19:54 +0000 UTC,LastTransitionTime:2021-05-21 19:57:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:2aa9b8566664435b84c4146a11c874db,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:befe5c4e-169e-4c36-9e45-742bb80d4660,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:2b114e08442070e7232fcffc4cb89529bd5c9effe733ed690277a33772bf2d00 localhost:30500/barometer-collectd:stable],SizeBytes:1464382814,},ContainerImage{Names:[localhost:30500/cmk@sha256:1d865c665dfeeec5a879dca7b9945cc49f55f10921b4e729f0da0cdec7dedbf7 localhost:30500/cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:a4dc6d912ce1a8dd4c3a51b1cfb52454080ed36db95bf824895d5ecb7175199f localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392673,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:f013255695f4515c5b21b11281c7e0fb491082d15ec5a96adb8217e015a9c422 localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:50746f542c19fda01d88ae124ce58c5a326dad7cd24d3c2d19fdf959cc7f0c49 localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 21 21:20:03.191: INFO: Logging kubelet events for node node2 May 21 21:20:03.192: INFO: Logging pods the kubelet thinks is on node node2 May 21 21:20:03.211: INFO: fail-once-local-zv48g started at 2021-05-21 21:14:59 +0000 UTC (0+1 container statuses recorded) May 21 21:20:03.211: INFO: Container c ready: false, restart count 0 May 21 21:20:03.211: INFO: ss2-0 started at 2021-05-21 21:15:09 +0000 UTC (0+1 container statuses recorded) May 21 21:20:03.211: INFO: Container webserver ready: false, restart count 0 May 21 21:20:03.211: INFO: kube-multus-ds-amd64-6q46t started at 2021-05-21 19:57:42 +0000 UTC (0+1 container statuses recorded) May 21 21:20:03.211: INFO: Container kube-multus ready: true, restart count 1 May 21 21:20:03.211: INFO: cmk-init-discover-node2-p7sdn started at 2021-05-21 20:06:37 +0000 UTC (0+3 container statuses recorded) May 21 21:20:03.212: INFO: Container discover ready: false, restart count 0 May 21 21:20:03.212: INFO: Container init ready: false, restart count 0 May 21 21:20:03.212: INFO: Container install ready: false, restart count 0 May 21 21:20:03.212: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-8kddc started at 2021-05-21 20:10:49 +0000 UTC (0+2 container statuses recorded) May 21 21:20:03.212: INFO: Container tas-controller ready: true, restart count 0 May 21 21:20:03.212: INFO: Container tas-extender ready: true, restart count 0 May 21 21:20:03.212: INFO: nginx-proxy-node2 started at 2021-05-21 20:03:00 +0000 UTC (0+1 container statuses recorded) May 21 21:20:03.212: INFO: Container nginx-proxy ready: true, restart count 2 May 21 21:20:03.212: INFO: server started at 2021-05-21 21:17:47 +0000 UTC (0+1 container statuses recorded) May 21 21:20:03.212: INFO: Container agnhost-container ready: true, restart count 0 May 21 21:20:03.212: INFO: collectd-tz5h5 started at 2021-05-21 20:13:40 +0000 UTC (0+3 container statuses recorded) May 21 21:20:03.212: INFO: Container collectd ready: true, restart count 0 May 21 21:20:03.212: INFO: Container collectd-exporter ready: true, restart count 0 May 21 21:20:03.212: INFO: Container rbac-proxy ready: true, restart count 0 May 21 21:20:03.212: INFO: var-expansion-d0e58258-191a-4ad3-a43e-274219c020b4 started at 2021-05-21 21:16:18 +0000 UTC (0+1 container statuses recorded) May 21 21:20:03.212: INFO: Container dapi-container ready: false, restart count 0 May 21 21:20:03.212: INFO: fail-once-local-tcmn7 started at 2021-05-21 21:14:59 +0000 UTC (0+1 container statuses recorded) May 21 21:20:03.212: INFO: Container c ready: false, restart count 0 May 21 21:20:03.212: INFO: kube-proxy-q57hf started at 2021-05-21 19:57:00 +0000 UTC (0+1 container statuses recorded) May 21 21:20:03.212: INFO: Container kube-proxy ready: true, restart count 2 May 21 21:20:03.212: INFO: node-feature-discovery-worker-28kx4 started at 2021-05-21 20:03:47 +0000 UTC (0+1 container statuses recorded) May 21 21:20:03.212: INFO: Container nfd-worker ready: true, restart count 0 May 21 21:20:03.212: INFO: cmk-j2nnh started at 2021-05-21 20:07:00 +0000 UTC (0+2 container statuses recorded) May 21 21:20:03.212: INFO: Container nodereport ready: true, restart count 0 May 21 21:20:03.212: INFO: Container reconcile ready: true, restart count 0 May 21 21:20:03.212: INFO: node-exporter-c46fg started at 2021-05-21 20:07:54 +0000 UTC (0+2 container statuses recorded) May 21 21:20:03.212: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:20:03.212: INFO: Container node-exporter ready: true, restart count 0 May 21 21:20:03.212: INFO: kube-flannel-5p7gq started at 2021-05-21 19:57:34 +0000 UTC (1+1 container statuses recorded) May 21 21:20:03.212: INFO: Init container install-cni ready: true, restart count 2 May 21 21:20:03.212: INFO: Container kube-flannel ready: true, restart count 2 May 21 21:20:03.212: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-j7fm6 started at 2021-05-21 20:04:29 +0000 UTC (0+1 container statuses recorded) May 21 21:20:03.212: INFO: Container kube-sriovdp ready: true, restart count 0 May 21 21:20:03.212: INFO: ss2-0 started at 2021-05-21 21:14:55 +0000 UTC (0+1 container statuses recorded) May 21 21:20:03.212: INFO: Container webserver ready: false, restart count 0 W0521 21:20:03.225497 25 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 21 21:20:03.256: INFO: Latency metrics for node node2 May 21 21:20:03.256: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "replicaset-1060" for this suite. /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 May 21 21:25:40.500: Unexpected error: <*errors.errorString | 0xc003e8f780>: { s: "expected pod \"downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab\" success: Gave up after waiting 5m0s for pod \"downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab\" to be \"Succeeded or Failed\"", } expected pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab" success: Gave up after waiting 5m0s for pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab" to be "Succeeded or Failed" occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 [BeforeEach] [sig-node] Downward API /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client May 21 21:20:37.899: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename downward-api STEP: Waiting for a default service account to be provisioned in namespace [It] should provide pod name, namespace and IP address as env vars [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating a pod to test downward api env vars May 21 21:20:37.930: INFO: Waiting up to 5m0s for pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab" in namespace "downward-api-6633" to be "Succeeded or Failed" May 21 21:20:37.933: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 2.771689ms May 21 21:20:39.936: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 2.005559195s May 21 21:20:41.941: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 4.01072441s May 21 21:20:43.944: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 6.013667566s May 21 21:20:45.948: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 8.017401882s May 21 21:20:47.952: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 10.021912592s May 21 21:20:49.955: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 12.025244648s May 21 21:20:51.959: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 14.028531604s May 21 21:20:53.961: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 16.031288185s May 21 21:20:55.965: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 18.035167251s May 21 21:20:57.970: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 20.040129346s May 21 21:20:59.974: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 22.043570639s May 21 21:21:01.978: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 24.047762433s May 21 21:21:03.983: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 26.053258589s May 21 21:21:05.988: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 28.058013636s May 21 21:21:07.991: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 30.060363144s May 21 21:21:09.994: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 32.063527715s May 21 21:21:11.998: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 34.068173058s May 21 21:21:14.004: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 36.074001517s May 21 21:21:16.009: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 38.078736222s May 21 21:21:18.014: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 40.083809462s May 21 21:21:20.017: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 42.087266471s May 21 21:21:22.021: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 44.091134009s May 21 21:21:24.024: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 46.094338148s May 21 21:21:26.027: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 48.097228566s May 21 21:21:28.031: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 50.100424076s May 21 21:21:30.033: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 52.103164011s May 21 21:21:32.036: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 54.1061406s May 21 21:21:34.041: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 56.110516023s May 21 21:21:36.044: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 58.114022723s May 21 21:21:38.048: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.11771854s May 21 21:21:40.052: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.121445057s May 21 21:21:42.056: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.126173051s May 21 21:21:44.060: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.129934619s May 21 21:21:46.065: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.134351419s May 21 21:21:48.070: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.139775995s May 21 21:21:50.075: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.144608877s May 21 21:21:52.081: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.150759785s May 21 21:21:54.086: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.156307504s May 21 21:21:56.090: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.160198213s May 21 21:21:58.093: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.163140163s May 21 21:22:00.100: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.17027557s May 21 21:22:02.104: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.174286564s May 21 21:22:04.109: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.178477022s May 21 21:22:06.112: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.181693485s May 21 21:22:08.115: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.184660453s May 21 21:22:10.118: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.187793488s May 21 21:22:12.123: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.19321803s May 21 21:22:14.127: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.197158172s May 21 21:22:16.132: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.201436965s May 21 21:22:18.136: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.205987681s May 21 21:22:20.141: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.210663363s May 21 21:22:22.146: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.215706524s May 21 21:22:24.148: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.218273408s May 21 21:22:26.151: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.221214064s May 21 21:22:28.156: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.225499408s May 21 21:22:30.160: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.23026134s May 21 21:22:32.165: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.23479373s May 21 21:22:34.168: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.237731184s May 21 21:22:36.171: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.240648064s May 21 21:22:38.175: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.24476367s May 21 21:22:40.180: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.249621356s May 21 21:22:42.185: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.25448055s May 21 21:22:44.187: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.257158467s May 21 21:22:46.191: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.260393129s May 21 21:22:48.194: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.264261922s May 21 21:22:50.197: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.267321844s May 21 21:22:52.201: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.270490007s May 21 21:22:54.205: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.274694006s May 21 21:22:56.208: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.278148223s May 21 21:22:58.212: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.282055148s May 21 21:23:00.215: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.284613999s May 21 21:23:02.217: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.287256337s May 21 21:23:04.221: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.290970322s May 21 21:23:06.225: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.294659397s May 21 21:23:08.228: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.298285657s May 21 21:23:10.232: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.302188878s May 21 21:23:12.236: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.30603855s May 21 21:23:14.239: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.308599021s May 21 21:23:16.242: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.312330675s May 21 21:23:18.246: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.315531536s May 21 21:23:20.250: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.31968306s May 21 21:23:22.252: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.322233769s May 21 21:23:24.256: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.32564206s May 21 21:23:26.259: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.329035048s May 21 21:23:28.262: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.3322659s May 21 21:23:30.266: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.335531703s May 21 21:23:32.269: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.338365417s May 21 21:23:34.273: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.342460752s May 21 21:23:36.276: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.345538348s May 21 21:23:38.279: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.349268131s May 21 21:23:40.282: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.35213672s May 21 21:23:42.285: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.355287312s May 21 21:23:44.289: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.359191441s May 21 21:23:46.293: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.362644372s May 21 21:23:48.298: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.367421903s May 21 21:23:50.301: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.370480241s May 21 21:23:52.304: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.373937238s May 21 21:23:54.307: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.376813421s May 21 21:23:56.311: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.380378641s May 21 21:23:58.314: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.383693964s May 21 21:24:00.318: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.387585539s May 21 21:24:02.321: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.390906556s May 21 21:24:04.324: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.394315069s May 21 21:24:06.328: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.39826689s May 21 21:24:08.331: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.401057866s May 21 21:24:10.335: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.405243793s May 21 21:24:12.338: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.407981342s May 21 21:24:14.341: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.410628495s May 21 21:24:16.344: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.413358357s May 21 21:24:18.347: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.416370043s May 21 21:24:20.350: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.419774539s May 21 21:24:22.353: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.422860393s May 21 21:24:24.357: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.426530602s May 21 21:24:26.360: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.430073189s May 21 21:24:28.364: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.43394699s May 21 21:24:30.367: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.437264062s May 21 21:24:32.370: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.439740374s May 21 21:24:34.372: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.442026345s May 21 21:24:36.375: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.444856369s May 21 21:24:38.377: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.447183882s May 21 21:24:40.381: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.450511086s May 21 21:24:42.383: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.453049896s May 21 21:24:44.387: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.456805793s May 21 21:24:46.391: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.460450402s May 21 21:24:48.394: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.463761475s May 21 21:24:50.398: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.467980029s May 21 21:24:52.403: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.472623488s May 21 21:24:54.406: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.475847627s May 21 21:24:56.410: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.47949963s May 21 21:24:58.412: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.482118392s May 21 21:25:00.415: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.485213284s May 21 21:25:02.418: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.48823225s May 21 21:25:04.423: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.493322242s May 21 21:25:06.426: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.495943539s May 21 21:25:08.432: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.501636681s May 21 21:25:10.435: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.504784323s May 21 21:25:12.439: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.508523952s May 21 21:25:14.442: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.512097683s May 21 21:25:16.445: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.515193632s May 21 21:25:18.449: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.519266793s May 21 21:25:20.453: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.522803181s May 21 21:25:22.456: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.525461026s May 21 21:25:24.458: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.528106114s May 21 21:25:26.462: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.531541505s May 21 21:25:28.465: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.535317591s May 21 21:25:30.469: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.538823505s May 21 21:25:32.472: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.541869282s May 21 21:25:34.476: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.545588348s May 21 21:25:36.480: INFO: Pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.549823829s May 21 21:25:38.487: INFO: Failed to get logs from node "node1" pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab" container "dapi-container": the server rejected our request for an unknown reason (get pods downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab) STEP: delete the pod May 21 21:25:38.492: INFO: Waiting for pod downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab to disappear May 21 21:25:38.495: INFO: Pod downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab still exists May 21 21:25:40.496: INFO: Waiting for pod downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab to disappear May 21 21:25:40.499: INFO: Pod downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab no longer exists May 21 21:25:40.500: FAIL: Unexpected error: <*errors.errorString | 0xc003e8f780>: { s: "expected pod \"downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab\" success: Gave up after waiting 5m0s for pod \"downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab\" to be \"Succeeded or Failed\"", } expected pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab" success: Gave up after waiting 5m0s for pod "downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab" to be "Succeeded or Failed" occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).testContainerOutputMatcher(0xc00004fa20, 0x4c29f00, 0x15, 0xc001df9000, 0x0, 0xc00162b1a8, 0x3, 0x3, 0x4de7490) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:725 +0x1ee k8s.io/kubernetes/test/e2e/framework.(*Framework).TestContainerOutputRegexp(...) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:532 k8s.io/kubernetes/test/e2e/common.testDownwardAPIUsingPod(...) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/downward_api.go:425 k8s.io/kubernetes/test/e2e/common.testDownwardAPI(0xc00004fa20, 0xc001b99dc0, 0x31, 0xc0035a4d80, 0x3, 0x3, 0xc00162b1a8, 0x3, 0x3) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/downward_api.go:391 +0x75c k8s.io/kubernetes/test/e2e/common.glob..func5.1() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/downward_api.go:80 +0x4e8 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc001902480) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc001902480) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc001902480, 0x4de37a0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [sig-node] Downward API /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "downward-api-6633". STEP: Found 9 events. May 21 21:25:40.505: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab: { } Scheduled: Successfully assigned downward-api-6633/downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab to node1 May 21 21:25:40.505: INFO: At 2021-05-21 21:20:39 +0000 UTC - event for downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab: {multus } AddedInterface: Add eth0 [10.244.3.65/24] May 21 21:25:40.505: INFO: At 2021-05-21 21:20:39 +0000 UTC - event for downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab: {kubelet node1} Pulling: Pulling image "docker.io/library/busybox:1.29" May 21 21:25:40.505: INFO: At 2021-05-21 21:20:40 +0000 UTC - event for downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab: {kubelet node1} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit May 21 21:25:40.505: INFO: At 2021-05-21 21:20:40 +0000 UTC - event for downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab: {kubelet node1} Failed: Error: ErrImagePull May 21 21:25:40.505: INFO: At 2021-05-21 21:20:40 +0000 UTC - event for downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab: {kubelet node1} SandboxChanged: Pod sandbox changed, it will be killed and re-created. May 21 21:25:40.505: INFO: At 2021-05-21 21:20:42 +0000 UTC - event for downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab: {multus } AddedInterface: Add eth0 [10.244.3.66/24] May 21 21:25:40.505: INFO: At 2021-05-21 21:20:42 +0000 UTC - event for downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab: {kubelet node1} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" May 21 21:25:40.505: INFO: At 2021-05-21 21:20:42 +0000 UTC - event for downward-api-17f278bd-07fe-4d1e-a855-c0a292923cab: {kubelet node1} Failed: Error: ImagePullBackOff May 21 21:25:40.507: INFO: POD NODE PHASE GRACE CONDITIONS May 21 21:25:40.507: INFO: May 21 21:25:40.511: INFO: Logging node info for node master1 May 21 21:25:40.513: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 18cf10c1-c08b-4d36-bbe6-5aa86f02296e 27813 0 2021-05-21 19:55:07 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"d2:e0:bb:d8:54:80"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-21 19:55:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-21 19:55:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-21 19:57:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-21 19:57:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-05-21 20:04:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234763776 0} {<nil>} 196518324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324599808 0} {<nil>} 195629492Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-21 19:59:55 +0000 UTC,LastTransitionTime:2021-05-21 19:59:55 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-21 21:25:33 +0000 UTC,LastTransitionTime:2021-05-21 19:55:07 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-21 21:25:33 +0000 UTC,LastTransitionTime:2021-05-21 19:55:07 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-21 21:25:33 +0000 UTC,LastTransitionTime:2021-05-21 19:55:07 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-21 21:25:33 +0000 UTC,LastTransitionTime:2021-05-21 19:59:16 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0b916e2f445c4d05b6a9058a788d9410,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:ab86499b-409f-44c9-86ff-e9bc113e4112,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:f013255695f4515c5b21b11281c7e0fb491082d15ec5a96adb8217e015a9c422 tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:50746f542c19fda01d88ae124ce58c5a326dad7cd24d3c2d19fdf959cc7f0c49 tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 21 21:25:40.513: INFO: Logging kubelet events for node master1 May 21 21:25:40.516: INFO: Logging pods the kubelet thinks is on node master1 May 21 21:25:40.524: INFO: kube-proxy-zv2rb started at 2021-05-21 19:57:00 +0000 UTC (0+1 container statuses recorded) May 21 21:25:40.524: INFO: Container kube-proxy ready: true, restart count 2 May 21 21:25:40.524: INFO: kube-flannel-5lkd2 started at 2021-05-21 19:57:34 +0000 UTC (1+1 container statuses recorded) May 21 21:25:40.524: INFO: Init container install-cni ready: true, restart count 0 May 21 21:25:40.524: INFO: Container kube-flannel ready: true, restart count 2 May 21 21:25:40.524: INFO: kube-controller-manager-master1 started at 2021-05-21 19:59:16 +0000 UTC (0+1 container statuses recorded) May 21 21:25:40.524: INFO: Container kube-controller-manager ready: true, restart count 3 May 21 21:25:40.524: INFO: kube-multus-ds-amd64-z8khx started at 2021-05-21 19:57:42 +0000 UTC (0+1 container statuses recorded) May 21 21:25:40.524: INFO: Container kube-multus ready: true, restart count 1 May 21 21:25:40.524: INFO: docker-registry-docker-registry-56cbc7bc58-mft7s started at 2021-05-21 20:00:26 +0000 UTC (0+2 container statuses recorded) May 21 21:25:40.524: INFO: Container docker-registry ready: true, restart count 0 May 21 21:25:40.524: INFO: Container nginx ready: true, restart count 0 May 21 21:25:40.524: INFO: node-feature-discovery-controller-5bf5c49849-ktcdq started at 2021-05-21 20:03:57 +0000 UTC (0+1 container statuses recorded) May 21 21:25:40.525: INFO: Container nfd-controller ready: true, restart count 0 May 21 21:25:40.525: INFO: node-exporter-m7jht started at 2021-05-21 20:07:54 +0000 UTC (0+2 container statuses recorded) May 21 21:25:40.525: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:25:40.525: INFO: Container node-exporter ready: true, restart count 0 May 21 21:25:40.525: INFO: kube-scheduler-master1 started at 2021-05-21 19:59:16 +0000 UTC (0+1 container statuses recorded) May 21 21:25:40.525: INFO: Container kube-scheduler ready: true, restart count 0 May 21 21:25:40.525: INFO: kube-apiserver-master1 started at 2021-05-21 20:03:10 +0000 UTC (0+1 container statuses recorded) May 21 21:25:40.525: INFO: Container kube-apiserver ready: true, restart count 0 W0521 21:25:40.536366 25 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 21 21:25:40.564: INFO: Latency metrics for node master1 May 21 21:25:40.564: INFO: Logging node info for node master2 May 21 21:25:40.567: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 d439093b-ce44-47e7-8b41-5739b7c49ca5 27864 0 2021-05-21 19:55:46 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"62:5a:fb:0b:f8:b0"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-21 19:55:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-21 19:55:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-21 19:57:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-21 19:57:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234763776 0} {<nil>} 196518324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324599808 0} {<nil>} 195629492Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-21 20:00:49 +0000 UTC,LastTransitionTime:2021-05-21 20:00:49 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-21 21:25:36 +0000 UTC,LastTransitionTime:2021-05-21 19:55:46 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-21 21:25:36 +0000 UTC,LastTransitionTime:2021-05-21 19:55:46 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-21 21:25:36 +0000 UTC,LastTransitionTime:2021-05-21 19:55:46 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-21 21:25:36 +0000 UTC,LastTransitionTime:2021-05-21 19:57:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:495d1cf47bdb4c7e982c636c95de5648,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:cca785c0-d61e-403e-91fd-d0d4f3fa573c,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 21 21:25:40.567: INFO: Logging kubelet events for node master2 May 21 21:25:40.569: INFO: Logging pods the kubelet thinks is on node master2 May 21 21:25:40.577: INFO: node-exporter-q52l5 started at 2021-05-21 20:07:54 +0000 UTC (0+2 container statuses recorded) May 21 21:25:40.577: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:25:40.577: INFO: Container node-exporter ready: true, restart count 0 May 21 21:25:40.577: INFO: kube-controller-manager-master2 started at 2021-05-21 19:59:58 +0000 UTC (0+1 container statuses recorded) May 21 21:25:40.577: INFO: Container kube-controller-manager ready: true, restart count 2 May 21 21:25:40.577: INFO: kube-scheduler-master2 started at 2021-05-21 20:00:08 +0000 UTC (0+1 container statuses recorded) May 21 21:25:40.577: INFO: Container kube-scheduler ready: true, restart count 2 May 21 21:25:40.577: INFO: kube-proxy-shdjd started at 2021-05-21 19:57:00 +0000 UTC (0+1 container statuses recorded) May 21 21:25:40.577: INFO: Container kube-proxy ready: true, restart count 1 May 21 21:25:40.577: INFO: kube-flannel-tnf5x started at 2021-05-21 19:57:34 +0000 UTC (1+1 container statuses recorded) May 21 21:25:40.577: INFO: Init container install-cni ready: true, restart count 0 May 21 21:25:40.577: INFO: Container kube-flannel ready: true, restart count 1 May 21 21:25:40.577: INFO: kube-multus-ds-amd64-lwzkr started at 2021-05-21 19:57:42 +0000 UTC (0+1 container statuses recorded) May 21 21:25:40.577: INFO: Container kube-multus ready: true, restart count 1 May 21 21:25:40.577: INFO: dns-autoscaler-5b7b5c9b6f-dvlvw started at 2021-05-21 19:58:05 +0000 UTC (0+1 container statuses recorded) May 21 21:25:40.577: INFO: Container autoscaler ready: true, restart count 2 May 21 21:25:40.577: INFO: kube-apiserver-master2 started at 2021-05-21 20:03:00 +0000 UTC (0+1 container statuses recorded) May 21 21:25:40.577: INFO: Container kube-apiserver ready: true, restart count 0 May 21 21:25:40.577: INFO: coredns-7677f9bb54-lv5gk started at 2021-05-21 19:58:07 +0000 UTC (0+1 container statuses recorded) May 21 21:25:40.577: INFO: Container coredns ready: true, restart count 1 W0521 21:25:40.590768 25 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 21 21:25:40.620: INFO: Latency metrics for node master2 May 21 21:25:40.620: INFO: Logging node info for node master3 May 21 21:25:40.623: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 23066049-f3f1-42a7-9cea-19e20ed4ccec 27814 0 2021-05-21 19:55:56 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:a6:e4:e7:ba:02"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-21 19:55:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-21 19:55:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-21 19:57:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-21 19:57:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234767872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324603904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-21 20:00:41 +0000 UTC,LastTransitionTime:2021-05-21 20:00:41 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-21 21:25:33 +0000 UTC,LastTransitionTime:2021-05-21 19:55:56 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-21 21:25:33 +0000 UTC,LastTransitionTime:2021-05-21 19:55:56 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-21 21:25:33 +0000 UTC,LastTransitionTime:2021-05-21 19:55:56 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-21 21:25:33 +0000 UTC,LastTransitionTime:2021-05-21 19:57:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:660844f5cb0944868621042562b928e3,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:02066ff3-4833-4130-ba94-138c581e4cc0,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 21 21:25:40.623: INFO: Logging kubelet events for node master3 May 21 21:25:40.625: INFO: Logging pods the kubelet thinks is on node master3 May 21 21:25:40.633: INFO: kube-proxy-hwwxt started at 2021-05-21 19:57:00 +0000 UTC (0+1 container statuses recorded) May 21 21:25:40.633: INFO: Container kube-proxy ready: true, restart count 2 May 21 21:25:40.633: INFO: kube-flannel-8sd6n started at 2021-05-21 19:57:34 +0000 UTC (1+1 container statuses recorded) May 21 21:25:40.633: INFO: Init container install-cni ready: true, restart count 0 May 21 21:25:40.633: INFO: Container kube-flannel ready: true, restart count 1 May 21 21:25:40.633: INFO: kube-multus-ds-amd64-zgdbl started at 2021-05-21 19:57:42 +0000 UTC (0+1 container statuses recorded) May 21 21:25:40.633: INFO: Container kube-multus ready: true, restart count 1 May 21 21:25:40.633: INFO: coredns-7677f9bb54-gjt42 started at 2021-05-21 19:58:03 +0000 UTC (0+1 container statuses recorded) May 21 21:25:40.633: INFO: Container coredns ready: true, restart count 1 May 21 21:25:40.633: INFO: node-exporter-s74rx started at 2021-05-21 20:07:54 +0000 UTC (0+2 container statuses recorded) May 21 21:25:40.633: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:25:40.633: INFO: Container node-exporter ready: true, restart count 0 May 21 21:25:40.633: INFO: kube-controller-manager-master3 started at 2021-05-21 20:03:00 +0000 UTC (0+1 container statuses recorded) May 21 21:25:40.633: INFO: Container kube-controller-manager ready: true, restart count 1 May 21 21:25:40.633: INFO: kube-scheduler-master3 started at 2021-05-21 20:03:10 +0000 UTC (0+1 container statuses recorded) May 21 21:25:40.633: INFO: Container kube-scheduler ready: true, restart count 1 May 21 21:25:40.633: INFO: kube-apiserver-master3 started at 2021-05-21 20:03:20 +0000 UTC (0+1 container statuses recorded) May 21 21:25:40.633: INFO: Container kube-apiserver ready: true, restart count 0 W0521 21:25:40.646647 25 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 21 21:25:40.674: INFO: Latency metrics for node master3 May 21 21:25:40.674: INFO: Logging node info for node node1 May 21 21:25:40.676: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 62cfecb3-af08-42a4-ab85-25a317061b61 27827 0 2021-05-21 19:56:58 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"22:2e:2b:06:83:4a"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-21 19:56:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-05-21 19:56:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-21 19:57:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-21 20:04:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-21 20:06:20 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-21 20:06:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269628928 0} {<nil>} 196552372Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884628480 0} {<nil>} 174692020Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-21 20:00:36 +0000 UTC,LastTransitionTime:2021-05-21 20:00:36 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-21 21:25:34 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-21 21:25:34 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-21 21:25:34 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-21 21:25:34 +0000 UTC,LastTransitionTime:2021-05-21 19:57:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:94b7bb79c41d4a0492f63fb5fb3c5cc0,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:1e94d819-8d68-4948-b171-5fd2d8fc7ff5,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:2b114e08442070e7232fcffc4cb89529bd5c9effe733ed690277a33772bf2d00 localhost:30500/barometer-collectd:stable],SizeBytes:1464382814,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:1002487865,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:ed5c574f653e2a39e784ff322033a2319aafde7366c803a88f20f7a2a8bc1efb opnfv/barometer-collectd:stable],SizeBytes:825413035,},ContainerImage{Names:[localhost:30500/cmk@sha256:1d865c665dfeeec5a879dca7b9945cc49f55f10921b4e729f0da0cdec7dedbf7 cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[golang@sha256:1636899c10870ab66c48d960a9df620f4f9e86a0c72fbacf36032d27404e7e6c golang:alpine3.12],SizeBytes:301156062,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:a4dc6d912ce1a8dd4c3a51b1cfb52454080ed36db95bf824895d5ecb7175199f nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392673,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:36553b10a4947067b9fbb7d532951066293a68eae893beba1d9235f7d11a20ad alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 21 21:25:40.676: INFO: Logging kubelet events for node node1 May 21 21:25:40.678: INFO: Logging pods the kubelet thinks is on node node1 May 21 21:25:40.691: INFO: node-feature-discovery-worker-lh5hz started at 2021-05-21 20:03:47 +0000 UTC (0+1 container statuses recorded) May 21 21:25:40.691: INFO: Container nfd-worker ready: true, restart count 0 May 21 21:25:40.691: INFO: kubernetes-dashboard-86c6f9df5b-8rsws started at 2021-05-21 19:58:07 +0000 UTC (0+1 container statuses recorded) May 21 21:25:40.691: INFO: Container kubernetes-dashboard ready: true, restart count 1 May 21 21:25:40.691: INFO: kubernetes-metrics-scraper-678c97765c-nnrtl started at 2021-05-21 19:58:07 +0000 UTC (0+1 container statuses recorded) May 21 21:25:40.691: INFO: Container kubernetes-metrics-scraper ready: true, restart count 2 May 21 21:25:40.691: INFO: prometheus-operator-5bb8cb9d8f-mzlrf started at 2021-05-21 20:07:47 +0000 UTC (0+2 container statuses recorded) May 21 21:25:40.691: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:25:40.691: INFO: Container prometheus-operator ready: true, restart count 0 May 21 21:25:40.691: INFO: node-exporter-l5k2r started at 2021-05-21 20:07:54 +0000 UTC (0+2 container statuses recorded) May 21 21:25:40.691: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:25:40.691: INFO: Container node-exporter ready: true, restart count 0 May 21 21:25:40.691: INFO: kube-multus-ds-amd64-wlmhr started at 2021-05-21 19:57:42 +0000 UTC (0+1 container statuses recorded) May 21 21:25:40.691: INFO: Container kube-multus ready: true, restart count 1 May 21 21:25:40.691: INFO: cmk-h8jxp started at 2021-05-21 20:07:00 +0000 UTC (0+2 container statuses recorded) May 21 21:25:40.691: INFO: Container nodereport ready: true, restart count 0 May 21 21:25:40.691: INFO: Container reconcile ready: true, restart count 0 May 21 21:25:40.691: INFO: prometheus-k8s-0 started at 2021-05-21 20:08:06 +0000 UTC (0+5 container statuses recorded) May 21 21:25:40.691: INFO: Container custom-metrics-apiserver ready: true, restart count 0 May 21 21:25:40.691: INFO: Container grafana ready: true, restart count 0 May 21 21:25:40.691: INFO: Container prometheus ready: true, restart count 1 May 21 21:25:40.691: INFO: Container prometheus-config-reloader ready: true, restart count 0 May 21 21:25:40.691: INFO: Container rules-configmap-reloader ready: true, restart count 0 May 21 21:25:40.691: INFO: nginx-proxy-node1 started at 2021-05-21 20:03:00 +0000 UTC (0+1 container statuses recorded) May 21 21:25:40.691: INFO: Container nginx-proxy ready: true, restart count 1 May 21 21:25:40.691: INFO: server-envvars-71ee385c-8848-4254-9b4d-2a1fe8ea0807 started at 2021-05-21 21:14:55 +0000 UTC (0+1 container statuses recorded) May 21 21:25:40.691: INFO: Container srv ready: true, restart count 0 May 21 21:25:40.691: INFO: kube-flannel-k6mr4 started at 2021-05-21 19:57:34 +0000 UTC (1+1 container statuses recorded) May 21 21:25:40.691: INFO: Init container install-cni ready: true, restart count 1 May 21 21:25:40.691: INFO: Container kube-flannel ready: true, restart count 1 May 21 21:25:40.691: INFO: collectd-mc5kl started at 2021-05-21 20:13:40 +0000 UTC (0+3 container statuses recorded) May 21 21:25:40.691: INFO: Container collectd ready: true, restart count 0 May 21 21:25:40.691: INFO: Container collectd-exporter ready: true, restart count 0 May 21 21:25:40.691: INFO: Container rbac-proxy ready: true, restart count 0 May 21 21:25:40.691: INFO: cmk-webhook-6c9d5f8578-8pz6w started at 2021-05-21 20:07:00 +0000 UTC (0+1 container statuses recorded) May 21 21:25:40.691: INFO: Container cmk-webhook ready: true, restart count 0 May 21 21:25:40.691: INFO: pod-logs-websocket-668aee7b-4e8d-4dc9-8d2b-95b724b959be started at 2021-05-21 21:22:52 +0000 UTC (0+1 container statuses recorded) May 21 21:25:40.691: INFO: Container main ready: false, restart count 0 May 21 21:25:40.691: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-czhnm started at 2021-05-21 20:04:29 +0000 UTC (0+1 container statuses recorded) May 21 21:25:40.691: INFO: Container kube-sriovdp ready: true, restart count 0 May 21 21:25:40.691: INFO: cmk-init-discover-node1-48g7j started at 2021-05-21 20:06:17 +0000 UTC (0+3 container statuses recorded) May 21 21:25:40.691: INFO: Container discover ready: false, restart count 0 May 21 21:25:40.691: INFO: Container init ready: false, restart count 0 May 21 21:25:40.691: INFO: Container install ready: false, restart count 0 May 21 21:25:40.691: INFO: kube-proxy-h5k9s started at 2021-05-21 19:57:00 +0000 UTC (0+1 container statuses recorded) May 21 21:25:40.691: INFO: Container kube-proxy ready: true, restart count 1 W0521 21:25:40.701324 25 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 21 21:25:40.730: INFO: Latency metrics for node node1 May 21 21:25:40.730: INFO: Logging node info for node node2 May 21 21:25:40.734: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 3f64ce47-e96b-43b8-9c91-df57a4e26826 27829 0 2021-05-21 19:56:58 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"4e:d8:e9:66:bc:b7"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-21 19:56:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-05-21 19:56:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-21 19:57:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-21 20:04:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-21 20:06:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-21 20:06:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269633024 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884632576 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-21 20:00:39 +0000 UTC,LastTransitionTime:2021-05-21 20:00:39 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-21 21:25:35 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-21 21:25:35 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-21 21:25:35 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-21 21:25:35 +0000 UTC,LastTransitionTime:2021-05-21 19:57:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:2aa9b8566664435b84c4146a11c874db,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:befe5c4e-169e-4c36-9e45-742bb80d4660,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:2b114e08442070e7232fcffc4cb89529bd5c9effe733ed690277a33772bf2d00 localhost:30500/barometer-collectd:stable],SizeBytes:1464382814,},ContainerImage{Names:[localhost:30500/cmk@sha256:1d865c665dfeeec5a879dca7b9945cc49f55f10921b4e729f0da0cdec7dedbf7 localhost:30500/cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:a4dc6d912ce1a8dd4c3a51b1cfb52454080ed36db95bf824895d5ecb7175199f localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392673,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:f013255695f4515c5b21b11281c7e0fb491082d15ec5a96adb8217e015a9c422 localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:50746f542c19fda01d88ae124ce58c5a326dad7cd24d3c2d19fdf959cc7f0c49 localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 21 21:25:40.734: INFO: Logging kubelet events for node node2 May 21 21:25:40.737: INFO: Logging pods the kubelet thinks is on node node2 May 21 21:25:40.750: INFO: busybox-scheduling-45e499d3-711c-4530-82e5-48d776ee7996 started at 2021-05-21 21:21:31 +0000 UTC (0+1 container statuses recorded) May 21 21:25:40.750: INFO: Container busybox-scheduling-45e499d3-711c-4530-82e5-48d776ee7996 ready: false, restart count 0 May 21 21:25:40.750: INFO: kube-flannel-5p7gq started at 2021-05-21 19:57:34 +0000 UTC (1+1 container statuses recorded) May 21 21:25:40.750: INFO: Init container install-cni ready: true, restart count 2 May 21 21:25:40.750: INFO: Container kube-flannel ready: true, restart count 2 May 21 21:25:40.750: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-j7fm6 started at 2021-05-21 20:04:29 +0000 UTC (0+1 container statuses recorded) May 21 21:25:40.750: INFO: Container kube-sriovdp ready: true, restart count 0 May 21 21:25:40.750: INFO: downward-api-693016f4-b946-499b-94de-e704d3cf4782 started at 2021-05-21 21:25:19 +0000 UTC (0+1 container statuses recorded) May 21 21:25:40.750: INFO: Container dapi-container ready: false, restart count 0 May 21 21:25:40.750: INFO: ss-0 started at 2021-05-21 21:25:26 +0000 UTC (0+1 container statuses recorded) May 21 21:25:40.750: INFO: Container webserver ready: false, restart count 0 May 21 21:25:40.750: INFO: kube-multus-ds-amd64-6q46t started at 2021-05-21 19:57:42 +0000 UTC (0+1 container statuses recorded) May 21 21:25:40.750: INFO: Container kube-multus ready: true, restart count 1 May 21 21:25:40.750: INFO: cmk-init-discover-node2-p7sdn started at 2021-05-21 20:06:37 +0000 UTC (0+3 container statuses recorded) May 21 21:25:40.750: INFO: Container discover ready: false, restart count 0 May 21 21:25:40.750: INFO: Container init ready: false, restart count 0 May 21 21:25:40.750: INFO: Container install ready: false, restart count 0 May 21 21:25:40.750: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-8kddc started at 2021-05-21 20:10:49 +0000 UTC (0+2 container statuses recorded) May 21 21:25:40.750: INFO: Container tas-controller ready: true, restart count 0 May 21 21:25:40.750: INFO: Container tas-extender ready: true, restart count 0 May 21 21:25:40.750: INFO: client-envvars-05493ac4-b42a-407e-a86f-a06a526f2af5 started at 2021-05-21 21:25:06 +0000 UTC (0+1 container statuses recorded) May 21 21:25:40.750: INFO: Container env3cont ready: false, restart count 0 May 21 21:25:40.750: INFO: fail-once-local-zv48g started at 2021-05-21 21:14:59 +0000 UTC (0+1 container statuses recorded) May 21 21:25:40.750: INFO: Container c ready: false, restart count 0 May 21 21:25:40.750: INFO: sample-webhook-deployment-cbccbf6bb-2hlwx started at 2021-05-21 21:25:36 +0000 UTC (0+1 container statuses recorded) May 21 21:25:40.750: INFO: Container sample-webhook ready: true, restart count 0 May 21 21:25:40.750: INFO: nginx-proxy-node2 started at 2021-05-21 20:03:00 +0000 UTC (0+1 container statuses recorded) May 21 21:25:40.750: INFO: Container nginx-proxy ready: true, restart count 2 May 21 21:25:40.750: INFO: collectd-tz5h5 started at 2021-05-21 20:13:40 +0000 UTC (0+3 container statuses recorded) May 21 21:25:40.750: INFO: Container collectd ready: true, restart count 0 May 21 21:25:40.750: INFO: Container collectd-exporter ready: true, restart count 0 May 21 21:25:40.750: INFO: Container rbac-proxy ready: true, restart count 0 May 21 21:25:40.750: INFO: kube-proxy-q57hf started at 2021-05-21 19:57:00 +0000 UTC (0+1 container statuses recorded) May 21 21:25:40.750: INFO: Container kube-proxy ready: true, restart count 2 May 21 21:25:40.750: INFO: node-feature-discovery-worker-28kx4 started at 2021-05-21 20:03:47 +0000 UTC (0+1 container statuses recorded) May 21 21:25:40.750: INFO: Container nfd-worker ready: true, restart count 0 May 21 21:25:40.750: INFO: cmk-j2nnh started at 2021-05-21 20:07:00 +0000 UTC (0+2 container statuses recorded) May 21 21:25:40.750: INFO: Container nodereport ready: true, restart count 0 May 21 21:25:40.750: INFO: Container reconcile ready: true, restart count 0 May 21 21:25:40.750: INFO: node-exporter-c46fg started at 2021-05-21 20:07:54 +0000 UTC (0+2 container statuses recorded) May 21 21:25:40.750: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:25:40.750: INFO: Container node-exporter ready: true, restart count 0 May 21 21:25:40.750: INFO: ss-0 started at 2021-05-21 21:24:41 +0000 UTC (0+1 container statuses recorded) May 21 21:25:40.750: INFO: Container webserver ready: false, restart count 0 May 21 21:25:40.750: INFO: fail-once-local-tcmn7 started at 2021-05-21 21:14:59 +0000 UTC (0+1 container statuses recorded) May 21 21:25:40.750: INFO: Container c ready: false, restart count 0 May 21 21:25:40.750: INFO: test-rolling-update-controller-5gmll started at 2021-05-21 21:25:06 +0000 UTC (0+1 container statuses recorded) May 21 21:25:40.750: INFO: Container httpd ready: false, restart count 0 W0521 21:25:40.763904 25 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 21 21:25:40.807: INFO: Latency metrics for node node2 May 21 21:25:40.807: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "downward-api-6633" for this suite. /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 May 21 21:30:14.087: while waiting for pod to be running Unexpected error: <*errors.errorString | 0xc0002c4200>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/expansion.go:270 [BeforeEach] [k8s.io] Variable Expansion /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client May 21 21:26:13.523: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename var-expansion STEP: Waiting for a default service account to be provisioned in namespace [It] should verify that a failing subpath expansion can be modified during the lifecycle of a container [sig-storage][Slow] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: creating the pod with failed condition STEP: updating the pod May 21 21:28:14.077: INFO: Successfully updated pod "var-expansion-9ac6f388-9c95-4b7b-9389-3dbff528d587" STEP: waiting for pod running May 21 21:30:14.087: FAIL: while waiting for pod to be running Unexpected error: <*errors.errorString | 0xc0002c4200>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/common.glob..func9.7() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/expansion.go:270 +0x5d1 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc001902480) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc001902480) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc001902480, 0x4de37a0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] Variable Expansion /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "var-expansion-4221". STEP: Found 9 events. May 21 21:30:14.091: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for var-expansion-9ac6f388-9c95-4b7b-9389-3dbff528d587: { } Scheduled: Successfully assigned var-expansion-4221/var-expansion-9ac6f388-9c95-4b7b-9389-3dbff528d587 to node1 May 21 21:30:14.091: INFO: At 2021-05-21 21:26:15 +0000 UTC - event for var-expansion-9ac6f388-9c95-4b7b-9389-3dbff528d587: {multus } AddedInterface: Add eth0 [10.244.3.75/24] May 21 21:30:14.091: INFO: At 2021-05-21 21:26:15 +0000 UTC - event for var-expansion-9ac6f388-9c95-4b7b-9389-3dbff528d587: {kubelet node1} Pulling: Pulling image "docker.io/library/busybox:1.29" May 21 21:30:14.091: INFO: At 2021-05-21 21:26:16 +0000 UTC - event for var-expansion-9ac6f388-9c95-4b7b-9389-3dbff528d587: {kubelet node1} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit May 21 21:30:14.091: INFO: At 2021-05-21 21:26:16 +0000 UTC - event for var-expansion-9ac6f388-9c95-4b7b-9389-3dbff528d587: {kubelet node1} Failed: Error: ErrImagePull May 21 21:30:14.091: INFO: At 2021-05-21 21:26:16 +0000 UTC - event for var-expansion-9ac6f388-9c95-4b7b-9389-3dbff528d587: {kubelet node1} SandboxChanged: Pod sandbox changed, it will be killed and re-created. May 21 21:30:14.091: INFO: At 2021-05-21 21:26:18 +0000 UTC - event for var-expansion-9ac6f388-9c95-4b7b-9389-3dbff528d587: {multus } AddedInterface: Add eth0 [10.244.3.76/24] May 21 21:30:14.091: INFO: At 2021-05-21 21:26:18 +0000 UTC - event for var-expansion-9ac6f388-9c95-4b7b-9389-3dbff528d587: {kubelet node1} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" May 21 21:30:14.091: INFO: At 2021-05-21 21:26:18 +0000 UTC - event for var-expansion-9ac6f388-9c95-4b7b-9389-3dbff528d587: {kubelet node1} Failed: Error: ImagePullBackOff May 21 21:30:14.093: INFO: POD NODE PHASE GRACE CONDITIONS May 21 21:30:14.093: INFO: var-expansion-9ac6f388-9c95-4b7b-9389-3dbff528d587 node1 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-05-21 21:26:13 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-05-21 21:26:13 +0000 UTC ContainersNotReady containers with unready status: [dapi-container]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-05-21 21:26:13 +0000 UTC ContainersNotReady containers with unready status: [dapi-container]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-05-21 21:26:13 +0000 UTC }] May 21 21:30:14.093: INFO: May 21 21:30:14.098: INFO: Logging node info for node master1 May 21 21:30:14.101: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 18cf10c1-c08b-4d36-bbe6-5aa86f02296e 29984 0 2021-05-21 19:55:07 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"d2:e0:bb:d8:54:80"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-21 19:55:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-21 19:55:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-21 19:57:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-21 19:57:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-05-21 20:04:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234763776 0} {<nil>} 196518324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324599808 0} {<nil>} 195629492Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-21 19:59:55 +0000 UTC,LastTransitionTime:2021-05-21 19:59:55 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-21 21:30:04 +0000 UTC,LastTransitionTime:2021-05-21 19:55:07 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-21 21:30:04 +0000 UTC,LastTransitionTime:2021-05-21 19:55:07 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-21 21:30:04 +0000 UTC,LastTransitionTime:2021-05-21 19:55:07 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-21 21:30:04 +0000 UTC,LastTransitionTime:2021-05-21 19:59:16 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0b916e2f445c4d05b6a9058a788d9410,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:ab86499b-409f-44c9-86ff-e9bc113e4112,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:f013255695f4515c5b21b11281c7e0fb491082d15ec5a96adb8217e015a9c422 tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:50746f542c19fda01d88ae124ce58c5a326dad7cd24d3c2d19fdf959cc7f0c49 tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 21 21:30:14.101: INFO: Logging kubelet events for node master1 May 21 21:30:14.103: INFO: Logging pods the kubelet thinks is on node master1 May 21 21:30:14.111: INFO: kube-apiserver-master1 started at 2021-05-21 20:03:10 +0000 UTC (0+1 container statuses recorded) May 21 21:30:14.111: INFO: Container kube-apiserver ready: true, restart count 0 May 21 21:30:14.111: INFO: kube-controller-manager-master1 started at 2021-05-21 19:59:16 +0000 UTC (0+1 container statuses recorded) May 21 21:30:14.111: INFO: Container kube-controller-manager ready: true, restart count 3 May 21 21:30:14.111: INFO: kube-multus-ds-amd64-z8khx started at 2021-05-21 19:57:42 +0000 UTC (0+1 container statuses recorded) May 21 21:30:14.111: INFO: Container kube-multus ready: true, restart count 1 May 21 21:30:14.111: INFO: docker-registry-docker-registry-56cbc7bc58-mft7s started at 2021-05-21 20:00:26 +0000 UTC (0+2 container statuses recorded) May 21 21:30:14.111: INFO: Container docker-registry ready: true, restart count 0 May 21 21:30:14.111: INFO: Container nginx ready: true, restart count 0 May 21 21:30:14.111: INFO: node-feature-discovery-controller-5bf5c49849-ktcdq started at 2021-05-21 20:03:57 +0000 UTC (0+1 container statuses recorded) May 21 21:30:14.111: INFO: Container nfd-controller ready: true, restart count 0 May 21 21:30:14.111: INFO: node-exporter-m7jht started at 2021-05-21 20:07:54 +0000 UTC (0+2 container statuses recorded) May 21 21:30:14.111: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:30:14.111: INFO: Container node-exporter ready: true, restart count 0 May 21 21:30:14.111: INFO: kube-scheduler-master1 started at 2021-05-21 19:59:16 +0000 UTC (0+1 container statuses recorded) May 21 21:30:14.111: INFO: Container kube-scheduler ready: true, restart count 0 May 21 21:30:14.111: INFO: kube-flannel-5lkd2 started at 2021-05-21 19:57:34 +0000 UTC (1+1 container statuses recorded) May 21 21:30:14.112: INFO: Init container install-cni ready: true, restart count 0 May 21 21:30:14.112: INFO: Container kube-flannel ready: true, restart count 2 May 21 21:30:14.112: INFO: kube-proxy-zv2rb started at 2021-05-21 19:57:00 +0000 UTC (0+1 container statuses recorded) May 21 21:30:14.112: INFO: Container kube-proxy ready: true, restart count 2 W0521 21:30:14.125716 25 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 21 21:30:14.151: INFO: Latency metrics for node master1 May 21 21:30:14.151: INFO: Logging node info for node master2 May 21 21:30:14.153: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 d439093b-ce44-47e7-8b41-5739b7c49ca5 30051 0 2021-05-21 19:55:46 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"62:5a:fb:0b:f8:b0"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-21 19:55:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-21 19:55:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-21 19:57:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-21 19:57:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234763776 0} {<nil>} 196518324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324599808 0} {<nil>} 195629492Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-21 20:00:49 +0000 UTC,LastTransitionTime:2021-05-21 20:00:49 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-21 21:30:07 +0000 UTC,LastTransitionTime:2021-05-21 19:55:46 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-21 21:30:07 +0000 UTC,LastTransitionTime:2021-05-21 19:55:46 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-21 21:30:07 +0000 UTC,LastTransitionTime:2021-05-21 19:55:46 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-21 21:30:07 +0000 UTC,LastTransitionTime:2021-05-21 19:57:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:495d1cf47bdb4c7e982c636c95de5648,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:cca785c0-d61e-403e-91fd-d0d4f3fa573c,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 21 21:30:14.154: INFO: Logging kubelet events for node master2 May 21 21:30:14.155: INFO: Logging pods the kubelet thinks is on node master2 May 21 21:30:14.163: INFO: kube-controller-manager-master2 started at 2021-05-21 19:59:58 +0000 UTC (0+1 container statuses recorded) May 21 21:30:14.163: INFO: Container kube-controller-manager ready: true, restart count 2 May 21 21:30:14.163: INFO: kube-scheduler-master2 started at 2021-05-21 20:00:08 +0000 UTC (0+1 container statuses recorded) May 21 21:30:14.163: INFO: Container kube-scheduler ready: true, restart count 2 May 21 21:30:14.163: INFO: kube-proxy-shdjd started at 2021-05-21 19:57:00 +0000 UTC (0+1 container statuses recorded) May 21 21:30:14.163: INFO: Container kube-proxy ready: true, restart count 1 May 21 21:30:14.163: INFO: kube-flannel-tnf5x started at 2021-05-21 19:57:34 +0000 UTC (1+1 container statuses recorded) May 21 21:30:14.163: INFO: Init container install-cni ready: true, restart count 0 May 21 21:30:14.163: INFO: Container kube-flannel ready: true, restart count 1 May 21 21:30:14.163: INFO: kube-multus-ds-amd64-lwzkr started at 2021-05-21 19:57:42 +0000 UTC (0+1 container statuses recorded) May 21 21:30:14.163: INFO: Container kube-multus ready: true, restart count 1 May 21 21:30:14.163: INFO: dns-autoscaler-5b7b5c9b6f-dvlvw started at 2021-05-21 19:58:05 +0000 UTC (0+1 container statuses recorded) May 21 21:30:14.163: INFO: Container autoscaler ready: true, restart count 2 May 21 21:30:14.163: INFO: node-exporter-q52l5 started at 2021-05-21 20:07:54 +0000 UTC (0+2 container statuses recorded) May 21 21:30:14.163: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:30:14.163: INFO: Container node-exporter ready: true, restart count 0 May 21 21:30:14.163: INFO: kube-apiserver-master2 started at 2021-05-21 20:03:00 +0000 UTC (0+1 container statuses recorded) May 21 21:30:14.163: INFO: Container kube-apiserver ready: true, restart count 0 May 21 21:30:14.163: INFO: coredns-7677f9bb54-lv5gk started at 2021-05-21 19:58:07 +0000 UTC (0+1 container statuses recorded) May 21 21:30:14.163: INFO: Container coredns ready: true, restart count 1 W0521 21:30:14.176182 25 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 21 21:30:14.198: INFO: Latency metrics for node master2 May 21 21:30:14.198: INFO: Logging node info for node master3 May 21 21:30:14.201: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 23066049-f3f1-42a7-9cea-19e20ed4ccec 29989 0 2021-05-21 19:55:56 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:a6:e4:e7:ba:02"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-21 19:55:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-21 19:55:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-21 19:57:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-21 19:57:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234767872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324603904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-21 20:00:41 +0000 UTC,LastTransitionTime:2021-05-21 20:00:41 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-21 21:30:04 +0000 UTC,LastTransitionTime:2021-05-21 19:55:56 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-21 21:30:04 +0000 UTC,LastTransitionTime:2021-05-21 19:55:56 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-21 21:30:04 +0000 UTC,LastTransitionTime:2021-05-21 19:55:56 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-21 21:30:04 +0000 UTC,LastTransitionTime:2021-05-21 19:57:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:660844f5cb0944868621042562b928e3,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:02066ff3-4833-4130-ba94-138c581e4cc0,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 21 21:30:14.201: INFO: Logging kubelet events for node master3 May 21 21:30:14.203: INFO: Logging pods the kubelet thinks is on node master3 May 21 21:30:14.211: INFO: kube-apiserver-master3 started at 2021-05-21 20:03:20 +0000 UTC (0+1 container statuses recorded) May 21 21:30:14.211: INFO: Container kube-apiserver ready: true, restart count 0 May 21 21:30:14.211: INFO: kube-proxy-hwwxt started at 2021-05-21 19:57:00 +0000 UTC (0+1 container statuses recorded) May 21 21:30:14.211: INFO: Container kube-proxy ready: true, restart count 2 May 21 21:30:14.211: INFO: kube-flannel-8sd6n started at 2021-05-21 19:57:34 +0000 UTC (1+1 container statuses recorded) May 21 21:30:14.211: INFO: Init container install-cni ready: true, restart count 0 May 21 21:30:14.211: INFO: Container kube-flannel ready: true, restart count 1 May 21 21:30:14.211: INFO: kube-multus-ds-amd64-zgdbl started at 2021-05-21 19:57:42 +0000 UTC (0+1 container statuses recorded) May 21 21:30:14.211: INFO: Container kube-multus ready: true, restart count 1 May 21 21:30:14.211: INFO: coredns-7677f9bb54-gjt42 started at 2021-05-21 19:58:03 +0000 UTC (0+1 container statuses recorded) May 21 21:30:14.211: INFO: Container coredns ready: true, restart count 1 May 21 21:30:14.211: INFO: node-exporter-s74rx started at 2021-05-21 20:07:54 +0000 UTC (0+2 container statuses recorded) May 21 21:30:14.211: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:30:14.211: INFO: Container node-exporter ready: true, restart count 0 May 21 21:30:14.211: INFO: kube-controller-manager-master3 started at 2021-05-21 20:03:00 +0000 UTC (0+1 container statuses recorded) May 21 21:30:14.211: INFO: Container kube-controller-manager ready: true, restart count 1 May 21 21:30:14.211: INFO: kube-scheduler-master3 started at 2021-05-21 20:03:10 +0000 UTC (0+1 container statuses recorded) May 21 21:30:14.211: INFO: Container kube-scheduler ready: true, restart count 1 W0521 21:30:14.222352 25 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 21 21:30:14.245: INFO: Latency metrics for node master3 May 21 21:30:14.245: INFO: Logging node info for node node1 May 21 21:30:14.249: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 62cfecb3-af08-42a4-ab85-25a317061b61 30041 0 2021-05-21 19:56:58 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"22:2e:2b:06:83:4a"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-21 19:56:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-05-21 19:56:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-21 19:57:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-21 20:04:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-21 20:06:20 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-21 20:06:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269628928 0} {<nil>} 196552372Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884628480 0} {<nil>} 174692020Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-21 20:00:36 +0000 UTC,LastTransitionTime:2021-05-21 20:00:36 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-21 21:30:06 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-21 21:30:06 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-21 21:30:06 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-21 21:30:06 +0000 UTC,LastTransitionTime:2021-05-21 19:57:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:94b7bb79c41d4a0492f63fb5fb3c5cc0,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:1e94d819-8d68-4948-b171-5fd2d8fc7ff5,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:2b114e08442070e7232fcffc4cb89529bd5c9effe733ed690277a33772bf2d00 localhost:30500/barometer-collectd:stable],SizeBytes:1464382814,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:1002487865,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:ed5c574f653e2a39e784ff322033a2319aafde7366c803a88f20f7a2a8bc1efb opnfv/barometer-collectd:stable],SizeBytes:825413035,},ContainerImage{Names:[localhost:30500/cmk@sha256:1d865c665dfeeec5a879dca7b9945cc49f55f10921b4e729f0da0cdec7dedbf7 cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[golang@sha256:1636899c10870ab66c48d960a9df620f4f9e86a0c72fbacf36032d27404e7e6c golang:alpine3.12],SizeBytes:301156062,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:a4dc6d912ce1a8dd4c3a51b1cfb52454080ed36db95bf824895d5ecb7175199f nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392673,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:36553b10a4947067b9fbb7d532951066293a68eae893beba1d9235f7d11a20ad alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 21 21:30:14.249: INFO: Logging kubelet events for node node1 May 21 21:30:14.252: INFO: Logging pods the kubelet thinks is on node node1 May 21 21:30:14.267: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-czhnm started at 2021-05-21 20:04:29 +0000 UTC (0+1 container statuses recorded) May 21 21:30:14.268: INFO: Container kube-sriovdp ready: true, restart count 0 May 21 21:30:14.268: INFO: kube-proxy-h5k9s started at 2021-05-21 19:57:00 +0000 UTC (0+1 container statuses recorded) May 21 21:30:14.268: INFO: Container kube-proxy ready: true, restart count 1 May 21 21:30:14.268: INFO: cmk-init-discover-node1-48g7j started at 2021-05-21 20:06:17 +0000 UTC (0+3 container statuses recorded) May 21 21:30:14.268: INFO: Container discover ready: false, restart count 0 May 21 21:30:14.268: INFO: Container init ready: false, restart count 0 May 21 21:30:14.268: INFO: Container install ready: false, restart count 0 May 21 21:30:14.268: INFO: kubernetes-dashboard-86c6f9df5b-8rsws started at 2021-05-21 19:58:07 +0000 UTC (0+1 container statuses recorded) May 21 21:30:14.268: INFO: Container kubernetes-dashboard ready: true, restart count 1 May 21 21:30:14.268: INFO: node-feature-discovery-worker-lh5hz started at 2021-05-21 20:03:47 +0000 UTC (0+1 container statuses recorded) May 21 21:30:14.268: INFO: Container nfd-worker ready: true, restart count 0 May 21 21:30:14.268: INFO: kube-multus-ds-amd64-wlmhr started at 2021-05-21 19:57:42 +0000 UTC (0+1 container statuses recorded) May 21 21:30:14.268: INFO: Container kube-multus ready: true, restart count 1 May 21 21:30:14.268: INFO: kubernetes-metrics-scraper-678c97765c-nnrtl started at 2021-05-21 19:58:07 +0000 UTC (0+1 container statuses recorded) May 21 21:30:14.268: INFO: Container kubernetes-metrics-scraper ready: true, restart count 2 May 21 21:30:14.268: INFO: prometheus-operator-5bb8cb9d8f-mzlrf started at 2021-05-21 20:07:47 +0000 UTC (0+2 container statuses recorded) May 21 21:30:14.268: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:30:14.268: INFO: Container prometheus-operator ready: true, restart count 0 May 21 21:30:14.268: INFO: node-exporter-l5k2r started at 2021-05-21 20:07:54 +0000 UTC (0+2 container statuses recorded) May 21 21:30:14.268: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:30:14.268: INFO: Container node-exporter ready: true, restart count 0 May 21 21:30:14.268: INFO: var-expansion-9ac6f388-9c95-4b7b-9389-3dbff528d587 started at 2021-05-21 21:26:13 +0000 UTC (0+1 container statuses recorded) May 21 21:30:14.268: INFO: Container dapi-container ready: false, restart count 0 May 21 21:30:14.268: INFO: nginx-proxy-node1 started at 2021-05-21 20:03:00 +0000 UTC (0+1 container statuses recorded) May 21 21:30:14.268: INFO: Container nginx-proxy ready: true, restart count 1 May 21 21:30:14.268: INFO: cmk-h8jxp started at 2021-05-21 20:07:00 +0000 UTC (0+2 container statuses recorded) May 21 21:30:14.268: INFO: Container nodereport ready: true, restart count 0 May 21 21:30:14.268: INFO: Container reconcile ready: true, restart count 0 May 21 21:30:14.268: INFO: prometheus-k8s-0 started at 2021-05-21 20:08:06 +0000 UTC (0+5 container statuses recorded) May 21 21:30:14.268: INFO: Container custom-metrics-apiserver ready: true, restart count 0 May 21 21:30:14.268: INFO: Container grafana ready: true, restart count 0 May 21 21:30:14.268: INFO: Container prometheus ready: true, restart count 1 May 21 21:30:14.268: INFO: Container prometheus-config-reloader ready: true, restart count 0 May 21 21:30:14.268: INFO: Container rules-configmap-reloader ready: true, restart count 0 May 21 21:30:14.268: INFO: pod-configmaps-46c95fa0-506c-4e37-a8fc-a5f6c01a1c72 started at 2021-05-21 21:26:05 +0000 UTC (0+1 container statuses recorded) May 21 21:30:14.268: INFO: Container env-test ready: false, restart count 0 May 21 21:30:14.268: INFO: labelsupdatef591f359-8834-48e2-b911-31b34e549aef started at 2021-05-21 21:30:05 +0000 UTC (0+1 container statuses recorded) May 21 21:30:14.268: INFO: Container client-container ready: true, restart count 0 May 21 21:30:14.268: INFO: kube-flannel-k6mr4 started at 2021-05-21 19:57:34 +0000 UTC (1+1 container statuses recorded) May 21 21:30:14.268: INFO: Init container install-cni ready: true, restart count 1 May 21 21:30:14.268: INFO: Container kube-flannel ready: true, restart count 1 May 21 21:30:14.268: INFO: server-envvars-71ee385c-8848-4254-9b4d-2a1fe8ea0807 started at 2021-05-21 21:14:55 +0000 UTC (0+1 container statuses recorded) May 21 21:30:14.268: INFO: Container srv ready: true, restart count 0 May 21 21:30:14.268: INFO: test-pod started at 2021-05-21 21:28:21 +0000 UTC (0+1 container statuses recorded) May 21 21:30:14.268: INFO: Container webserver ready: false, restart count 0 May 21 21:30:14.268: INFO: cmk-webhook-6c9d5f8578-8pz6w started at 2021-05-21 20:07:00 +0000 UTC (0+1 container statuses recorded) May 21 21:30:14.268: INFO: Container cmk-webhook ready: true, restart count 0 May 21 21:30:14.268: INFO: collectd-mc5kl started at 2021-05-21 20:13:40 +0000 UTC (0+3 container statuses recorded) May 21 21:30:14.268: INFO: Container collectd ready: true, restart count 0 May 21 21:30:14.268: INFO: Container collectd-exporter ready: true, restart count 0 May 21 21:30:14.268: INFO: Container rbac-proxy ready: true, restart count 0 W0521 21:30:14.282043 25 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 21 21:30:14.998: INFO: Latency metrics for node node1 May 21 21:30:14.998: INFO: Logging node info for node node2 May 21 21:30:15.001: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 3f64ce47-e96b-43b8-9c91-df57a4e26826 30052 0 2021-05-21 19:56:58 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"4e:d8:e9:66:bc:b7"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-21 19:56:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-05-21 19:56:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-21 19:57:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-21 20:04:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-21 20:06:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-21 20:06:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269633024 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884632576 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-21 20:00:39 +0000 UTC,LastTransitionTime:2021-05-21 20:00:39 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-21 21:30:08 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-21 21:30:08 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-21 21:30:08 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-21 21:30:08 +0000 UTC,LastTransitionTime:2021-05-21 19:57:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:2aa9b8566664435b84c4146a11c874db,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:befe5c4e-169e-4c36-9e45-742bb80d4660,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:2b114e08442070e7232fcffc4cb89529bd5c9effe733ed690277a33772bf2d00 localhost:30500/barometer-collectd:stable],SizeBytes:1464382814,},ContainerImage{Names:[localhost:30500/cmk@sha256:1d865c665dfeeec5a879dca7b9945cc49f55f10921b4e729f0da0cdec7dedbf7 localhost:30500/cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:a4dc6d912ce1a8dd4c3a51b1cfb52454080ed36db95bf824895d5ecb7175199f localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392673,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:f013255695f4515c5b21b11281c7e0fb491082d15ec5a96adb8217e015a9c422 localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:50746f542c19fda01d88ae124ce58c5a326dad7cd24d3c2d19fdf959cc7f0c49 localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 21 21:30:15.001: INFO: Logging kubelet events for node node2 May 21 21:30:15.003: INFO: Logging pods the kubelet thinks is on node node2 May 21 21:30:15.019: INFO: test-rolling-update-controller-5gmll started at 2021-05-21 21:25:06 +0000 UTC (0+1 container statuses recorded) May 21 21:30:15.019: INFO: Container httpd ready: false, restart count 0 May 21 21:30:15.019: INFO: kube-proxy-q57hf started at 2021-05-21 19:57:00 +0000 UTC (0+1 container statuses recorded) May 21 21:30:15.019: INFO: Container kube-proxy ready: true, restart count 2 May 21 21:30:15.019: INFO: node-feature-discovery-worker-28kx4 started at 2021-05-21 20:03:47 +0000 UTC (0+1 container statuses recorded) May 21 21:30:15.019: INFO: Container nfd-worker ready: true, restart count 0 May 21 21:30:15.019: INFO: cmk-j2nnh started at 2021-05-21 20:07:00 +0000 UTC (0+2 container statuses recorded) May 21 21:30:15.019: INFO: Container nodereport ready: true, restart count 0 May 21 21:30:15.019: INFO: Container reconcile ready: true, restart count 0 May 21 21:30:15.019: INFO: node-exporter-c46fg started at 2021-05-21 20:07:54 +0000 UTC (0+2 container statuses recorded) May 21 21:30:15.019: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:30:15.019: INFO: Container node-exporter ready: true, restart count 0 May 21 21:30:15.019: INFO: ss-0 started at 2021-05-21 21:24:41 +0000 UTC (0+1 container statuses recorded) May 21 21:30:15.019: INFO: Container webserver ready: false, restart count 0 May 21 21:30:15.019: INFO: kube-flannel-5p7gq started at 2021-05-21 19:57:34 +0000 UTC (1+1 container statuses recorded) May 21 21:30:15.019: INFO: Init container install-cni ready: true, restart count 2 May 21 21:30:15.019: INFO: Container kube-flannel ready: true, restart count 2 May 21 21:30:15.019: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-j7fm6 started at 2021-05-21 20:04:29 +0000 UTC (0+1 container statuses recorded) May 21 21:30:15.019: INFO: Container kube-sriovdp ready: true, restart count 0 May 21 21:30:15.019: INFO: downward-api-693016f4-b946-499b-94de-e704d3cf4782 started at 2021-05-21 21:25:19 +0000 UTC (0+1 container statuses recorded) May 21 21:30:15.019: INFO: Container dapi-container ready: false, restart count 0 May 21 21:30:15.019: INFO: ss-0 started at 2021-05-21 21:25:26 +0000 UTC (0+1 container statuses recorded) May 21 21:30:15.019: INFO: Container webserver ready: false, restart count 0 May 21 21:30:15.019: INFO: pod-update-activedeadlineseconds-5540cee0-4476-496f-94f4-7fe4b1559547 started at 2021-05-21 21:30:12 +0000 UTC (0+1 container statuses recorded) May 21 21:30:15.019: INFO: Container nginx ready: false, restart count 0 May 21 21:30:15.019: INFO: kube-multus-ds-amd64-6q46t started at 2021-05-21 19:57:42 +0000 UTC (0+1 container statuses recorded) May 21 21:30:15.019: INFO: Container kube-multus ready: true, restart count 1 May 21 21:30:15.019: INFO: cmk-init-discover-node2-p7sdn started at 2021-05-21 20:06:37 +0000 UTC (0+3 container statuses recorded) May 21 21:30:15.019: INFO: Container discover ready: false, restart count 0 May 21 21:30:15.019: INFO: Container init ready: false, restart count 0 May 21 21:30:15.019: INFO: Container install ready: false, restart count 0 May 21 21:30:15.019: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-8kddc started at 2021-05-21 20:10:49 +0000 UTC (0+2 container statuses recorded) May 21 21:30:15.019: INFO: Container tas-controller ready: true, restart count 0 May 21 21:30:15.019: INFO: Container tas-extender ready: true, restart count 0 May 21 21:30:15.019: INFO: nginx-proxy-node2 started at 2021-05-21 20:03:00 +0000 UTC (0+1 container statuses recorded) May 21 21:30:15.019: INFO: Container nginx-proxy ready: true, restart count 2 May 21 21:30:15.019: INFO: busybox-17e87367-50dd-4d4d-8a62-53d2ff289bab started at 2021-05-21 21:30:11 +0000 UTC (0+1 container statuses recorded) May 21 21:30:15.019: INFO: Container busybox ready: false, restart count 0 May 21 21:30:15.019: INFO: pod-projected-secrets-7223f31d-4ee3-47a0-927d-e5107bf3ae30 started at 2021-05-21 21:30:12 +0000 UTC (0+1 container statuses recorded) May 21 21:30:15.019: INFO: Container projected-secret-volume-test ready: false, restart count 0 May 21 21:30:15.019: INFO: collectd-tz5h5 started at 2021-05-21 20:13:40 +0000 UTC (0+3 container statuses recorded) May 21 21:30:15.019: INFO: Container collectd ready: true, restart count 0 May 21 21:30:15.019: INFO: Container collectd-exporter ready: true, restart count 0 May 21 21:30:15.019: INFO: Container rbac-proxy ready: true, restart count 0 W0521 21:30:15.033174 25 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 21 21:30:15.093: INFO: Latency metrics for node node2 May 21 21:30:15.093: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "var-expansion-4221" for this suite. /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 May 21 21:35:21.384: Unexpected error: <*errors.errorString | 0xc0002c4200>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:103 [BeforeEach] [k8s.io] Kubelet /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client May 21 21:30:21.346: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename kubelet-test STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [k8s.io] Kubelet /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/kubelet.go:38 [It] should not write to root filesystem [LinuxOnly] [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 May 21 21:35:21.384: FAIL: Unexpected error: <*errors.errorString | 0xc0002c4200>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*PodClient).CreateSync(0xc005e25d20, 0xc00429c000, 0xc000036fc0) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:103 +0xfe k8s.io/kubernetes/test/e2e/common.glob..func12.5.1() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/kubelet.go:199 +0x206 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc001902480) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc001902480) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc001902480, 0x4de37a0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] Kubelet /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "kubelet-test-6887". STEP: Found 10 events. May 21 21:35:21.388: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for busybox-readonly-fs8211e09a-f168-41b5-af3e-827e02c7e8d2: { } Scheduled: Successfully assigned kubelet-test-6887/busybox-readonly-fs8211e09a-f168-41b5-af3e-827e02c7e8d2 to node2 May 21 21:35:21.389: INFO: At 2021-05-21 21:30:22 +0000 UTC - event for busybox-readonly-fs8211e09a-f168-41b5-af3e-827e02c7e8d2: {multus } AddedInterface: Add eth0 [10.244.4.155/24] May 21 21:35:21.389: INFO: At 2021-05-21 21:30:22 +0000 UTC - event for busybox-readonly-fs8211e09a-f168-41b5-af3e-827e02c7e8d2: {kubelet node2} Pulling: Pulling image "docker.io/library/busybox:1.29" May 21 21:35:21.389: INFO: At 2021-05-21 21:30:23 +0000 UTC - event for busybox-readonly-fs8211e09a-f168-41b5-af3e-827e02c7e8d2: {kubelet node2} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit May 21 21:35:21.389: INFO: At 2021-05-21 21:30:23 +0000 UTC - event for busybox-readonly-fs8211e09a-f168-41b5-af3e-827e02c7e8d2: {kubelet node2} Failed: Error: ErrImagePull May 21 21:35:21.389: INFO: At 2021-05-21 21:30:24 +0000 UTC - event for busybox-readonly-fs8211e09a-f168-41b5-af3e-827e02c7e8d2: {kubelet node2} SandboxChanged: Pod sandbox changed, it will be killed and re-created. May 21 21:35:21.389: INFO: At 2021-05-21 21:30:26 +0000 UTC - event for busybox-readonly-fs8211e09a-f168-41b5-af3e-827e02c7e8d2: {multus } AddedInterface: Add eth0 [10.244.4.157/24] May 21 21:35:21.389: INFO: At 2021-05-21 21:30:26 +0000 UTC - event for busybox-readonly-fs8211e09a-f168-41b5-af3e-827e02c7e8d2: {kubelet node2} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" May 21 21:35:21.389: INFO: At 2021-05-21 21:30:26 +0000 UTC - event for busybox-readonly-fs8211e09a-f168-41b5-af3e-827e02c7e8d2: {kubelet node2} Failed: Error: ImagePullBackOff May 21 21:35:21.389: INFO: At 2021-05-21 21:30:29 +0000 UTC - event for busybox-readonly-fs8211e09a-f168-41b5-af3e-827e02c7e8d2: {multus } AddedInterface: Add eth0 [10.244.4.158/24] May 21 21:35:21.391: INFO: POD NODE PHASE GRACE CONDITIONS May 21 21:35:21.391: INFO: busybox-readonly-fs8211e09a-f168-41b5-af3e-827e02c7e8d2 node2 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-05-21 21:30:21 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-05-21 21:30:21 +0000 UTC ContainersNotReady containers with unready status: [busybox-readonly-fs8211e09a-f168-41b5-af3e-827e02c7e8d2]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-05-21 21:30:21 +0000 UTC ContainersNotReady containers with unready status: [busybox-readonly-fs8211e09a-f168-41b5-af3e-827e02c7e8d2]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-05-21 21:30:21 +0000 UTC }] May 21 21:35:21.391: INFO: May 21 21:35:21.395: INFO: Logging node info for node master1 May 21 21:35:21.398: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 18cf10c1-c08b-4d36-bbe6-5aa86f02296e 32980 0 2021-05-21 19:55:07 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"d2:e0:bb:d8:54:80"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-21 19:55:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-21 19:55:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-21 19:57:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-21 19:57:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-05-21 20:04:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234763776 0} {<nil>} 196518324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324599808 0} {<nil>} 195629492Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-21 19:59:55 +0000 UTC,LastTransitionTime:2021-05-21 19:59:55 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-21 21:35:15 +0000 UTC,LastTransitionTime:2021-05-21 19:55:07 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-21 21:35:15 +0000 UTC,LastTransitionTime:2021-05-21 19:55:07 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-21 21:35:15 +0000 UTC,LastTransitionTime:2021-05-21 19:55:07 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-21 21:35:15 +0000 UTC,LastTransitionTime:2021-05-21 19:59:16 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0b916e2f445c4d05b6a9058a788d9410,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:ab86499b-409f-44c9-86ff-e9bc113e4112,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:f013255695f4515c5b21b11281c7e0fb491082d15ec5a96adb8217e015a9c422 tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:50746f542c19fda01d88ae124ce58c5a326dad7cd24d3c2d19fdf959cc7f0c49 tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 21 21:35:21.398: INFO: Logging kubelet events for node master1 May 21 21:35:21.400: INFO: Logging pods the kubelet thinks is on node master1 May 21 21:35:21.408: INFO: kube-proxy-zv2rb started at 2021-05-21 19:57:00 +0000 UTC (0+1 container statuses recorded) May 21 21:35:21.408: INFO: Container kube-proxy ready: true, restart count 2 May 21 21:35:21.408: INFO: kube-flannel-5lkd2 started at 2021-05-21 19:57:34 +0000 UTC (1+1 container statuses recorded) May 21 21:35:21.408: INFO: Init container install-cni ready: true, restart count 0 May 21 21:35:21.408: INFO: Container kube-flannel ready: true, restart count 2 May 21 21:35:21.408: INFO: kube-scheduler-master1 started at 2021-05-21 19:59:16 +0000 UTC (0+1 container statuses recorded) May 21 21:35:21.408: INFO: Container kube-scheduler ready: true, restart count 0 May 21 21:35:21.408: INFO: kube-apiserver-master1 started at 2021-05-21 20:03:10 +0000 UTC (0+1 container statuses recorded) May 21 21:35:21.408: INFO: Container kube-apiserver ready: true, restart count 0 May 21 21:35:21.408: INFO: kube-controller-manager-master1 started at 2021-05-21 19:59:16 +0000 UTC (0+1 container statuses recorded) May 21 21:35:21.409: INFO: Container kube-controller-manager ready: true, restart count 3 May 21 21:35:21.409: INFO: kube-multus-ds-amd64-z8khx started at 2021-05-21 19:57:42 +0000 UTC (0+1 container statuses recorded) May 21 21:35:21.409: INFO: Container kube-multus ready: true, restart count 1 May 21 21:35:21.409: INFO: docker-registry-docker-registry-56cbc7bc58-mft7s started at 2021-05-21 20:00:26 +0000 UTC (0+2 container statuses recorded) May 21 21:35:21.409: INFO: Container docker-registry ready: true, restart count 0 May 21 21:35:21.409: INFO: Container nginx ready: true, restart count 0 May 21 21:35:21.409: INFO: node-feature-discovery-controller-5bf5c49849-ktcdq started at 2021-05-21 20:03:57 +0000 UTC (0+1 container statuses recorded) May 21 21:35:21.409: INFO: Container nfd-controller ready: true, restart count 0 May 21 21:35:21.409: INFO: node-exporter-m7jht started at 2021-05-21 20:07:54 +0000 UTC (0+2 container statuses recorded) May 21 21:35:21.409: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:35:21.409: INFO: Container node-exporter ready: true, restart count 0 W0521 21:35:21.422271 25 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 21 21:35:21.448: INFO: Latency metrics for node master1 May 21 21:35:21.448: INFO: Logging node info for node master2 May 21 21:35:21.451: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 d439093b-ce44-47e7-8b41-5739b7c49ca5 33067 0 2021-05-21 19:55:46 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"62:5a:fb:0b:f8:b0"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-21 19:55:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-21 19:55:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-21 19:57:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-21 19:57:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234763776 0} {<nil>} 196518324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324599808 0} {<nil>} 195629492Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-21 20:00:49 +0000 UTC,LastTransitionTime:2021-05-21 20:00:49 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-21 21:35:19 +0000 UTC,LastTransitionTime:2021-05-21 19:55:46 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-21 21:35:19 +0000 UTC,LastTransitionTime:2021-05-21 19:55:46 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-21 21:35:19 +0000 UTC,LastTransitionTime:2021-05-21 19:55:46 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-21 21:35:19 +0000 UTC,LastTransitionTime:2021-05-21 19:57:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:495d1cf47bdb4c7e982c636c95de5648,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:cca785c0-d61e-403e-91fd-d0d4f3fa573c,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 21 21:35:21.451: INFO: Logging kubelet events for node master2 May 21 21:35:21.454: INFO: Logging pods the kubelet thinks is on node master2 May 21 21:35:21.462: INFO: kube-controller-manager-master2 started at 2021-05-21 19:59:58 +0000 UTC (0+1 container statuses recorded) May 21 21:35:21.462: INFO: Container kube-controller-manager ready: true, restart count 2 May 21 21:35:21.462: INFO: kube-scheduler-master2 started at 2021-05-21 20:00:08 +0000 UTC (0+1 container statuses recorded) May 21 21:35:21.462: INFO: Container kube-scheduler ready: true, restart count 2 May 21 21:35:21.462: INFO: kube-proxy-shdjd started at 2021-05-21 19:57:00 +0000 UTC (0+1 container statuses recorded) May 21 21:35:21.462: INFO: Container kube-proxy ready: true, restart count 1 May 21 21:35:21.462: INFO: kube-flannel-tnf5x started at 2021-05-21 19:57:34 +0000 UTC (1+1 container statuses recorded) May 21 21:35:21.462: INFO: Init container install-cni ready: true, restart count 0 May 21 21:35:21.462: INFO: Container kube-flannel ready: true, restart count 1 May 21 21:35:21.462: INFO: kube-multus-ds-amd64-lwzkr started at 2021-05-21 19:57:42 +0000 UTC (0+1 container statuses recorded) May 21 21:35:21.462: INFO: Container kube-multus ready: true, restart count 1 May 21 21:35:21.462: INFO: dns-autoscaler-5b7b5c9b6f-dvlvw started at 2021-05-21 19:58:05 +0000 UTC (0+1 container statuses recorded) May 21 21:35:21.462: INFO: Container autoscaler ready: true, restart count 2 May 21 21:35:21.462: INFO: node-exporter-q52l5 started at 2021-05-21 20:07:54 +0000 UTC (0+2 container statuses recorded) May 21 21:35:21.462: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:35:21.462: INFO: Container node-exporter ready: true, restart count 0 May 21 21:35:21.462: INFO: kube-apiserver-master2 started at 2021-05-21 20:03:00 +0000 UTC (0+1 container statuses recorded) May 21 21:35:21.462: INFO: Container kube-apiserver ready: true, restart count 0 May 21 21:35:21.462: INFO: coredns-7677f9bb54-lv5gk started at 2021-05-21 19:58:07 +0000 UTC (0+1 container statuses recorded) May 21 21:35:21.462: INFO: Container coredns ready: true, restart count 1 W0521 21:35:21.473116 25 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 21 21:35:21.501: INFO: Latency metrics for node master2 May 21 21:35:21.501: INFO: Logging node info for node master3 May 21 21:35:21.503: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 23066049-f3f1-42a7-9cea-19e20ed4ccec 32979 0 2021-05-21 19:55:56 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:a6:e4:e7:ba:02"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-21 19:55:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-21 19:55:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-21 19:57:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-21 19:57:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234767872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324603904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-21 20:00:41 +0000 UTC,LastTransitionTime:2021-05-21 20:00:41 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-21 21:35:15 +0000 UTC,LastTransitionTime:2021-05-21 19:55:56 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-21 21:35:15 +0000 UTC,LastTransitionTime:2021-05-21 19:55:56 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-21 21:35:15 +0000 UTC,LastTransitionTime:2021-05-21 19:55:56 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-21 21:35:15 +0000 UTC,LastTransitionTime:2021-05-21 19:57:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:660844f5cb0944868621042562b928e3,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:02066ff3-4833-4130-ba94-138c581e4cc0,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 21 21:35:21.504: INFO: Logging kubelet events for node master3 May 21 21:35:21.506: INFO: Logging pods the kubelet thinks is on node master3 May 21 21:35:21.514: INFO: kube-controller-manager-master3 started at 2021-05-21 20:03:00 +0000 UTC (0+1 container statuses recorded) May 21 21:35:21.514: INFO: Container kube-controller-manager ready: true, restart count 1 May 21 21:35:21.514: INFO: kube-scheduler-master3 started at 2021-05-21 20:03:10 +0000 UTC (0+1 container statuses recorded) May 21 21:35:21.514: INFO: Container kube-scheduler ready: true, restart count 1 May 21 21:35:21.514: INFO: kube-apiserver-master3 started at 2021-05-21 20:03:20 +0000 UTC (0+1 container statuses recorded) May 21 21:35:21.514: INFO: Container kube-apiserver ready: true, restart count 0 May 21 21:35:21.514: INFO: kube-proxy-hwwxt started at 2021-05-21 19:57:00 +0000 UTC (0+1 container statuses recorded) May 21 21:35:21.514: INFO: Container kube-proxy ready: true, restart count 2 May 21 21:35:21.514: INFO: kube-flannel-8sd6n started at 2021-05-21 19:57:34 +0000 UTC (1+1 container statuses recorded) May 21 21:35:21.514: INFO: Init container install-cni ready: true, restart count 0 May 21 21:35:21.514: INFO: Container kube-flannel ready: true, restart count 1 May 21 21:35:21.514: INFO: kube-multus-ds-amd64-zgdbl started at 2021-05-21 19:57:42 +0000 UTC (0+1 container statuses recorded) May 21 21:35:21.514: INFO: Container kube-multus ready: true, restart count 1 May 21 21:35:21.514: INFO: coredns-7677f9bb54-gjt42 started at 2021-05-21 19:58:03 +0000 UTC (0+1 container statuses recorded) May 21 21:35:21.514: INFO: Container coredns ready: true, restart count 1 May 21 21:35:21.514: INFO: node-exporter-s74rx started at 2021-05-21 20:07:54 +0000 UTC (0+2 container statuses recorded) May 21 21:35:21.514: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:35:21.514: INFO: Container node-exporter ready: true, restart count 0 W0521 21:35:21.527353 25 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 21 21:35:21.551: INFO: Latency metrics for node master3 May 21 21:35:21.551: INFO: Logging node info for node node1 May 21 21:35:21.554: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 62cfecb3-af08-42a4-ab85-25a317061b61 33081 0 2021-05-21 19:56:58 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"22:2e:2b:06:83:4a"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-21 19:56:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-05-21 19:56:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-21 19:57:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-21 20:04:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-21 20:06:20 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-21 20:06:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269628928 0} {<nil>} 196552372Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884628480 0} {<nil>} 174692020Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-21 20:00:36 +0000 UTC,LastTransitionTime:2021-05-21 20:00:36 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-21 21:35:19 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-21 21:35:19 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-21 21:35:19 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-21 21:35:19 +0000 UTC,LastTransitionTime:2021-05-21 19:57:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:94b7bb79c41d4a0492f63fb5fb3c5cc0,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:1e94d819-8d68-4948-b171-5fd2d8fc7ff5,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:2b114e08442070e7232fcffc4cb89529bd5c9effe733ed690277a33772bf2d00 localhost:30500/barometer-collectd:stable],SizeBytes:1464382814,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:1002487865,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:ed5c574f653e2a39e784ff322033a2319aafde7366c803a88f20f7a2a8bc1efb opnfv/barometer-collectd:stable],SizeBytes:825413035,},ContainerImage{Names:[localhost:30500/cmk@sha256:1d865c665dfeeec5a879dca7b9945cc49f55f10921b4e729f0da0cdec7dedbf7 cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[golang@sha256:1636899c10870ab66c48d960a9df620f4f9e86a0c72fbacf36032d27404e7e6c golang:alpine3.12],SizeBytes:301156062,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:a4dc6d912ce1a8dd4c3a51b1cfb52454080ed36db95bf824895d5ecb7175199f nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392673,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:36553b10a4947067b9fbb7d532951066293a68eae893beba1d9235f7d11a20ad alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 21 21:35:21.555: INFO: Logging kubelet events for node node1 May 21 21:35:21.557: INFO: Logging pods the kubelet thinks is on node node1 May 21 21:35:21.573: INFO: node-exporter-l5k2r started at 2021-05-21 20:07:54 +0000 UTC (0+2 container statuses recorded) May 21 21:35:21.573: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:35:21.573: INFO: Container node-exporter ready: true, restart count 0 May 21 21:35:21.573: INFO: kube-multus-ds-amd64-wlmhr started at 2021-05-21 19:57:42 +0000 UTC (0+1 container statuses recorded) May 21 21:35:21.573: INFO: Container kube-multus ready: true, restart count 1 May 21 21:35:21.573: INFO: kubernetes-metrics-scraper-678c97765c-nnrtl started at 2021-05-21 19:58:07 +0000 UTC (0+1 container statuses recorded) May 21 21:35:21.573: INFO: Container kubernetes-metrics-scraper ready: true, restart count 2 May 21 21:35:21.573: INFO: prometheus-operator-5bb8cb9d8f-mzlrf started at 2021-05-21 20:07:47 +0000 UTC (0+2 container statuses recorded) May 21 21:35:21.573: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:35:21.573: INFO: Container prometheus-operator ready: true, restart count 0 May 21 21:35:21.573: INFO: nginx-proxy-node1 started at 2021-05-21 20:03:00 +0000 UTC (0+1 container statuses recorded) May 21 21:35:21.573: INFO: Container nginx-proxy ready: true, restart count 1 May 21 21:35:21.573: INFO: cmk-h8jxp started at 2021-05-21 20:07:00 +0000 UTC (0+2 container statuses recorded) May 21 21:35:21.573: INFO: Container nodereport ready: true, restart count 0 May 21 21:35:21.573: INFO: Container reconcile ready: true, restart count 0 May 21 21:35:21.573: INFO: prometheus-k8s-0 started at 2021-05-21 20:08:06 +0000 UTC (0+5 container statuses recorded) May 21 21:35:21.573: INFO: Container custom-metrics-apiserver ready: true, restart count 0 May 21 21:35:21.573: INFO: Container grafana ready: true, restart count 0 May 21 21:35:21.573: INFO: Container prometheus ready: true, restart count 1 May 21 21:35:21.573: INFO: Container prometheus-config-reloader ready: true, restart count 0 May 21 21:35:21.573: INFO: Container rules-configmap-reloader ready: true, restart count 0 May 21 21:35:21.573: INFO: kube-flannel-k6mr4 started at 2021-05-21 19:57:34 +0000 UTC (1+1 container statuses recorded) May 21 21:35:21.573: INFO: Init container install-cni ready: true, restart count 1 May 21 21:35:21.573: INFO: Container kube-flannel ready: true, restart count 1 May 21 21:35:21.573: INFO: liveness-a5f9f699-4122-4365-aff2-0c97e279f909 started at 2021-05-21 21:35:08 +0000 UTC (0+1 container statuses recorded) May 21 21:35:21.573: INFO: Container liveness ready: true, restart count 0 May 21 21:35:21.573: INFO: cmk-webhook-6c9d5f8578-8pz6w started at 2021-05-21 20:07:00 +0000 UTC (0+1 container statuses recorded) May 21 21:35:21.573: INFO: Container cmk-webhook ready: true, restart count 0 May 21 21:35:21.573: INFO: collectd-mc5kl started at 2021-05-21 20:13:40 +0000 UTC (0+3 container statuses recorded) May 21 21:35:21.573: INFO: Container collectd ready: true, restart count 0 May 21 21:35:21.573: INFO: Container collectd-exporter ready: true, restart count 0 May 21 21:35:21.573: INFO: Container rbac-proxy ready: true, restart count 0 May 21 21:35:21.573: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-czhnm started at 2021-05-21 20:04:29 +0000 UTC (0+1 container statuses recorded) May 21 21:35:21.573: INFO: Container kube-sriovdp ready: true, restart count 0 May 21 21:35:21.573: INFO: busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00 started at 2021-05-21 21:35:15 +0000 UTC (0+1 container statuses recorded) May 21 21:35:21.573: INFO: Container busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00 ready: false, restart count 0 May 21 21:35:21.573: INFO: kube-proxy-h5k9s started at 2021-05-21 19:57:00 +0000 UTC (0+1 container statuses recorded) May 21 21:35:21.573: INFO: Container kube-proxy ready: true, restart count 1 May 21 21:35:21.573: INFO: cmk-init-discover-node1-48g7j started at 2021-05-21 20:06:17 +0000 UTC (0+3 container statuses recorded) May 21 21:35:21.573: INFO: Container discover ready: false, restart count 0 May 21 21:35:21.573: INFO: Container init ready: false, restart count 0 May 21 21:35:21.573: INFO: Container install ready: false, restart count 0 May 21 21:35:21.573: INFO: pod-configmaps-973853b2-2b0a-427a-b65f-a3b4fe6dfc9c started at 2021-05-21 21:31:56 +0000 UTC (0+2 container statuses recorded) May 21 21:35:21.573: INFO: Container configmap-volume-binary-test ready: false, restart count 0 May 21 21:35:21.573: INFO: Container configmap-volume-data-test ready: true, restart count 0 May 21 21:35:21.573: INFO: kubernetes-dashboard-86c6f9df5b-8rsws started at 2021-05-21 19:58:07 +0000 UTC (0+1 container statuses recorded) May 21 21:35:21.573: INFO: Container kubernetes-dashboard ready: true, restart count 1 May 21 21:35:21.573: INFO: node-feature-discovery-worker-lh5hz started at 2021-05-21 20:03:47 +0000 UTC (0+1 container statuses recorded) May 21 21:35:21.573: INFO: Container nfd-worker ready: true, restart count 0 W0521 21:35:21.586384 25 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 21 21:35:21.633: INFO: Latency metrics for node node1 May 21 21:35:21.633: INFO: Logging node info for node node2 May 21 21:35:21.636: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 3f64ce47-e96b-43b8-9c91-df57a4e26826 33074 0 2021-05-21 19:56:58 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"4e:d8:e9:66:bc:b7"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-21 19:56:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-05-21 19:56:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-21 19:57:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-21 20:04:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-21 20:06:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-21 20:06:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269633024 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884632576 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-21 20:00:39 +0000 UTC,LastTransitionTime:2021-05-21 20:00:39 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-21 21:35:19 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-21 21:35:19 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-21 21:35:19 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-21 21:35:19 +0000 UTC,LastTransitionTime:2021-05-21 19:57:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:2aa9b8566664435b84c4146a11c874db,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:befe5c4e-169e-4c36-9e45-742bb80d4660,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:2b114e08442070e7232fcffc4cb89529bd5c9effe733ed690277a33772bf2d00 localhost:30500/barometer-collectd:stable],SizeBytes:1464382814,},ContainerImage{Names:[localhost:30500/cmk@sha256:1d865c665dfeeec5a879dca7b9945cc49f55f10921b4e729f0da0cdec7dedbf7 localhost:30500/cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:a4dc6d912ce1a8dd4c3a51b1cfb52454080ed36db95bf824895d5ecb7175199f localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392673,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:f013255695f4515c5b21b11281c7e0fb491082d15ec5a96adb8217e015a9c422 localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:50746f542c19fda01d88ae124ce58c5a326dad7cd24d3c2d19fdf959cc7f0c49 localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 21 21:35:21.636: INFO: Logging kubelet events for node node2 May 21 21:35:21.639: INFO: Logging pods the kubelet thinks is on node node2 May 21 21:35:21.652: INFO: collectd-tz5h5 started at 2021-05-21 20:13:40 +0000 UTC (0+3 container statuses recorded) May 21 21:35:21.652: INFO: Container collectd ready: true, restart count 0 May 21 21:35:21.652: INFO: Container collectd-exporter ready: true, restart count 0 May 21 21:35:21.652: INFO: Container rbac-proxy ready: true, restart count 0 May 21 21:35:21.652: INFO: foo-fbxdj started at 2021-05-21 21:30:30 +0000 UTC (0+1 container statuses recorded) May 21 21:35:21.652: INFO: Container c ready: false, restart count 0 May 21 21:35:21.652: INFO: termination-message-containerf07b56c9-8e08-4407-9cba-777cb45ca08a started at 2021-05-21 21:35:13 +0000 UTC (0+1 container statuses recorded) May 21 21:35:21.652: INFO: Container termination-message-container ready: false, restart count 0 May 21 21:35:21.652: INFO: termination-message-containerd3db3f0c-7f8e-4f60-b458-411cd464eb8b started at 2021-05-21 21:35:15 +0000 UTC (0+1 container statuses recorded) May 21 21:35:21.652: INFO: Container termination-message-container ready: false, restart count 0 May 21 21:35:21.652: INFO: cmk-j2nnh started at 2021-05-21 20:07:00 +0000 UTC (0+2 container statuses recorded) May 21 21:35:21.652: INFO: Container nodereport ready: true, restart count 0 May 21 21:35:21.652: INFO: Container reconcile ready: true, restart count 0 May 21 21:35:21.652: INFO: node-exporter-c46fg started at 2021-05-21 20:07:54 +0000 UTC (0+2 container statuses recorded) May 21 21:35:21.652: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:35:21.652: INFO: Container node-exporter ready: true, restart count 0 May 21 21:35:21.652: INFO: busybox-readonly-fs8211e09a-f168-41b5-af3e-827e02c7e8d2 started at 2021-05-21 21:30:21 +0000 UTC (0+1 container statuses recorded) May 21 21:35:21.652: INFO: Container busybox-readonly-fs8211e09a-f168-41b5-af3e-827e02c7e8d2 ready: false, restart count 0 May 21 21:35:21.652: INFO: kube-proxy-q57hf started at 2021-05-21 19:57:00 +0000 UTC (0+1 container statuses recorded) May 21 21:35:21.652: INFO: Container kube-proxy ready: true, restart count 2 May 21 21:35:21.652: INFO: node-feature-discovery-worker-28kx4 started at 2021-05-21 20:03:47 +0000 UTC (0+1 container statuses recorded) May 21 21:35:21.652: INFO: Container nfd-worker ready: true, restart count 0 May 21 21:35:21.652: INFO: ss-0 started at 2021-05-21 21:33:14 +0000 UTC (0+1 container statuses recorded) May 21 21:35:21.652: INFO: Container webserver ready: false, restart count 0 May 21 21:35:21.652: INFO: foo-l9rbb started at 2021-05-21 21:30:30 +0000 UTC (0+1 container statuses recorded) May 21 21:35:21.652: INFO: Container c ready: false, restart count 0 May 21 21:35:21.652: INFO: ss-0 started at 2021-05-21 21:25:26 +0000 UTC (0+1 container statuses recorded) May 21 21:35:21.652: INFO: Container webserver ready: false, restart count 0 May 21 21:35:21.652: INFO: kube-flannel-5p7gq started at 2021-05-21 19:57:34 +0000 UTC (1+1 container statuses recorded) May 21 21:35:21.652: INFO: Init container install-cni ready: true, restart count 2 May 21 21:35:21.652: INFO: Container kube-flannel ready: true, restart count 2 May 21 21:35:21.652: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-j7fm6 started at 2021-05-21 20:04:29 +0000 UTC (0+1 container statuses recorded) May 21 21:35:21.652: INFO: Container kube-sriovdp ready: true, restart count 0 May 21 21:35:21.652: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-8kddc started at 2021-05-21 20:10:49 +0000 UTC (0+2 container statuses recorded) May 21 21:35:21.652: INFO: Container tas-controller ready: true, restart count 0 May 21 21:35:21.652: INFO: Container tas-extender ready: true, restart count 0 May 21 21:35:21.652: INFO: downward-api-1499468a-6e10-47f6-a735-09d7d997a784 started at 2021-05-21 21:33:48 +0000 UTC (0+1 container statuses recorded) May 21 21:35:21.652: INFO: Container dapi-container ready: false, restart count 0 May 21 21:35:21.652: INFO: kube-multus-ds-amd64-6q46t started at 2021-05-21 19:57:42 +0000 UTC (0+1 container statuses recorded) May 21 21:35:21.652: INFO: Container kube-multus ready: true, restart count 1 May 21 21:35:21.653: INFO: cmk-init-discover-node2-p7sdn started at 2021-05-21 20:06:37 +0000 UTC (0+3 container statuses recorded) May 21 21:35:21.653: INFO: Container discover ready: false, restart count 0 May 21 21:35:21.653: INFO: Container init ready: false, restart count 0 May 21 21:35:21.653: INFO: Container install ready: false, restart count 0 May 21 21:35:21.653: INFO: nginx-proxy-node2 started at 2021-05-21 20:03:00 +0000 UTC (0+1 container statuses recorded) May 21 21:35:21.653: INFO: Container nginx-proxy ready: true, restart count 2 W0521 21:35:21.663988 25 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 21 21:35:21.704: INFO: Latency metrics for node node2 May 21 21:35:21.704: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "kubelet-test-6887" for this suite. /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 May 21 21:37:33.668: while waiting for pod to be running Unexpected error: <*errors.errorString | 0xc0002c4200>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/expansion.go:331 [BeforeEach] [k8s.io] Variable Expansion /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client May 21 21:35:33.627: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename var-expansion STEP: Waiting for a default service account to be provisioned in namespace [It] should succeed in writing subpaths in container [sig-storage][Slow] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: creating the pod STEP: waiting for pod running May 21 21:37:33.668: FAIL: while waiting for pod to be running Unexpected error: <*errors.errorString | 0xc0002c4200>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/common.glob..func9.8() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/expansion.go:331 +0x4ad k8s.io/kubernetes/test/e2e.RunE2ETests(0xc001902480) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc001902480) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc001902480, 0x4de37a0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] Variable Expansion /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "var-expansion-6967". STEP: Found 9 events. May 21 21:37:33.673: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for var-expansion-5bc1be18-bfff-4578-8012-160b506bc70e: { } Scheduled: Successfully assigned var-expansion-6967/var-expansion-5bc1be18-bfff-4578-8012-160b506bc70e to node2 May 21 21:37:33.673: INFO: At 2021-05-21 21:35:35 +0000 UTC - event for var-expansion-5bc1be18-bfff-4578-8012-160b506bc70e: {multus } AddedInterface: Add eth0 [10.244.4.182/24] May 21 21:37:33.673: INFO: At 2021-05-21 21:35:35 +0000 UTC - event for var-expansion-5bc1be18-bfff-4578-8012-160b506bc70e: {kubelet node2} Pulling: Pulling image "docker.io/library/busybox:1.29" May 21 21:37:33.673: INFO: At 2021-05-21 21:35:35 +0000 UTC - event for var-expansion-5bc1be18-bfff-4578-8012-160b506bc70e: {kubelet node2} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit May 21 21:37:33.673: INFO: At 2021-05-21 21:35:35 +0000 UTC - event for var-expansion-5bc1be18-bfff-4578-8012-160b506bc70e: {kubelet node2} Failed: Error: ErrImagePull May 21 21:37:33.673: INFO: At 2021-05-21 21:35:36 +0000 UTC - event for var-expansion-5bc1be18-bfff-4578-8012-160b506bc70e: {kubelet node2} SandboxChanged: Pod sandbox changed, it will be killed and re-created. May 21 21:37:33.673: INFO: At 2021-05-21 21:35:38 +0000 UTC - event for var-expansion-5bc1be18-bfff-4578-8012-160b506bc70e: {multus } AddedInterface: Add eth0 [10.244.4.183/24] May 21 21:37:33.673: INFO: At 2021-05-21 21:35:38 +0000 UTC - event for var-expansion-5bc1be18-bfff-4578-8012-160b506bc70e: {kubelet node2} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" May 21 21:37:33.673: INFO: At 2021-05-21 21:35:38 +0000 UTC - event for var-expansion-5bc1be18-bfff-4578-8012-160b506bc70e: {kubelet node2} Failed: Error: ImagePullBackOff May 21 21:37:33.675: INFO: POD NODE PHASE GRACE CONDITIONS May 21 21:37:33.675: INFO: var-expansion-5bc1be18-bfff-4578-8012-160b506bc70e node2 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-05-21 21:35:33 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-05-21 21:35:33 +0000 UTC ContainersNotReady containers with unready status: [dapi-container]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-05-21 21:35:33 +0000 UTC ContainersNotReady containers with unready status: [dapi-container]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-05-21 21:35:33 +0000 UTC }] May 21 21:37:33.675: INFO: May 21 21:37:33.680: INFO: Logging node info for node master1 May 21 21:37:33.683: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 18cf10c1-c08b-4d36-bbe6-5aa86f02296e 34057 0 2021-05-21 19:55:07 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"d2:e0:bb:d8:54:80"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-21 19:55:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-21 19:55:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-21 19:57:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-21 19:57:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-05-21 20:04:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234763776 0} {<nil>} 196518324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324599808 0} {<nil>} 195629492Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-21 19:59:55 +0000 UTC,LastTransitionTime:2021-05-21 19:59:55 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-21 21:37:26 +0000 UTC,LastTransitionTime:2021-05-21 19:55:07 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-21 21:37:26 +0000 UTC,LastTransitionTime:2021-05-21 19:55:07 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-21 21:37:26 +0000 UTC,LastTransitionTime:2021-05-21 19:55:07 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-21 21:37:26 +0000 UTC,LastTransitionTime:2021-05-21 19:59:16 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0b916e2f445c4d05b6a9058a788d9410,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:ab86499b-409f-44c9-86ff-e9bc113e4112,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:f013255695f4515c5b21b11281c7e0fb491082d15ec5a96adb8217e015a9c422 tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:50746f542c19fda01d88ae124ce58c5a326dad7cd24d3c2d19fdf959cc7f0c49 tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 21 21:37:33.683: INFO: Logging kubelet events for node master1 May 21 21:37:33.686: INFO: Logging pods the kubelet thinks is on node master1 May 21 21:37:33.694: INFO: kube-scheduler-master1 started at 2021-05-21 19:59:16 +0000 UTC (0+1 container statuses recorded) May 21 21:37:33.694: INFO: Container kube-scheduler ready: true, restart count 0 May 21 21:37:33.694: INFO: kube-apiserver-master1 started at 2021-05-21 20:03:10 +0000 UTC (0+1 container statuses recorded) May 21 21:37:33.694: INFO: Container kube-apiserver ready: true, restart count 0 May 21 21:37:33.694: INFO: kube-controller-manager-master1 started at 2021-05-21 19:59:16 +0000 UTC (0+1 container statuses recorded) May 21 21:37:33.694: INFO: Container kube-controller-manager ready: true, restart count 3 May 21 21:37:33.694: INFO: kube-multus-ds-amd64-z8khx started at 2021-05-21 19:57:42 +0000 UTC (0+1 container statuses recorded) May 21 21:37:33.694: INFO: Container kube-multus ready: true, restart count 1 May 21 21:37:33.694: INFO: docker-registry-docker-registry-56cbc7bc58-mft7s started at 2021-05-21 20:00:26 +0000 UTC (0+2 container statuses recorded) May 21 21:37:33.694: INFO: Container docker-registry ready: true, restart count 0 May 21 21:37:33.694: INFO: Container nginx ready: true, restart count 0 May 21 21:37:33.694: INFO: node-feature-discovery-controller-5bf5c49849-ktcdq started at 2021-05-21 20:03:57 +0000 UTC (0+1 container statuses recorded) May 21 21:37:33.694: INFO: Container nfd-controller ready: true, restart count 0 May 21 21:37:33.694: INFO: node-exporter-m7jht started at 2021-05-21 20:07:54 +0000 UTC (0+2 container statuses recorded) May 21 21:37:33.694: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:37:33.694: INFO: Container node-exporter ready: true, restart count 0 May 21 21:37:33.694: INFO: kube-proxy-zv2rb started at 2021-05-21 19:57:00 +0000 UTC (0+1 container statuses recorded) May 21 21:37:33.694: INFO: Container kube-proxy ready: true, restart count 2 May 21 21:37:33.694: INFO: kube-flannel-5lkd2 started at 2021-05-21 19:57:34 +0000 UTC (1+1 container statuses recorded) May 21 21:37:33.694: INFO: Init container install-cni ready: true, restart count 0 May 21 21:37:33.694: INFO: Container kube-flannel ready: true, restart count 2 W0521 21:37:33.708375 25 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 21 21:37:33.732: INFO: Latency metrics for node master1 May 21 21:37:33.732: INFO: Logging node info for node master2 May 21 21:37:33.734: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 d439093b-ce44-47e7-8b41-5739b7c49ca5 34086 0 2021-05-21 19:55:46 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"62:5a:fb:0b:f8:b0"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-21 19:55:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-21 19:55:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-21 19:57:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-21 19:57:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234763776 0} {<nil>} 196518324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324599808 0} {<nil>} 195629492Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-21 20:00:49 +0000 UTC,LastTransitionTime:2021-05-21 20:00:49 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-21 21:37:29 +0000 UTC,LastTransitionTime:2021-05-21 19:55:46 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-21 21:37:29 +0000 UTC,LastTransitionTime:2021-05-21 19:55:46 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-21 21:37:29 +0000 UTC,LastTransitionTime:2021-05-21 19:55:46 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-21 21:37:29 +0000 UTC,LastTransitionTime:2021-05-21 19:57:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:495d1cf47bdb4c7e982c636c95de5648,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:cca785c0-d61e-403e-91fd-d0d4f3fa573c,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 21 21:37:33.734: INFO: Logging kubelet events for node master2 May 21 21:37:33.736: INFO: Logging pods the kubelet thinks is on node master2 May 21 21:37:33.744: INFO: node-exporter-q52l5 started at 2021-05-21 20:07:54 +0000 UTC (0+2 container statuses recorded) May 21 21:37:33.744: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:37:33.744: INFO: Container node-exporter ready: true, restart count 0 May 21 21:37:33.744: INFO: kube-controller-manager-master2 started at 2021-05-21 19:59:58 +0000 UTC (0+1 container statuses recorded) May 21 21:37:33.744: INFO: Container kube-controller-manager ready: true, restart count 2 May 21 21:37:33.744: INFO: kube-scheduler-master2 started at 2021-05-21 20:00:08 +0000 UTC (0+1 container statuses recorded) May 21 21:37:33.744: INFO: Container kube-scheduler ready: true, restart count 2 May 21 21:37:33.744: INFO: kube-proxy-shdjd started at 2021-05-21 19:57:00 +0000 UTC (0+1 container statuses recorded) May 21 21:37:33.744: INFO: Container kube-proxy ready: true, restart count 1 May 21 21:37:33.744: INFO: kube-flannel-tnf5x started at 2021-05-21 19:57:34 +0000 UTC (1+1 container statuses recorded) May 21 21:37:33.744: INFO: Init container install-cni ready: true, restart count 0 May 21 21:37:33.744: INFO: Container kube-flannel ready: true, restart count 1 May 21 21:37:33.744: INFO: kube-multus-ds-amd64-lwzkr started at 2021-05-21 19:57:42 +0000 UTC (0+1 container statuses recorded) May 21 21:37:33.744: INFO: Container kube-multus ready: true, restart count 1 May 21 21:37:33.744: INFO: dns-autoscaler-5b7b5c9b6f-dvlvw started at 2021-05-21 19:58:05 +0000 UTC (0+1 container statuses recorded) May 21 21:37:33.744: INFO: Container autoscaler ready: true, restart count 2 May 21 21:37:33.744: INFO: kube-apiserver-master2 started at 2021-05-21 20:03:00 +0000 UTC (0+1 container statuses recorded) May 21 21:37:33.744: INFO: Container kube-apiserver ready: true, restart count 0 May 21 21:37:33.744: INFO: coredns-7677f9bb54-lv5gk started at 2021-05-21 19:58:07 +0000 UTC (0+1 container statuses recorded) May 21 21:37:33.744: INFO: Container coredns ready: true, restart count 1 W0521 21:37:33.759587 25 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 21 21:37:33.781: INFO: Latency metrics for node master2 May 21 21:37:33.781: INFO: Logging node info for node master3 May 21 21:37:33.784: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 23066049-f3f1-42a7-9cea-19e20ed4ccec 34056 0 2021-05-21 19:55:56 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:a6:e4:e7:ba:02"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-21 19:55:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-21 19:55:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-21 19:57:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-21 19:57:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234767872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324603904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-21 20:00:41 +0000 UTC,LastTransitionTime:2021-05-21 20:00:41 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-21 21:37:26 +0000 UTC,LastTransitionTime:2021-05-21 19:55:56 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-21 21:37:26 +0000 UTC,LastTransitionTime:2021-05-21 19:55:56 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-21 21:37:26 +0000 UTC,LastTransitionTime:2021-05-21 19:55:56 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-21 21:37:26 +0000 UTC,LastTransitionTime:2021-05-21 19:57:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:660844f5cb0944868621042562b928e3,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:02066ff3-4833-4130-ba94-138c581e4cc0,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 21 21:37:33.784: INFO: Logging kubelet events for node master3 May 21 21:37:33.786: INFO: Logging pods the kubelet thinks is on node master3 May 21 21:37:33.795: INFO: kube-multus-ds-amd64-zgdbl started at 2021-05-21 19:57:42 +0000 UTC (0+1 container statuses recorded) May 21 21:37:33.795: INFO: Container kube-multus ready: true, restart count 1 May 21 21:37:33.795: INFO: coredns-7677f9bb54-gjt42 started at 2021-05-21 19:58:03 +0000 UTC (0+1 container statuses recorded) May 21 21:37:33.795: INFO: Container coredns ready: true, restart count 1 May 21 21:37:33.795: INFO: node-exporter-s74rx started at 2021-05-21 20:07:54 +0000 UTC (0+2 container statuses recorded) May 21 21:37:33.795: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:37:33.795: INFO: Container node-exporter ready: true, restart count 0 May 21 21:37:33.795: INFO: kube-controller-manager-master3 started at 2021-05-21 20:03:00 +0000 UTC (0+1 container statuses recorded) May 21 21:37:33.795: INFO: Container kube-controller-manager ready: true, restart count 1 May 21 21:37:33.795: INFO: kube-scheduler-master3 started at 2021-05-21 20:03:10 +0000 UTC (0+1 container statuses recorded) May 21 21:37:33.795: INFO: Container kube-scheduler ready: true, restart count 1 May 21 21:37:33.795: INFO: kube-apiserver-master3 started at 2021-05-21 20:03:20 +0000 UTC (0+1 container statuses recorded) May 21 21:37:33.795: INFO: Container kube-apiserver ready: true, restart count 0 May 21 21:37:33.795: INFO: kube-proxy-hwwxt started at 2021-05-21 19:57:00 +0000 UTC (0+1 container statuses recorded) May 21 21:37:33.795: INFO: Container kube-proxy ready: true, restart count 2 May 21 21:37:33.795: INFO: kube-flannel-8sd6n started at 2021-05-21 19:57:34 +0000 UTC (1+1 container statuses recorded) May 21 21:37:33.795: INFO: Init container install-cni ready: true, restart count 0 May 21 21:37:33.795: INFO: Container kube-flannel ready: true, restart count 1 W0521 21:37:33.812428 25 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 21 21:37:33.841: INFO: Latency metrics for node master3 May 21 21:37:33.841: INFO: Logging node info for node node1 May 21 21:37:33.844: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 62cfecb3-af08-42a4-ab85-25a317061b61 34100 0 2021-05-21 19:56:58 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"22:2e:2b:06:83:4a"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-21 19:56:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-05-21 19:56:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-21 19:57:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-21 20:04:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-21 20:06:20 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-21 20:06:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269628928 0} {<nil>} 196552372Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884628480 0} {<nil>} 174692020Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-21 20:00:36 +0000 UTC,LastTransitionTime:2021-05-21 20:00:36 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-21 21:37:30 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-21 21:37:30 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-21 21:37:30 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-21 21:37:30 +0000 UTC,LastTransitionTime:2021-05-21 19:57:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:94b7bb79c41d4a0492f63fb5fb3c5cc0,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:1e94d819-8d68-4948-b171-5fd2d8fc7ff5,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:2b114e08442070e7232fcffc4cb89529bd5c9effe733ed690277a33772bf2d00 localhost:30500/barometer-collectd:stable],SizeBytes:1464382814,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:1002487865,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:ed5c574f653e2a39e784ff322033a2319aafde7366c803a88f20f7a2a8bc1efb opnfv/barometer-collectd:stable],SizeBytes:825413035,},ContainerImage{Names:[localhost:30500/cmk@sha256:1d865c665dfeeec5a879dca7b9945cc49f55f10921b4e729f0da0cdec7dedbf7 cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[golang@sha256:1636899c10870ab66c48d960a9df620f4f9e86a0c72fbacf36032d27404e7e6c golang:alpine3.12],SizeBytes:301156062,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:a4dc6d912ce1a8dd4c3a51b1cfb52454080ed36db95bf824895d5ecb7175199f nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392673,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:36553b10a4947067b9fbb7d532951066293a68eae893beba1d9235f7d11a20ad alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 21 21:37:33.845: INFO: Logging kubelet events for node node1 May 21 21:37:33.847: INFO: Logging pods the kubelet thinks is on node node1 May 21 21:37:33.905: INFO: cmk-webhook-6c9d5f8578-8pz6w started at 2021-05-21 20:07:00 +0000 UTC (0+1 container statuses recorded) May 21 21:37:33.905: INFO: Container cmk-webhook ready: true, restart count 0 May 21 21:37:33.905: INFO: collectd-mc5kl started at 2021-05-21 20:13:40 +0000 UTC (0+3 container statuses recorded) May 21 21:37:33.905: INFO: Container collectd ready: true, restart count 0 May 21 21:37:33.905: INFO: Container collectd-exporter ready: true, restart count 0 May 21 21:37:33.905: INFO: Container rbac-proxy ready: true, restart count 0 May 21 21:37:33.905: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-czhnm started at 2021-05-21 20:04:29 +0000 UTC (0+1 container statuses recorded) May 21 21:37:33.905: INFO: Container kube-sriovdp ready: true, restart count 0 May 21 21:37:33.905: INFO: busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00 started at 2021-05-21 21:35:15 +0000 UTC (0+1 container statuses recorded) May 21 21:37:33.905: INFO: Container busybox-user-65534-256e86af-24df-43c8-857b-bb29fcc37c00 ready: false, restart count 0 May 21 21:37:33.905: INFO: kube-proxy-h5k9s started at 2021-05-21 19:57:00 +0000 UTC (0+1 container statuses recorded) May 21 21:37:33.905: INFO: Container kube-proxy ready: true, restart count 1 May 21 21:37:33.905: INFO: cmk-init-discover-node1-48g7j started at 2021-05-21 20:06:17 +0000 UTC (0+3 container statuses recorded) May 21 21:37:33.905: INFO: Container discover ready: false, restart count 0 May 21 21:37:33.905: INFO: Container init ready: false, restart count 0 May 21 21:37:33.905: INFO: Container install ready: false, restart count 0 May 21 21:37:33.905: INFO: sample-apiserver-deployment-67dc674868-2n287 started at 2021-05-21 21:37:33 +0000 UTC (0+2 container statuses recorded) May 21 21:37:33.905: INFO: Container etcd ready: false, restart count 0 May 21 21:37:33.905: INFO: Container sample-apiserver ready: false, restart count 0 May 21 21:37:33.905: INFO: kubernetes-dashboard-86c6f9df5b-8rsws started at 2021-05-21 19:58:07 +0000 UTC (0+1 container statuses recorded) May 21 21:37:33.905: INFO: Container kubernetes-dashboard ready: true, restart count 1 May 21 21:37:33.905: INFO: node-feature-discovery-worker-lh5hz started at 2021-05-21 20:03:47 +0000 UTC (0+1 container statuses recorded) May 21 21:37:33.905: INFO: Container nfd-worker ready: true, restart count 0 May 21 21:37:33.905: INFO: kube-multus-ds-amd64-wlmhr started at 2021-05-21 19:57:42 +0000 UTC (0+1 container statuses recorded) May 21 21:37:33.905: INFO: Container kube-multus ready: true, restart count 1 May 21 21:37:33.905: INFO: kubernetes-metrics-scraper-678c97765c-nnrtl started at 2021-05-21 19:58:07 +0000 UTC (0+1 container statuses recorded) May 21 21:37:33.905: INFO: Container kubernetes-metrics-scraper ready: true, restart count 2 May 21 21:37:33.905: INFO: prometheus-operator-5bb8cb9d8f-mzlrf started at 2021-05-21 20:07:47 +0000 UTC (0+2 container statuses recorded) May 21 21:37:33.905: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:37:33.905: INFO: Container prometheus-operator ready: true, restart count 0 May 21 21:37:33.905: INFO: node-exporter-l5k2r started at 2021-05-21 20:07:54 +0000 UTC (0+2 container statuses recorded) May 21 21:37:33.905: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:37:33.905: INFO: Container node-exporter ready: true, restart count 0 May 21 21:37:33.905: INFO: pod-secrets-5286dcf7-bbee-4c29-9671-343e2fa6bad0 started at 2021-05-21 21:36:56 +0000 UTC (0+1 container statuses recorded) May 21 21:37:33.905: INFO: Container secret-env-test ready: false, restart count 0 May 21 21:37:33.905: INFO: nginx-proxy-node1 started at 2021-05-21 20:03:00 +0000 UTC (0+1 container statuses recorded) May 21 21:37:33.905: INFO: Container nginx-proxy ready: true, restart count 1 May 21 21:37:33.905: INFO: cmk-h8jxp started at 2021-05-21 20:07:00 +0000 UTC (0+2 container statuses recorded) May 21 21:37:33.905: INFO: Container nodereport ready: true, restart count 0 May 21 21:37:33.905: INFO: Container reconcile ready: true, restart count 0 May 21 21:37:33.905: INFO: prometheus-k8s-0 started at 2021-05-21 20:08:06 +0000 UTC (0+5 container statuses recorded) May 21 21:37:33.905: INFO: Container custom-metrics-apiserver ready: true, restart count 0 May 21 21:37:33.905: INFO: Container grafana ready: true, restart count 0 May 21 21:37:33.905: INFO: Container prometheus ready: true, restart count 1 May 21 21:37:33.905: INFO: Container prometheus-config-reloader ready: true, restart count 0 May 21 21:37:33.905: INFO: Container rules-configmap-reloader ready: true, restart count 0 May 21 21:37:33.905: INFO: kube-flannel-k6mr4 started at 2021-05-21 19:57:34 +0000 UTC (1+1 container statuses recorded) May 21 21:37:33.905: INFO: Init container install-cni ready: true, restart count 1 May 21 21:37:33.905: INFO: Container kube-flannel ready: true, restart count 1 May 21 21:37:33.905: INFO: liveness-a5f9f699-4122-4365-aff2-0c97e279f909 started at 2021-05-21 21:35:08 +0000 UTC (0+1 container statuses recorded) May 21 21:37:33.905: INFO: Container liveness ready: true, restart count 0 W0521 21:37:33.919554 25 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 21 21:37:34.238: INFO: Latency metrics for node node1 May 21 21:37:34.238: INFO: Logging node info for node node2 May 21 21:37:34.240: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 3f64ce47-e96b-43b8-9c91-df57a4e26826 34092 0 2021-05-21 19:56:58 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"4e:d8:e9:66:bc:b7"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-21 19:56:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-05-21 19:56:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-21 19:57:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-21 20:04:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-21 20:06:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-21 20:06:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269633024 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884632576 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-21 20:00:39 +0000 UTC,LastTransitionTime:2021-05-21 20:00:39 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-21 21:37:30 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-21 21:37:30 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-21 21:37:30 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-21 21:37:30 +0000 UTC,LastTransitionTime:2021-05-21 19:57:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:2aa9b8566664435b84c4146a11c874db,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:befe5c4e-169e-4c36-9e45-742bb80d4660,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:2b114e08442070e7232fcffc4cb89529bd5c9effe733ed690277a33772bf2d00 localhost:30500/barometer-collectd:stable],SizeBytes:1464382814,},ContainerImage{Names:[localhost:30500/cmk@sha256:1d865c665dfeeec5a879dca7b9945cc49f55f10921b4e729f0da0cdec7dedbf7 localhost:30500/cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:a4dc6d912ce1a8dd4c3a51b1cfb52454080ed36db95bf824895d5ecb7175199f localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392673,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:f013255695f4515c5b21b11281c7e0fb491082d15ec5a96adb8217e015a9c422 localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:50746f542c19fda01d88ae124ce58c5a326dad7cd24d3c2d19fdf959cc7f0c49 localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 21 21:37:34.241: INFO: Logging kubelet events for node node2 May 21 21:37:34.242: INFO: Logging pods the kubelet thinks is on node node2 May 21 21:37:34.255: INFO: termination-message-containerf07b56c9-8e08-4407-9cba-777cb45ca08a started at 2021-05-21 21:35:13 +0000 UTC (0+1 container statuses recorded) May 21 21:37:34.255: INFO: Container termination-message-container ready: false, restart count 0 May 21 21:37:34.255: INFO: termination-message-containerd3db3f0c-7f8e-4f60-b458-411cd464eb8b started at 2021-05-21 21:35:15 +0000 UTC (0+1 container statuses recorded) May 21 21:37:34.255: INFO: Container termination-message-container ready: false, restart count 0 May 21 21:37:34.255: INFO: foo-fbxdj started at 2021-05-21 21:30:30 +0000 UTC (0+1 container statuses recorded) May 21 21:37:34.255: INFO: Container c ready: false, restart count 0 May 21 21:37:34.255: INFO: var-expansion-5bc1be18-bfff-4578-8012-160b506bc70e started at 2021-05-21 21:35:33 +0000 UTC (0+1 container statuses recorded) May 21 21:37:34.255: INFO: Container dapi-container ready: false, restart count 0 May 21 21:37:34.255: INFO: kube-proxy-q57hf started at 2021-05-21 19:57:00 +0000 UTC (0+1 container statuses recorded) May 21 21:37:34.255: INFO: Container kube-proxy ready: true, restart count 2 May 21 21:37:34.255: INFO: node-feature-discovery-worker-28kx4 started at 2021-05-21 20:03:47 +0000 UTC (0+1 container statuses recorded) May 21 21:37:34.255: INFO: Container nfd-worker ready: true, restart count 0 May 21 21:37:34.255: INFO: cmk-j2nnh started at 2021-05-21 20:07:00 +0000 UTC (0+2 container statuses recorded) May 21 21:37:34.255: INFO: Container nodereport ready: true, restart count 0 May 21 21:37:34.255: INFO: Container reconcile ready: true, restart count 0 May 21 21:37:34.255: INFO: node-exporter-c46fg started at 2021-05-21 20:07:54 +0000 UTC (0+2 container statuses recorded) May 21 21:37:34.255: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:37:34.255: INFO: Container node-exporter ready: true, restart count 0 May 21 21:37:34.255: INFO: ss-0 started at 2021-05-21 21:33:14 +0000 UTC (0+1 container statuses recorded) May 21 21:37:34.255: INFO: Container webserver ready: false, restart count 0 May 21 21:37:34.255: INFO: foo-l9rbb started at 2021-05-21 21:30:30 +0000 UTC (0+1 container statuses recorded) May 21 21:37:34.255: INFO: Container c ready: false, restart count 0 May 21 21:37:34.255: INFO: kube-flannel-5p7gq started at 2021-05-21 19:57:34 +0000 UTC (1+1 container statuses recorded) May 21 21:37:34.255: INFO: Init container install-cni ready: true, restart count 2 May 21 21:37:34.255: INFO: Container kube-flannel ready: true, restart count 2 May 21 21:37:34.255: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-j7fm6 started at 2021-05-21 20:04:29 +0000 UTC (0+1 container statuses recorded) May 21 21:37:34.255: INFO: Container kube-sriovdp ready: true, restart count 0 May 21 21:37:34.255: INFO: kube-multus-ds-amd64-6q46t started at 2021-05-21 19:57:42 +0000 UTC (0+1 container statuses recorded) May 21 21:37:34.255: INFO: Container kube-multus ready: true, restart count 1 May 21 21:37:34.255: INFO: cmk-init-discover-node2-p7sdn started at 2021-05-21 20:06:37 +0000 UTC (0+3 container statuses recorded) May 21 21:37:34.255: INFO: Container discover ready: false, restart count 0 May 21 21:37:34.255: INFO: Container init ready: false, restart count 0 May 21 21:37:34.255: INFO: Container install ready: false, restart count 0 May 21 21:37:34.255: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-8kddc started at 2021-05-21 20:10:49 +0000 UTC (0+2 container statuses recorded) May 21 21:37:34.255: INFO: Container tas-controller ready: true, restart count 0 May 21 21:37:34.255: INFO: Container tas-extender ready: true, restart count 0 May 21 21:37:34.255: INFO: downward-api-1499468a-6e10-47f6-a735-09d7d997a784 started at 2021-05-21 21:33:48 +0000 UTC (0+1 container statuses recorded) May 21 21:37:34.255: INFO: Container dapi-container ready: false, restart count 0 May 21 21:37:34.255: INFO: nginx-proxy-node2 started at 2021-05-21 20:03:00 +0000 UTC (0+1 container statuses recorded) May 21 21:37:34.255: INFO: Container nginx-proxy ready: true, restart count 2 May 21 21:37:34.255: INFO: collectd-tz5h5 started at 2021-05-21 20:13:40 +0000 UTC (0+3 container statuses recorded) May 21 21:37:34.255: INFO: Container collectd ready: true, restart count 0 May 21 21:37:34.255: INFO: Container collectd-exporter ready: true, restart count 0 May 21 21:37:34.255: INFO: Container rbac-proxy ready: true, restart count 0 W0521 21:37:34.269208 25 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 21 21:37:34.299: INFO: Latency metrics for node node2 May 21 21:37:34.299: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "var-expansion-6967" for this suite. /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 May 21 21:42:39.949: Timed out after 300.000s. Expected <v1.PodPhase>: Pending to equal <v1.PodPhase>: Succeeded /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/runtime.go:154 [BeforeEach] [k8s.io] Container Runtime /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client May 21 21:37:39.916: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename container-runtime STEP: Waiting for a default service account to be provisioned in namespace [It] should report termination message [LinuxOnly] from file when pod succeeds and TerminationMessagePolicy FallbackToLogsOnError is set [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: create the container STEP: wait for the container to reach Succeeded May 21 21:42:39.949: FAIL: Timed out after 300.000s. Expected <v1.PodPhase>: Pending to equal <v1.PodPhase>: Succeeded Full Stack Trace k8s.io/kubernetes/test/e2e/common.glob..func25.1.2.1(0x4c5d8a0, 0x1d, 0xc000325ae0, 0x1e, 0xc0043a3580, 0x2, 0x2, 0xc004e81610, 0x1, 0x1, ...) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/runtime.go:154 +0x3f1 k8s.io/kubernetes/test/e2e/common.glob..func25.1.2.6() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/runtime.go:262 +0x1d2 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc001902480) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc001902480) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc001902480, 0x4de37a0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] Container Runtime /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "container-runtime-7756". STEP: Found 7 events. May 21 21:42:39.963: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for termination-message-containerd0db43ea-8ded-4393-94c1-c3a86267cd01: { } Scheduled: Successfully assigned container-runtime-7756/termination-message-containerd0db43ea-8ded-4393-94c1-c3a86267cd01 to node2 May 21 21:42:39.963: INFO: At 2021-05-21 21:37:41 +0000 UTC - event for termination-message-containerd0db43ea-8ded-4393-94c1-c3a86267cd01: {multus } AddedInterface: Add eth0 [10.244.4.189/24] May 21 21:42:39.963: INFO: At 2021-05-21 21:37:41 +0000 UTC - event for termination-message-containerd0db43ea-8ded-4393-94c1-c3a86267cd01: {kubelet node2} Pulling: Pulling image "docker.io/library/busybox:1.29" May 21 21:42:39.963: INFO: At 2021-05-21 21:37:42 +0000 UTC - event for termination-message-containerd0db43ea-8ded-4393-94c1-c3a86267cd01: {kubelet node2} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit May 21 21:42:39.963: INFO: At 2021-05-21 21:37:42 +0000 UTC - event for termination-message-containerd0db43ea-8ded-4393-94c1-c3a86267cd01: {kubelet node2} Failed: Error: ErrImagePull May 21 21:42:39.963: INFO: At 2021-05-21 21:37:42 +0000 UTC - event for termination-message-containerd0db43ea-8ded-4393-94c1-c3a86267cd01: {kubelet node2} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" May 21 21:42:39.963: INFO: At 2021-05-21 21:37:42 +0000 UTC - event for termination-message-containerd0db43ea-8ded-4393-94c1-c3a86267cd01: {kubelet node2} Failed: Error: ImagePullBackOff May 21 21:42:39.964: INFO: POD NODE PHASE GRACE CONDITIONS May 21 21:42:39.964: INFO: May 21 21:42:39.969: INFO: Logging node info for node master1 May 21 21:42:39.971: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 18cf10c1-c08b-4d36-bbe6-5aa86f02296e 39061 0 2021-05-21 19:55:07 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"d2:e0:bb:d8:54:80"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-21 19:55:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-21 19:55:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-21 19:57:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-21 19:57:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-05-21 20:04:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234763776 0} {<nil>} 196518324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324599808 0} {<nil>} 195629492Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-21 19:59:55 +0000 UTC,LastTransitionTime:2021-05-21 19:59:55 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-21 21:42:37 +0000 UTC,LastTransitionTime:2021-05-21 19:55:07 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-21 21:42:37 +0000 UTC,LastTransitionTime:2021-05-21 19:55:07 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-21 21:42:37 +0000 UTC,LastTransitionTime:2021-05-21 19:55:07 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-21 21:42:37 +0000 UTC,LastTransitionTime:2021-05-21 19:59:16 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0b916e2f445c4d05b6a9058a788d9410,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:ab86499b-409f-44c9-86ff-e9bc113e4112,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:f013255695f4515c5b21b11281c7e0fb491082d15ec5a96adb8217e015a9c422 tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:50746f542c19fda01d88ae124ce58c5a326dad7cd24d3c2d19fdf959cc7f0c49 tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 21 21:42:39.972: INFO: Logging kubelet events for node master1 May 21 21:42:39.974: INFO: Logging pods the kubelet thinks is on node master1 May 21 21:42:39.982: INFO: kube-proxy-zv2rb started at 2021-05-21 19:57:00 +0000 UTC (0+1 container statuses recorded) May 21 21:42:39.982: INFO: Container kube-proxy ready: true, restart count 2 May 21 21:42:39.982: INFO: kube-flannel-5lkd2 started at 2021-05-21 19:57:34 +0000 UTC (1+1 container statuses recorded) May 21 21:42:39.982: INFO: Init container install-cni ready: true, restart count 0 May 21 21:42:39.982: INFO: Container kube-flannel ready: true, restart count 2 May 21 21:42:39.983: INFO: node-exporter-m7jht started at 2021-05-21 20:07:54 +0000 UTC (0+2 container statuses recorded) May 21 21:42:39.983: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:42:39.983: INFO: Container node-exporter ready: true, restart count 0 May 21 21:42:39.983: INFO: kube-scheduler-master1 started at 2021-05-21 19:59:16 +0000 UTC (0+1 container statuses recorded) May 21 21:42:39.983: INFO: Container kube-scheduler ready: true, restart count 0 May 21 21:42:39.983: INFO: kube-apiserver-master1 started at 2021-05-21 20:03:10 +0000 UTC (0+1 container statuses recorded) May 21 21:42:39.983: INFO: Container kube-apiserver ready: true, restart count 0 May 21 21:42:39.983: INFO: kube-controller-manager-master1 started at 2021-05-21 19:59:16 +0000 UTC (0+1 container statuses recorded) May 21 21:42:39.983: INFO: Container kube-controller-manager ready: true, restart count 3 May 21 21:42:39.983: INFO: kube-multus-ds-amd64-z8khx started at 2021-05-21 19:57:42 +0000 UTC (0+1 container statuses recorded) May 21 21:42:39.983: INFO: Container kube-multus ready: true, restart count 1 May 21 21:42:39.983: INFO: docker-registry-docker-registry-56cbc7bc58-mft7s started at 2021-05-21 20:00:26 +0000 UTC (0+2 container statuses recorded) May 21 21:42:39.983: INFO: Container docker-registry ready: true, restart count 0 May 21 21:42:39.983: INFO: Container nginx ready: true, restart count 0 May 21 21:42:39.983: INFO: node-feature-discovery-controller-5bf5c49849-ktcdq started at 2021-05-21 20:03:57 +0000 UTC (0+1 container statuses recorded) May 21 21:42:39.983: INFO: Container nfd-controller ready: true, restart count 0 W0521 21:42:39.997221 25 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 21 21:42:40.027: INFO: Latency metrics for node master1 May 21 21:42:40.027: INFO: Logging node info for node master2 May 21 21:42:40.029: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 d439093b-ce44-47e7-8b41-5739b7c49ca5 39030 0 2021-05-21 19:55:46 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"62:5a:fb:0b:f8:b0"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-21 19:55:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-21 19:55:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-21 19:57:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-21 19:57:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234763776 0} {<nil>} 196518324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324599808 0} {<nil>} 195629492Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-21 20:00:49 +0000 UTC,LastTransitionTime:2021-05-21 20:00:49 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-21 21:42:30 +0000 UTC,LastTransitionTime:2021-05-21 19:55:46 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-21 21:42:30 +0000 UTC,LastTransitionTime:2021-05-21 19:55:46 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-21 21:42:30 +0000 UTC,LastTransitionTime:2021-05-21 19:55:46 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-21 21:42:30 +0000 UTC,LastTransitionTime:2021-05-21 19:57:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:495d1cf47bdb4c7e982c636c95de5648,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:cca785c0-d61e-403e-91fd-d0d4f3fa573c,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 21 21:42:40.030: INFO: Logging kubelet events for node master2 May 21 21:42:40.032: INFO: Logging pods the kubelet thinks is on node master2 May 21 21:42:40.042: INFO: dns-autoscaler-5b7b5c9b6f-dvlvw started at 2021-05-21 19:58:05 +0000 UTC (0+1 container statuses recorded) May 21 21:42:40.042: INFO: Container autoscaler ready: true, restart count 2 May 21 21:42:40.042: INFO: node-exporter-q52l5 started at 2021-05-21 20:07:54 +0000 UTC (0+2 container statuses recorded) May 21 21:42:40.042: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:42:40.042: INFO: Container node-exporter ready: true, restart count 0 May 21 21:42:40.042: INFO: kube-controller-manager-master2 started at 2021-05-21 19:59:58 +0000 UTC (0+1 container statuses recorded) May 21 21:42:40.042: INFO: Container kube-controller-manager ready: true, restart count 2 May 21 21:42:40.042: INFO: kube-scheduler-master2 started at 2021-05-21 20:00:08 +0000 UTC (0+1 container statuses recorded) May 21 21:42:40.042: INFO: Container kube-scheduler ready: true, restart count 2 May 21 21:42:40.042: INFO: kube-proxy-shdjd started at 2021-05-21 19:57:00 +0000 UTC (0+1 container statuses recorded) May 21 21:42:40.042: INFO: Container kube-proxy ready: true, restart count 1 May 21 21:42:40.042: INFO: kube-flannel-tnf5x started at 2021-05-21 19:57:34 +0000 UTC (1+1 container statuses recorded) May 21 21:42:40.042: INFO: Init container install-cni ready: true, restart count 0 May 21 21:42:40.042: INFO: Container kube-flannel ready: true, restart count 1 May 21 21:42:40.042: INFO: kube-multus-ds-amd64-lwzkr started at 2021-05-21 19:57:42 +0000 UTC (0+1 container statuses recorded) May 21 21:42:40.042: INFO: Container kube-multus ready: true, restart count 1 May 21 21:42:40.042: INFO: kube-apiserver-master2 started at 2021-05-21 20:03:00 +0000 UTC (0+1 container statuses recorded) May 21 21:42:40.042: INFO: Container kube-apiserver ready: true, restart count 0 May 21 21:42:40.042: INFO: coredns-7677f9bb54-lv5gk started at 2021-05-21 19:58:07 +0000 UTC (0+1 container statuses recorded) May 21 21:42:40.042: INFO: Container coredns ready: true, restart count 1 W0521 21:42:40.056260 25 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 21 21:42:40.086: INFO: Latency metrics for node master2 May 21 21:42:40.086: INFO: Logging node info for node master3 May 21 21:42:40.088: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 23066049-f3f1-42a7-9cea-19e20ed4ccec 39062 0 2021-05-21 19:55:56 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:a6:e4:e7:ba:02"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-21 19:55:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-21 19:55:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-21 19:57:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-21 19:57:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234767872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324603904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-21 20:00:41 +0000 UTC,LastTransitionTime:2021-05-21 20:00:41 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-21 21:42:37 +0000 UTC,LastTransitionTime:2021-05-21 19:55:56 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-21 21:42:37 +0000 UTC,LastTransitionTime:2021-05-21 19:55:56 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-21 21:42:37 +0000 UTC,LastTransitionTime:2021-05-21 19:55:56 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-21 21:42:37 +0000 UTC,LastTransitionTime:2021-05-21 19:57:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:660844f5cb0944868621042562b928e3,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:02066ff3-4833-4130-ba94-138c581e4cc0,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 21 21:42:40.089: INFO: Logging kubelet events for node master3 May 21 21:42:40.091: INFO: Logging pods the kubelet thinks is on node master3 May 21 21:42:40.100: INFO: coredns-7677f9bb54-gjt42 started at 2021-05-21 19:58:03 +0000 UTC (0+1 container statuses recorded) May 21 21:42:40.100: INFO: Container coredns ready: true, restart count 1 May 21 21:42:40.100: INFO: node-exporter-s74rx started at 2021-05-21 20:07:54 +0000 UTC (0+2 container statuses recorded) May 21 21:42:40.100: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:42:40.100: INFO: Container node-exporter ready: true, restart count 0 May 21 21:42:40.100: INFO: kube-controller-manager-master3 started at 2021-05-21 20:03:00 +0000 UTC (0+1 container statuses recorded) May 21 21:42:40.100: INFO: Container kube-controller-manager ready: true, restart count 1 May 21 21:42:40.100: INFO: kube-scheduler-master3 started at 2021-05-21 20:03:10 +0000 UTC (0+1 container statuses recorded) May 21 21:42:40.100: INFO: Container kube-scheduler ready: true, restart count 1 May 21 21:42:40.100: INFO: kube-apiserver-master3 started at 2021-05-21 20:03:20 +0000 UTC (0+1 container statuses recorded) May 21 21:42:40.100: INFO: Container kube-apiserver ready: true, restart count 0 May 21 21:42:40.100: INFO: kube-proxy-hwwxt started at 2021-05-21 19:57:00 +0000 UTC (0+1 container statuses recorded) May 21 21:42:40.100: INFO: Container kube-proxy ready: true, restart count 2 May 21 21:42:40.100: INFO: kube-flannel-8sd6n started at 2021-05-21 19:57:34 +0000 UTC (1+1 container statuses recorded) May 21 21:42:40.100: INFO: Init container install-cni ready: true, restart count 0 May 21 21:42:40.100: INFO: Container kube-flannel ready: true, restart count 1 May 21 21:42:40.100: INFO: kube-multus-ds-amd64-zgdbl started at 2021-05-21 19:57:42 +0000 UTC (0+1 container statuses recorded) May 21 21:42:40.100: INFO: Container kube-multus ready: true, restart count 1 W0521 21:42:40.113893 25 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 21 21:42:40.138: INFO: Latency metrics for node master3 May 21 21:42:40.138: INFO: Logging node info for node node1 May 21 21:42:40.141: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 62cfecb3-af08-42a4-ab85-25a317061b61 39049 0 2021-05-21 19:56:58 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"22:2e:2b:06:83:4a"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-21 19:56:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-05-21 19:56:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-21 19:57:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-21 20:04:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-21 20:06:20 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-21 20:06:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269628928 0} {<nil>} 196552372Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884628480 0} {<nil>} 174692020Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-21 20:00:36 +0000 UTC,LastTransitionTime:2021-05-21 20:00:36 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-21 21:42:33 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-21 21:42:33 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-21 21:42:33 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-21 21:42:33 +0000 UTC,LastTransitionTime:2021-05-21 19:57:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:94b7bb79c41d4a0492f63fb5fb3c5cc0,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:1e94d819-8d68-4948-b171-5fd2d8fc7ff5,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:2b114e08442070e7232fcffc4cb89529bd5c9effe733ed690277a33772bf2d00 localhost:30500/barometer-collectd:stable],SizeBytes:1464382814,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:1002487865,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:ed5c574f653e2a39e784ff322033a2319aafde7366c803a88f20f7a2a8bc1efb opnfv/barometer-collectd:stable],SizeBytes:825413035,},ContainerImage{Names:[localhost:30500/cmk@sha256:1d865c665dfeeec5a879dca7b9945cc49f55f10921b4e729f0da0cdec7dedbf7 cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[golang@sha256:1636899c10870ab66c48d960a9df620f4f9e86a0c72fbacf36032d27404e7e6c golang:alpine3.12],SizeBytes:301156062,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:a4dc6d912ce1a8dd4c3a51b1cfb52454080ed36db95bf824895d5ecb7175199f nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392673,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:36553b10a4947067b9fbb7d532951066293a68eae893beba1d9235f7d11a20ad alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 21 21:42:40.141: INFO: Logging kubelet events for node node1 May 21 21:42:40.143: INFO: Logging pods the kubelet thinks is on node node1 May 21 21:42:40.159: INFO: kube-flannel-k6mr4 started at 2021-05-21 19:57:34 +0000 UTC (1+1 container statuses recorded) May 21 21:42:40.160: INFO: Init container install-cni ready: true, restart count 1 May 21 21:42:40.160: INFO: Container kube-flannel ready: true, restart count 1 May 21 21:42:40.160: INFO: var-expansion-4e42a31b-7838-4412-9bf2-9fcf678babe3 started at 2021-05-21 21:37:47 +0000 UTC (0+1 container statuses recorded) May 21 21:42:40.160: INFO: Container dapi-container ready: false, restart count 0 May 21 21:42:40.160: INFO: cmk-webhook-6c9d5f8578-8pz6w started at 2021-05-21 20:07:00 +0000 UTC (0+1 container statuses recorded) May 21 21:42:40.160: INFO: Container cmk-webhook ready: true, restart count 0 May 21 21:42:40.160: INFO: collectd-mc5kl started at 2021-05-21 20:13:40 +0000 UTC (0+3 container statuses recorded) May 21 21:42:40.160: INFO: Container collectd ready: true, restart count 0 May 21 21:42:40.160: INFO: Container collectd-exporter ready: true, restart count 0 May 21 21:42:40.160: INFO: Container rbac-proxy ready: true, restart count 0 May 21 21:42:40.160: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-czhnm started at 2021-05-21 20:04:29 +0000 UTC (0+1 container statuses recorded) May 21 21:42:40.160: INFO: Container kube-sriovdp ready: true, restart count 0 May 21 21:42:40.160: INFO: kube-proxy-h5k9s started at 2021-05-21 19:57:00 +0000 UTC (0+1 container statuses recorded) May 21 21:42:40.160: INFO: Container kube-proxy ready: true, restart count 1 May 21 21:42:40.160: INFO: cmk-init-discover-node1-48g7j started at 2021-05-21 20:06:17 +0000 UTC (0+3 container statuses recorded) May 21 21:42:40.160: INFO: Container discover ready: false, restart count 0 May 21 21:42:40.160: INFO: Container init ready: false, restart count 0 May 21 21:42:40.160: INFO: Container install ready: false, restart count 0 May 21 21:42:40.160: INFO: pod-init-3a218723-a89e-4381-82d5-b9684848a992 started at 2021-05-21 21:42:03 +0000 UTC (2+1 container statuses recorded) May 21 21:42:40.160: INFO: Init container init1 ready: false, restart count 0 May 21 21:42:40.160: INFO: Init container init2 ready: false, restart count 0 May 21 21:42:40.160: INFO: Container run1 ready: false, restart count 0 May 21 21:42:40.160: INFO: kubernetes-dashboard-86c6f9df5b-8rsws started at 2021-05-21 19:58:07 +0000 UTC (0+1 container statuses recorded) May 21 21:42:40.160: INFO: Container kubernetes-dashboard ready: true, restart count 1 May 21 21:42:40.160: INFO: node-feature-discovery-worker-lh5hz started at 2021-05-21 20:03:47 +0000 UTC (0+1 container statuses recorded) May 21 21:42:40.160: INFO: Container nfd-worker ready: true, restart count 0 May 21 21:42:40.160: INFO: busybox-host-aliases44a891b1-46fb-41d0-8db8-b1e1a24c66ef started at 2021-05-21 21:42:01 +0000 UTC (0+1 container statuses recorded) May 21 21:42:40.160: INFO: Container busybox-host-aliases44a891b1-46fb-41d0-8db8-b1e1a24c66ef ready: false, restart count 0 May 21 21:42:40.160: INFO: node-exporter-l5k2r started at 2021-05-21 20:07:54 +0000 UTC (0+2 container statuses recorded) May 21 21:42:40.160: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:42:40.160: INFO: Container node-exporter ready: true, restart count 0 May 21 21:42:40.160: INFO: kube-multus-ds-amd64-wlmhr started at 2021-05-21 19:57:42 +0000 UTC (0+1 container statuses recorded) May 21 21:42:40.160: INFO: Container kube-multus ready: true, restart count 1 May 21 21:42:40.160: INFO: kubernetes-metrics-scraper-678c97765c-nnrtl started at 2021-05-21 19:58:07 +0000 UTC (0+1 container statuses recorded) May 21 21:42:40.160: INFO: Container kubernetes-metrics-scraper ready: true, restart count 2 May 21 21:42:40.160: INFO: prometheus-operator-5bb8cb9d8f-mzlrf started at 2021-05-21 20:07:47 +0000 UTC (0+2 container statuses recorded) May 21 21:42:40.160: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:42:40.160: INFO: Container prometheus-operator ready: true, restart count 0 May 21 21:42:40.160: INFO: nginx-proxy-node1 started at 2021-05-21 20:03:00 +0000 UTC (0+1 container statuses recorded) May 21 21:42:40.160: INFO: Container nginx-proxy ready: true, restart count 1 May 21 21:42:40.160: INFO: cmk-h8jxp started at 2021-05-21 20:07:00 +0000 UTC (0+2 container statuses recorded) May 21 21:42:40.160: INFO: Container nodereport ready: true, restart count 0 May 21 21:42:40.160: INFO: Container reconcile ready: true, restart count 0 May 21 21:42:40.160: INFO: prometheus-k8s-0 started at 2021-05-21 20:08:06 +0000 UTC (0+5 container statuses recorded) May 21 21:42:40.160: INFO: Container custom-metrics-apiserver ready: true, restart count 0 May 21 21:42:40.160: INFO: Container grafana ready: true, restart count 0 May 21 21:42:40.160: INFO: Container prometheus ready: true, restart count 1 May 21 21:42:40.160: INFO: Container prometheus-config-reloader ready: true, restart count 0 May 21 21:42:40.160: INFO: Container rules-configmap-reloader ready: true, restart count 0 W0521 21:42:40.174435 25 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 21 21:42:40.208: INFO: Latency metrics for node node1 May 21 21:42:40.208: INFO: Logging node info for node node2 May 21 21:42:40.211: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 3f64ce47-e96b-43b8-9c91-df57a4e26826 39037 0 2021-05-21 19:56:58 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"4e:d8:e9:66:bc:b7"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-21 19:56:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-05-21 19:56:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-21 19:57:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-21 20:04:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-21 20:06:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-21 20:06:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269633024 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884632576 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-21 20:00:39 +0000 UTC,LastTransitionTime:2021-05-21 20:00:39 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-21 21:42:31 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-21 21:42:31 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-21 21:42:31 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-21 21:42:31 +0000 UTC,LastTransitionTime:2021-05-21 19:57:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:2aa9b8566664435b84c4146a11c874db,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:befe5c4e-169e-4c36-9e45-742bb80d4660,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:2b114e08442070e7232fcffc4cb89529bd5c9effe733ed690277a33772bf2d00 localhost:30500/barometer-collectd:stable],SizeBytes:1464382814,},ContainerImage{Names:[localhost:30500/cmk@sha256:1d865c665dfeeec5a879dca7b9945cc49f55f10921b4e729f0da0cdec7dedbf7 localhost:30500/cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:a4dc6d912ce1a8dd4c3a51b1cfb52454080ed36db95bf824895d5ecb7175199f localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392673,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:f013255695f4515c5b21b11281c7e0fb491082d15ec5a96adb8217e015a9c422 localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:50746f542c19fda01d88ae124ce58c5a326dad7cd24d3c2d19fdf959cc7f0c49 localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 21 21:42:40.211: INFO: Logging kubelet events for node node2 May 21 21:42:40.214: INFO: Logging pods the kubelet thinks is on node node2 May 21 21:42:40.277: INFO: var-expansion-8d8840bf-39cb-4cb0-8c1d-94df2b953cd7 started at 2021-05-21 21:41:35 +0000 UTC (0+1 container statuses recorded) May 21 21:42:40.277: INFO: Container dapi-container ready: false, restart count 0 May 21 21:42:40.277: INFO: test-rollover-controller-9qcsx started at 2021-05-21 21:39:13 +0000 UTC (0+1 container statuses recorded) May 21 21:42:40.277: INFO: Container httpd ready: false, restart count 0 May 21 21:42:40.277: INFO: kube-flannel-5p7gq started at 2021-05-21 19:57:34 +0000 UTC (1+1 container statuses recorded) May 21 21:42:40.277: INFO: Init container install-cni ready: true, restart count 2 May 21 21:42:40.277: INFO: Container kube-flannel ready: true, restart count 2 May 21 21:42:40.277: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-j7fm6 started at 2021-05-21 20:04:29 +0000 UTC (0+1 container statuses recorded) May 21 21:42:40.277: INFO: Container kube-sriovdp ready: true, restart count 0 May 21 21:42:40.277: INFO: kube-multus-ds-amd64-6q46t started at 2021-05-21 19:57:42 +0000 UTC (0+1 container statuses recorded) May 21 21:42:40.277: INFO: Container kube-multus ready: true, restart count 1 May 21 21:42:40.277: INFO: cmk-init-discover-node2-p7sdn started at 2021-05-21 20:06:37 +0000 UTC (0+3 container statuses recorded) May 21 21:42:40.277: INFO: Container discover ready: false, restart count 0 May 21 21:42:40.277: INFO: Container init ready: false, restart count 0 May 21 21:42:40.277: INFO: Container install ready: false, restart count 0 May 21 21:42:40.277: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-8kddc started at 2021-05-21 20:10:49 +0000 UTC (0+2 container statuses recorded) May 21 21:42:40.277: INFO: Container tas-controller ready: true, restart count 0 May 21 21:42:40.277: INFO: Container tas-extender ready: true, restart count 0 May 21 21:42:40.277: INFO: nginx-proxy-node2 started at 2021-05-21 20:03:00 +0000 UTC (0+1 container statuses recorded) May 21 21:42:40.277: INFO: Container nginx-proxy ready: true, restart count 2 May 21 21:42:40.277: INFO: pod-configmaps-a27f114b-52c7-4acf-8a4e-1166bc040dea started at 2021-05-21 21:40:16 +0000 UTC (0+1 container statuses recorded) May 21 21:42:40.277: INFO: Container env-test ready: false, restart count 0 May 21 21:42:40.277: INFO: collectd-tz5h5 started at 2021-05-21 20:13:40 +0000 UTC (0+3 container statuses recorded) May 21 21:42:40.277: INFO: Container collectd ready: true, restart count 0 May 21 21:42:40.277: INFO: Container collectd-exporter ready: true, restart count 0 May 21 21:42:40.277: INFO: Container rbac-proxy ready: true, restart count 0 May 21 21:42:40.277: INFO: adopt-release-xf7hc started at 2021-05-21 21:41:11 +0000 UTC (0+1 container statuses recorded) May 21 21:42:40.277: INFO: Container c ready: false, restart count 0 May 21 21:42:40.277: INFO: foo-fbxdj started at 2021-05-21 21:30:30 +0000 UTC (0+1 container statuses recorded) May 21 21:42:40.277: INFO: Container c ready: false, restart count 0 May 21 21:42:40.277: INFO: node-exporter-c46fg started at 2021-05-21 20:07:54 +0000 UTC (0+2 container statuses recorded) May 21 21:42:40.277: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:42:40.277: INFO: Container node-exporter ready: true, restart count 0 May 21 21:42:40.277: INFO: kube-proxy-q57hf started at 2021-05-21 19:57:00 +0000 UTC (0+1 container statuses recorded) May 21 21:42:40.277: INFO: Container kube-proxy ready: true, restart count 2 May 21 21:42:40.277: INFO: node-feature-discovery-worker-28kx4 started at 2021-05-21 20:03:47 +0000 UTC (0+1 container statuses recorded) May 21 21:42:40.277: INFO: Container nfd-worker ready: true, restart count 0 May 21 21:42:40.277: INFO: cmk-j2nnh started at 2021-05-21 20:07:00 +0000 UTC (0+2 container statuses recorded) May 21 21:42:40.277: INFO: Container nodereport ready: true, restart count 0 May 21 21:42:40.277: INFO: Container reconcile ready: true, restart count 0 May 21 21:42:40.278: INFO: ss-0 started at 2021-05-21 21:33:14 +0000 UTC (0+1 container statuses recorded) May 21 21:42:40.278: INFO: Container webserver ready: false, restart count 0 May 21 21:42:40.278: INFO: foo-l9rbb started at 2021-05-21 21:30:30 +0000 UTC (0+1 container statuses recorded) May 21 21:42:40.278: INFO: Container c ready: false, restart count 0 May 21 21:42:40.278: INFO: adopt-release-n9wdj started at 2021-05-21 21:41:11 +0000 UTC (0+1 container statuses recorded) May 21 21:42:40.278: INFO: Container c ready: false, restart count 0 W0521 21:42:40.290308 25 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 21 21:42:40.322: INFO: Latency metrics for node node2 May 21 21:42:40.322: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "container-runtime-7756" for this suite. /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 May 21 21:47:54.878: Unexpected error: <*errors.errorString | 0xc0002c4200>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:103 [BeforeEach] [sig-storage] EmptyDir volumes /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client May 21 21:42:54.838: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename emptydir STEP: Waiting for a default service account to be provisioned in namespace [It] pod should support shared volumes between containers [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 STEP: Creating Pod May 21 21:47:54.878: FAIL: Unexpected error: <*errors.errorString | 0xc0002c4200>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*PodClient).CreateSync(0xc003c51bc0, 0xc00192cc00, 0x0) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:103 +0xfe k8s.io/kubernetes/test/e2e/common.glob..func8.16() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/empty_dir.go:283 +0xa58 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc001902480) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc001902480) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc001902480, 0x4de37a0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [sig-storage] EmptyDir volumes /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "emptydir-3167". STEP: Found 9 events. May 21 21:47:54.883: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for pod-sharedvolume-ba00bf9b-616b-4a0f-bc91-6eb37a4b1973: { } Scheduled: Successfully assigned emptydir-3167/pod-sharedvolume-ba00bf9b-616b-4a0f-bc91-6eb37a4b1973 to node2 May 21 21:47:54.883: INFO: At 2021-05-21 21:42:56 +0000 UTC - event for pod-sharedvolume-ba00bf9b-616b-4a0f-bc91-6eb37a4b1973: {multus } AddedInterface: Add eth0 [10.244.4.223/24] May 21 21:47:54.883: INFO: At 2021-05-21 21:42:56 +0000 UTC - event for pod-sharedvolume-ba00bf9b-616b-4a0f-bc91-6eb37a4b1973: {kubelet node2} Pulling: Pulling image "docker.io/library/busybox:1.29" May 21 21:47:54.883: INFO: At 2021-05-21 21:42:57 +0000 UTC - event for pod-sharedvolume-ba00bf9b-616b-4a0f-bc91-6eb37a4b1973: {kubelet node2} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit May 21 21:47:54.883: INFO: At 2021-05-21 21:42:57 +0000 UTC - event for pod-sharedvolume-ba00bf9b-616b-4a0f-bc91-6eb37a4b1973: {kubelet node2} Failed: Error: ErrImagePull May 21 21:47:54.883: INFO: At 2021-05-21 21:42:57 +0000 UTC - event for pod-sharedvolume-ba00bf9b-616b-4a0f-bc91-6eb37a4b1973: {kubelet node2} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" May 21 21:47:54.883: INFO: At 2021-05-21 21:42:57 +0000 UTC - event for pod-sharedvolume-ba00bf9b-616b-4a0f-bc91-6eb37a4b1973: {kubelet node2} Failed: Error: ImagePullBackOff May 21 21:47:54.883: INFO: At 2021-05-21 21:42:58 +0000 UTC - event for pod-sharedvolume-ba00bf9b-616b-4a0f-bc91-6eb37a4b1973: {kubelet node2} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" May 21 21:47:54.883: INFO: At 2021-05-21 21:42:58 +0000 UTC - event for pod-sharedvolume-ba00bf9b-616b-4a0f-bc91-6eb37a4b1973: {kubelet node2} Failed: Error: ImagePullBackOff May 21 21:47:54.885: INFO: POD NODE PHASE GRACE CONDITIONS May 21 21:47:54.885: INFO: pod-sharedvolume-ba00bf9b-616b-4a0f-bc91-6eb37a4b1973 node2 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-05-21 21:42:54 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-05-21 21:42:54 +0000 UTC ContainersNotReady containers with unready status: [busybox-main-container busybox-sub-container]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-05-21 21:42:54 +0000 UTC ContainersNotReady containers with unready status: [busybox-main-container busybox-sub-container]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-05-21 21:42:54 +0000 UTC }] May 21 21:47:54.885: INFO: May 21 21:47:54.890: INFO: Logging node info for node master1 May 21 21:47:54.892: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 18cf10c1-c08b-4d36-bbe6-5aa86f02296e 41804 0 2021-05-21 19:55:07 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"d2:e0:bb:d8:54:80"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-21 19:55:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-21 19:55:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-21 19:57:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-21 19:57:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-05-21 20:04:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234763776 0} {<nil>} 196518324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324599808 0} {<nil>} 195629492Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-21 19:59:55 +0000 UTC,LastTransitionTime:2021-05-21 19:59:55 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-21 21:47:48 +0000 UTC,LastTransitionTime:2021-05-21 19:55:07 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-21 21:47:48 +0000 UTC,LastTransitionTime:2021-05-21 19:55:07 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-21 21:47:48 +0000 UTC,LastTransitionTime:2021-05-21 19:55:07 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-21 21:47:48 +0000 UTC,LastTransitionTime:2021-05-21 19:59:16 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0b916e2f445c4d05b6a9058a788d9410,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:ab86499b-409f-44c9-86ff-e9bc113e4112,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:f013255695f4515c5b21b11281c7e0fb491082d15ec5a96adb8217e015a9c422 tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:50746f542c19fda01d88ae124ce58c5a326dad7cd24d3c2d19fdf959cc7f0c49 tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 21 21:47:54.893: INFO: Logging kubelet events for node master1 May 21 21:47:54.896: INFO: Logging pods the kubelet thinks is on node master1 May 21 21:47:54.904: INFO: kube-proxy-zv2rb started at 2021-05-21 19:57:00 +0000 UTC (0+1 container statuses recorded) May 21 21:47:54.904: INFO: Container kube-proxy ready: true, restart count 2 May 21 21:47:54.904: INFO: kube-flannel-5lkd2 started at 2021-05-21 19:57:34 +0000 UTC (1+1 container statuses recorded) May 21 21:47:54.904: INFO: Init container install-cni ready: true, restart count 0 May 21 21:47:54.904: INFO: Container kube-flannel ready: true, restart count 2 May 21 21:47:54.904: INFO: kube-scheduler-master1 started at 2021-05-21 19:59:16 +0000 UTC (0+1 container statuses recorded) May 21 21:47:54.904: INFO: Container kube-scheduler ready: true, restart count 0 May 21 21:47:54.905: INFO: kube-apiserver-master1 started at 2021-05-21 20:03:10 +0000 UTC (0+1 container statuses recorded) May 21 21:47:54.905: INFO: Container kube-apiserver ready: true, restart count 0 May 21 21:47:54.905: INFO: kube-controller-manager-master1 started at 2021-05-21 19:59:16 +0000 UTC (0+1 container statuses recorded) May 21 21:47:54.905: INFO: Container kube-controller-manager ready: true, restart count 3 May 21 21:47:54.905: INFO: kube-multus-ds-amd64-z8khx started at 2021-05-21 19:57:42 +0000 UTC (0+1 container statuses recorded) May 21 21:47:54.905: INFO: Container kube-multus ready: true, restart count 1 May 21 21:47:54.905: INFO: docker-registry-docker-registry-56cbc7bc58-mft7s started at 2021-05-21 20:00:26 +0000 UTC (0+2 container statuses recorded) May 21 21:47:54.905: INFO: Container docker-registry ready: true, restart count 0 May 21 21:47:54.905: INFO: Container nginx ready: true, restart count 0 May 21 21:47:54.905: INFO: node-feature-discovery-controller-5bf5c49849-ktcdq started at 2021-05-21 20:03:57 +0000 UTC (0+1 container statuses recorded) May 21 21:47:54.905: INFO: Container nfd-controller ready: true, restart count 0 May 21 21:47:54.905: INFO: node-exporter-m7jht started at 2021-05-21 20:07:54 +0000 UTC (0+2 container statuses recorded) May 21 21:47:54.905: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:47:54.905: INFO: Container node-exporter ready: true, restart count 0 W0521 21:47:54.916106 25 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 21 21:47:54.946: INFO: Latency metrics for node master1 May 21 21:47:54.946: INFO: Logging node info for node master2 May 21 21:47:54.949: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 d439093b-ce44-47e7-8b41-5739b7c49ca5 41827 0 2021-05-21 19:55:46 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"62:5a:fb:0b:f8:b0"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-21 19:55:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-21 19:55:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-21 19:57:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-21 19:57:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234763776 0} {<nil>} 196518324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324599808 0} {<nil>} 195629492Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-21 20:00:49 +0000 UTC,LastTransitionTime:2021-05-21 20:00:49 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-21 21:47:51 +0000 UTC,LastTransitionTime:2021-05-21 19:55:46 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-21 21:47:51 +0000 UTC,LastTransitionTime:2021-05-21 19:55:46 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-21 21:47:51 +0000 UTC,LastTransitionTime:2021-05-21 19:55:46 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-21 21:47:51 +0000 UTC,LastTransitionTime:2021-05-21 19:57:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:495d1cf47bdb4c7e982c636c95de5648,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:cca785c0-d61e-403e-91fd-d0d4f3fa573c,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 21 21:47:54.950: INFO: Logging kubelet events for node master2 May 21 21:47:54.951: INFO: Logging pods the kubelet thinks is on node master2 May 21 21:47:54.961: INFO: kube-apiserver-master2 started at 2021-05-21 20:03:00 +0000 UTC (0+1 container statuses recorded) May 21 21:47:54.961: INFO: Container kube-apiserver ready: true, restart count 0 May 21 21:47:54.961: INFO: coredns-7677f9bb54-lv5gk started at 2021-05-21 19:58:07 +0000 UTC (0+1 container statuses recorded) May 21 21:47:54.961: INFO: Container coredns ready: true, restart count 1 May 21 21:47:54.961: INFO: node-exporter-q52l5 started at 2021-05-21 20:07:54 +0000 UTC (0+2 container statuses recorded) May 21 21:47:54.961: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:47:54.961: INFO: Container node-exporter ready: true, restart count 0 May 21 21:47:54.961: INFO: kube-controller-manager-master2 started at 2021-05-21 19:59:58 +0000 UTC (0+1 container statuses recorded) May 21 21:47:54.961: INFO: Container kube-controller-manager ready: true, restart count 2 May 21 21:47:54.961: INFO: kube-scheduler-master2 started at 2021-05-21 20:00:08 +0000 UTC (0+1 container statuses recorded) May 21 21:47:54.961: INFO: Container kube-scheduler ready: true, restart count 2 May 21 21:47:54.961: INFO: kube-proxy-shdjd started at 2021-05-21 19:57:00 +0000 UTC (0+1 container statuses recorded) May 21 21:47:54.961: INFO: Container kube-proxy ready: true, restart count 1 May 21 21:47:54.961: INFO: kube-flannel-tnf5x started at 2021-05-21 19:57:34 +0000 UTC (1+1 container statuses recorded) May 21 21:47:54.961: INFO: Init container install-cni ready: true, restart count 0 May 21 21:47:54.961: INFO: Container kube-flannel ready: true, restart count 1 May 21 21:47:54.961: INFO: kube-multus-ds-amd64-lwzkr started at 2021-05-21 19:57:42 +0000 UTC (0+1 container statuses recorded) May 21 21:47:54.961: INFO: Container kube-multus ready: true, restart count 1 May 21 21:47:54.961: INFO: dns-autoscaler-5b7b5c9b6f-dvlvw started at 2021-05-21 19:58:05 +0000 UTC (0+1 container statuses recorded) May 21 21:47:54.961: INFO: Container autoscaler ready: true, restart count 2 W0521 21:47:54.974040 25 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 21 21:47:55.002: INFO: Latency metrics for node master2 May 21 21:47:55.002: INFO: Logging node info for node master3 May 21 21:47:55.005: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 23066049-f3f1-42a7-9cea-19e20ed4ccec 41802 0 2021-05-21 19:55:56 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:a6:e4:e7:ba:02"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-21 19:55:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-21 19:55:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-21 19:57:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-21 19:57:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234767872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324603904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-21 20:00:41 +0000 UTC,LastTransitionTime:2021-05-21 20:00:41 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-21 21:47:48 +0000 UTC,LastTransitionTime:2021-05-21 19:55:56 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-21 21:47:48 +0000 UTC,LastTransitionTime:2021-05-21 19:55:56 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-21 21:47:48 +0000 UTC,LastTransitionTime:2021-05-21 19:55:56 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-21 21:47:48 +0000 UTC,LastTransitionTime:2021-05-21 19:57:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:660844f5cb0944868621042562b928e3,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:02066ff3-4833-4130-ba94-138c581e4cc0,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 21 21:47:55.006: INFO: Logging kubelet events for node master3 May 21 21:47:55.008: INFO: Logging pods the kubelet thinks is on node master3 May 21 21:47:55.017: INFO: kube-apiserver-master3 started at 2021-05-21 20:03:20 +0000 UTC (0+1 container statuses recorded) May 21 21:47:55.017: INFO: Container kube-apiserver ready: true, restart count 0 May 21 21:47:55.017: INFO: kube-proxy-hwwxt started at 2021-05-21 19:57:00 +0000 UTC (0+1 container statuses recorded) May 21 21:47:55.017: INFO: Container kube-proxy ready: true, restart count 2 May 21 21:47:55.017: INFO: kube-flannel-8sd6n started at 2021-05-21 19:57:34 +0000 UTC (1+1 container statuses recorded) May 21 21:47:55.017: INFO: Init container install-cni ready: true, restart count 0 May 21 21:47:55.017: INFO: Container kube-flannel ready: true, restart count 1 May 21 21:47:55.017: INFO: kube-multus-ds-amd64-zgdbl started at 2021-05-21 19:57:42 +0000 UTC (0+1 container statuses recorded) May 21 21:47:55.017: INFO: Container kube-multus ready: true, restart count 1 May 21 21:47:55.017: INFO: coredns-7677f9bb54-gjt42 started at 2021-05-21 19:58:03 +0000 UTC (0+1 container statuses recorded) May 21 21:47:55.017: INFO: Container coredns ready: true, restart count 1 May 21 21:47:55.017: INFO: node-exporter-s74rx started at 2021-05-21 20:07:54 +0000 UTC (0+2 container statuses recorded) May 21 21:47:55.017: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:47:55.017: INFO: Container node-exporter ready: true, restart count 0 May 21 21:47:55.017: INFO: kube-controller-manager-master3 started at 2021-05-21 20:03:00 +0000 UTC (0+1 container statuses recorded) May 21 21:47:55.017: INFO: Container kube-controller-manager ready: true, restart count 1 May 21 21:47:55.017: INFO: kube-scheduler-master3 started at 2021-05-21 20:03:10 +0000 UTC (0+1 container statuses recorded) May 21 21:47:55.017: INFO: Container kube-scheduler ready: true, restart count 1 W0521 21:47:55.030220 25 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 21 21:47:55.056: INFO: Latency metrics for node master3 May 21 21:47:55.056: INFO: Logging node info for node node1 May 21 21:47:55.060: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 62cfecb3-af08-42a4-ab85-25a317061b61 41792 0 2021-05-21 19:56:58 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"22:2e:2b:06:83:4a"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-21 19:56:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-05-21 19:56:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-21 19:57:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-21 20:04:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-21 20:06:20 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-21 20:06:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269628928 0} {<nil>} 196552372Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884628480 0} {<nil>} 174692020Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-21 20:00:36 +0000 UTC,LastTransitionTime:2021-05-21 20:00:36 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-21 21:47:46 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-21 21:47:46 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-21 21:47:46 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-21 21:47:46 +0000 UTC,LastTransitionTime:2021-05-21 19:57:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:94b7bb79c41d4a0492f63fb5fb3c5cc0,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:1e94d819-8d68-4948-b171-5fd2d8fc7ff5,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:2b114e08442070e7232fcffc4cb89529bd5c9effe733ed690277a33772bf2d00 localhost:30500/barometer-collectd:stable],SizeBytes:1464382814,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:1002487865,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:ed5c574f653e2a39e784ff322033a2319aafde7366c803a88f20f7a2a8bc1efb opnfv/barometer-collectd:stable],SizeBytes:825413035,},ContainerImage{Names:[localhost:30500/cmk@sha256:1d865c665dfeeec5a879dca7b9945cc49f55f10921b4e729f0da0cdec7dedbf7 cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[golang@sha256:1636899c10870ab66c48d960a9df620f4f9e86a0c72fbacf36032d27404e7e6c golang:alpine3.12],SizeBytes:301156062,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:a4dc6d912ce1a8dd4c3a51b1cfb52454080ed36db95bf824895d5ecb7175199f nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392673,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:36553b10a4947067b9fbb7d532951066293a68eae893beba1d9235f7d11a20ad alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 21 21:47:55.060: INFO: Logging kubelet events for node node1 May 21 21:47:55.063: INFO: Logging pods the kubelet thinks is on node node1 May 21 21:47:55.078: INFO: cmk-webhook-6c9d5f8578-8pz6w started at 2021-05-21 20:07:00 +0000 UTC (0+1 container statuses recorded) May 21 21:47:55.078: INFO: Container cmk-webhook ready: true, restart count 0 May 21 21:47:55.078: INFO: collectd-mc5kl started at 2021-05-21 20:13:40 +0000 UTC (0+3 container statuses recorded) May 21 21:47:55.078: INFO: Container collectd ready: true, restart count 0 May 21 21:47:55.078: INFO: Container collectd-exporter ready: true, restart count 0 May 21 21:47:55.078: INFO: Container rbac-proxy ready: true, restart count 0 May 21 21:47:55.078: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-czhnm started at 2021-05-21 20:04:29 +0000 UTC (0+1 container statuses recorded) May 21 21:47:55.078: INFO: Container kube-sriovdp ready: true, restart count 0 May 21 21:47:55.078: INFO: busybox-readonly-false-e3148609-ce0e-4605-92a4-0e7bd917b471 started at 2021-05-21 21:45:31 +0000 UTC (0+1 container statuses recorded) May 21 21:47:55.078: INFO: Container busybox-readonly-false-e3148609-ce0e-4605-92a4-0e7bd917b471 ready: false, restart count 0 May 21 21:47:55.078: INFO: kube-proxy-h5k9s started at 2021-05-21 19:57:00 +0000 UTC (0+1 container statuses recorded) May 21 21:47:55.078: INFO: Container kube-proxy ready: true, restart count 1 May 21 21:47:55.078: INFO: cmk-init-discover-node1-48g7j started at 2021-05-21 20:06:17 +0000 UTC (0+3 container statuses recorded) May 21 21:47:55.078: INFO: Container discover ready: false, restart count 0 May 21 21:47:55.078: INFO: Container init ready: false, restart count 0 May 21 21:47:55.078: INFO: Container install ready: false, restart count 0 May 21 21:47:55.078: INFO: pod-init-2ec58da9-36da-4b8a-b115-720b8ba8e13b started at 2021-05-21 21:44:40 +0000 UTC (2+1 container statuses recorded) May 21 21:47:55.078: INFO: Init container init1 ready: false, restart count 0 May 21 21:47:55.078: INFO: Init container init2 ready: false, restart count 0 May 21 21:47:55.078: INFO: Container run1 ready: false, restart count 0 May 21 21:47:55.078: INFO: kubernetes-dashboard-86c6f9df5b-8rsws started at 2021-05-21 19:58:07 +0000 UTC (0+1 container statuses recorded) May 21 21:47:55.078: INFO: Container kubernetes-dashboard ready: true, restart count 1 May 21 21:47:55.078: INFO: node-feature-discovery-worker-lh5hz started at 2021-05-21 20:03:47 +0000 UTC (0+1 container statuses recorded) May 21 21:47:55.078: INFO: Container nfd-worker ready: true, restart count 0 May 21 21:47:55.078: INFO: affinity-clusterip-timeout-rfm9t started at 2021-05-21 21:47:20 +0000 UTC (0+1 container statuses recorded) May 21 21:47:55.078: INFO: Container affinity-clusterip-timeout ready: false, restart count 0 May 21 21:47:55.078: INFO: kube-multus-ds-amd64-wlmhr started at 2021-05-21 19:57:42 +0000 UTC (0+1 container statuses recorded) May 21 21:47:55.078: INFO: Container kube-multus ready: true, restart count 1 May 21 21:47:55.078: INFO: kubernetes-metrics-scraper-678c97765c-nnrtl started at 2021-05-21 19:58:07 +0000 UTC (0+1 container statuses recorded) May 21 21:47:55.078: INFO: Container kubernetes-metrics-scraper ready: true, restart count 2 May 21 21:47:55.078: INFO: prometheus-operator-5bb8cb9d8f-mzlrf started at 2021-05-21 20:07:47 +0000 UTC (0+2 container statuses recorded) May 21 21:47:55.078: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:47:55.078: INFO: Container prometheus-operator ready: true, restart count 0 May 21 21:47:55.078: INFO: node-exporter-l5k2r started at 2021-05-21 20:07:54 +0000 UTC (0+2 container statuses recorded) May 21 21:47:55.078: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:47:55.078: INFO: Container node-exporter ready: true, restart count 0 May 21 21:47:55.078: INFO: pod-adoption started at 2021-05-21 21:43:33 +0000 UTC (0+1 container statuses recorded) May 21 21:47:55.078: INFO: Container pod-adoption ready: false, restart count 0 May 21 21:47:55.078: INFO: nginx-proxy-node1 started at 2021-05-21 20:03:00 +0000 UTC (0+1 container statuses recorded) May 21 21:47:55.078: INFO: Container nginx-proxy ready: true, restart count 1 May 21 21:47:55.078: INFO: cmk-h8jxp started at 2021-05-21 20:07:00 +0000 UTC (0+2 container statuses recorded) May 21 21:47:55.078: INFO: Container nodereport ready: true, restart count 0 May 21 21:47:55.078: INFO: Container reconcile ready: true, restart count 0 May 21 21:47:55.078: INFO: prometheus-k8s-0 started at 2021-05-21 20:08:06 +0000 UTC (0+5 container statuses recorded) May 21 21:47:55.078: INFO: Container custom-metrics-apiserver ready: true, restart count 0 May 21 21:47:55.078: INFO: Container grafana ready: true, restart count 0 May 21 21:47:55.078: INFO: Container prometheus ready: true, restart count 1 May 21 21:47:55.078: INFO: Container prometheus-config-reloader ready: true, restart count 0 May 21 21:47:55.079: INFO: Container rules-configmap-reloader ready: true, restart count 0 May 21 21:47:55.079: INFO: kube-flannel-k6mr4 started at 2021-05-21 19:57:34 +0000 UTC (1+1 container statuses recorded) May 21 21:47:55.079: INFO: Init container install-cni ready: true, restart count 1 May 21 21:47:55.079: INFO: Container kube-flannel ready: true, restart count 1 W0521 21:47:55.089815 25 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 21 21:47:55.120: INFO: Latency metrics for node node1 May 21 21:47:55.120: INFO: Logging node info for node node2 May 21 21:47:55.122: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 3f64ce47-e96b-43b8-9c91-df57a4e26826 41838 0 2021-05-21 19:56:58 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"4e:d8:e9:66:bc:b7"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-21 19:56:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-05-21 19:56:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-21 19:57:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-21 20:04:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-21 20:06:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-21 20:06:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269633024 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884632576 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-21 20:00:39 +0000 UTC,LastTransitionTime:2021-05-21 20:00:39 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-21 21:47:53 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-21 21:47:53 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-21 21:47:53 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-21 21:47:53 +0000 UTC,LastTransitionTime:2021-05-21 19:57:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:2aa9b8566664435b84c4146a11c874db,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:befe5c4e-169e-4c36-9e45-742bb80d4660,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:2b114e08442070e7232fcffc4cb89529bd5c9effe733ed690277a33772bf2d00 localhost:30500/barometer-collectd:stable],SizeBytes:1464382814,},ContainerImage{Names:[localhost:30500/cmk@sha256:1d865c665dfeeec5a879dca7b9945cc49f55f10921b4e729f0da0cdec7dedbf7 localhost:30500/cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:a4dc6d912ce1a8dd4c3a51b1cfb52454080ed36db95bf824895d5ecb7175199f localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392673,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:f013255695f4515c5b21b11281c7e0fb491082d15ec5a96adb8217e015a9c422 localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:50746f542c19fda01d88ae124ce58c5a326dad7cd24d3c2d19fdf959cc7f0c49 localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 21 21:47:55.122: INFO: Logging kubelet events for node node2 May 21 21:47:55.124: INFO: Logging pods the kubelet thinks is on node node2 May 21 21:47:55.137: INFO: adopt-release-n9wdj started at 2021-05-21 21:41:11 +0000 UTC (0+1 container statuses recorded) May 21 21:47:55.137: INFO: Container c ready: false, restart count 0 May 21 21:47:55.137: INFO: pod-sharedvolume-ba00bf9b-616b-4a0f-bc91-6eb37a4b1973 started at 2021-05-21 21:42:54 +0000 UTC (0+2 container statuses recorded) May 21 21:47:55.137: INFO: Container busybox-main-container ready: false, restart count 0 May 21 21:47:55.137: INFO: Container busybox-sub-container ready: false, restart count 0 May 21 21:47:55.137: INFO: kube-flannel-5p7gq started at 2021-05-21 19:57:34 +0000 UTC (1+1 container statuses recorded) May 21 21:47:55.137: INFO: Init container install-cni ready: true, restart count 2 May 21 21:47:55.137: INFO: Container kube-flannel ready: true, restart count 2 May 21 21:47:55.137: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-j7fm6 started at 2021-05-21 20:04:29 +0000 UTC (0+1 container statuses recorded) May 21 21:47:55.137: INFO: Container kube-sriovdp ready: true, restart count 0 May 21 21:47:55.137: INFO: pod-init-c253672c-86b7-4133-9ea0-5a4cc39cb2cf started at 2021-05-21 21:46:41 +0000 UTC (2+1 container statuses recorded) May 21 21:47:55.137: INFO: Init container init1 ready: false, restart count 0 May 21 21:47:55.137: INFO: Init container init2 ready: false, restart count 0 May 21 21:47:55.137: INFO: Container run1 ready: false, restart count 0 May 21 21:47:55.137: INFO: kube-multus-ds-amd64-6q46t started at 2021-05-21 19:57:42 +0000 UTC (0+1 container statuses recorded) May 21 21:47:55.137: INFO: Container kube-multus ready: true, restart count 1 May 21 21:47:55.137: INFO: cmk-init-discover-node2-p7sdn started at 2021-05-21 20:06:37 +0000 UTC (0+3 container statuses recorded) May 21 21:47:55.137: INFO: Container discover ready: false, restart count 0 May 21 21:47:55.137: INFO: Container init ready: false, restart count 0 May 21 21:47:55.137: INFO: Container install ready: false, restart count 0 May 21 21:47:55.137: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-8kddc started at 2021-05-21 20:10:49 +0000 UTC (0+2 container statuses recorded) May 21 21:47:55.137: INFO: Container tas-controller ready: true, restart count 0 May 21 21:47:55.137: INFO: Container tas-extender ready: true, restart count 0 May 21 21:47:55.137: INFO: e2e-test-httpd-pod started at 2021-05-21 21:43:04 +0000 UTC (0+1 container statuses recorded) May 21 21:47:55.137: INFO: Container e2e-test-httpd-pod ready: false, restart count 0 May 21 21:47:55.137: INFO: nginx-proxy-node2 started at 2021-05-21 20:03:00 +0000 UTC (0+1 container statuses recorded) May 21 21:47:55.137: INFO: Container nginx-proxy ready: true, restart count 2 May 21 21:47:55.137: INFO: affinity-clusterip-timeout-6ddhr started at 2021-05-21 21:47:20 +0000 UTC (0+1 container statuses recorded) May 21 21:47:55.137: INFO: Container affinity-clusterip-timeout ready: false, restart count 0 May 21 21:47:55.137: INFO: collectd-tz5h5 started at 2021-05-21 20:13:40 +0000 UTC (0+3 container statuses recorded) May 21 21:47:55.137: INFO: Container collectd ready: true, restart count 0 May 21 21:47:55.137: INFO: Container collectd-exporter ready: true, restart count 0 May 21 21:47:55.137: INFO: Container rbac-proxy ready: true, restart count 0 May 21 21:47:55.137: INFO: affinity-clusterip-timeout-mzb86 started at 2021-05-21 21:47:20 +0000 UTC (0+1 container statuses recorded) May 21 21:47:55.137: INFO: Container affinity-clusterip-timeout ready: false, restart count 0 May 21 21:47:55.137: INFO: adopt-release-xf7hc started at 2021-05-21 21:41:11 +0000 UTC (0+1 container statuses recorded) May 21 21:47:55.137: INFO: Container c ready: false, restart count 0 May 21 21:47:55.137: INFO: kube-proxy-q57hf started at 2021-05-21 19:57:00 +0000 UTC (0+1 container statuses recorded) May 21 21:47:55.137: INFO: Container kube-proxy ready: true, restart count 2 May 21 21:47:55.137: INFO: node-feature-discovery-worker-28kx4 started at 2021-05-21 20:03:47 +0000 UTC (0+1 container statuses recorded) May 21 21:47:55.137: INFO: Container nfd-worker ready: true, restart count 0 May 21 21:47:55.137: INFO: cmk-j2nnh started at 2021-05-21 20:07:00 +0000 UTC (0+2 container statuses recorded) May 21 21:47:55.137: INFO: Container nodereport ready: true, restart count 0 May 21 21:47:55.137: INFO: Container reconcile ready: true, restart count 0 May 21 21:47:55.137: INFO: node-exporter-c46fg started at 2021-05-21 20:07:54 +0000 UTC (0+2 container statuses recorded) May 21 21:47:55.137: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:47:55.137: INFO: Container node-exporter ready: true, restart count 0 May 21 21:47:55.137: INFO: busybox-31d82853-0ab7-4147-8cd3-52c6c6a07033 started at 2021-05-21 21:43:52 +0000 UTC (0+1 container statuses recorded) May 21 21:47:55.137: INFO: Container busybox ready: false, restart count 0 W0521 21:47:55.151471 25 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 21 21:47:55.181: INFO: Latency metrics for node node2 May 21 21:47:55.181: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "emptydir-3167" for this suite. /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 May 21 21:52:55.828: wait for pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b" to succeed Expected success, but got an error: <*errors.errorString | 0xc0001ce5e0>: { s: "Gave up after waiting 5m0s for pod \"busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b\" to be \"Succeeded or Failed\"", } Gave up after waiting 5m0s for pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b" to be "Succeeded or Failed" /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:212 [BeforeEach] [k8s.io] Security Context /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:174 STEP: Creating a kubernetes client May 21 21:47:55.239: INFO: >>> kubeConfig: /root/.kube/config STEP: Building a namespace api object, basename security-context-test STEP: Waiting for a default service account to be provisioned in namespace [BeforeEach] [k8s.io] Security Context /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/security_context.go:41 [It] should run the container as unprivileged when false [LinuxOnly] [NodeConformance] [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:597 May 21 21:47:55.274: INFO: Waiting up to 5m0s for pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b" in namespace "security-context-test-5632" to be "Succeeded or Failed" May 21 21:47:55.276: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 1.970125ms May 21 21:47:57.279: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 2.005573559s May 21 21:47:59.282: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 4.008553335s May 21 21:48:01.285: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 6.011257295s May 21 21:48:03.290: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 8.015933158s May 21 21:48:05.293: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 10.019575167s May 21 21:48:07.300: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 12.026166407s May 21 21:48:09.302: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 14.028732125s May 21 21:48:11.306: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 16.032198533s May 21 21:48:13.309: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 18.035526059s May 21 21:48:15.315: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 20.040890983s May 21 21:48:17.317: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 22.043648569s May 21 21:48:19.321: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 24.047334157s May 21 21:48:21.324: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 26.05023611s May 21 21:48:23.327: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 28.053068136s May 21 21:48:25.330: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 30.056014286s May 21 21:48:27.335: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 32.061135532s May 21 21:48:29.338: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 34.064300928s May 21 21:48:31.344: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 36.070570352s May 21 21:48:33.348: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 38.074114852s May 21 21:48:35.352: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 40.077996876s May 21 21:48:37.355: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 42.081506728s May 21 21:48:39.359: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 44.085757s May 21 21:48:41.363: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 46.089503252s May 21 21:48:43.373: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 48.099784433s May 21 21:48:45.380: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 50.106514813s May 21 21:48:47.384: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 52.109952993s May 21 21:48:49.387: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 54.113242356s May 21 21:48:51.390: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 56.116663603s May 21 21:48:53.394: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 58.120232668s May 21 21:48:55.398: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.124535855s May 21 21:48:57.403: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.129626216s May 21 21:48:59.407: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.132997061s May 21 21:49:01.412: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.138573264s May 21 21:49:03.416: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.142759258s May 21 21:49:05.420: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.146793313s May 21 21:49:07.427: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.152912262s May 21 21:49:09.431: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.156923014s May 21 21:49:11.435: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.161477062s May 21 21:49:13.439: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.164984011s May 21 21:49:15.443: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.169711072s May 21 21:49:17.448: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.174859214s May 21 21:49:19.452: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.178430997s May 21 21:49:21.455: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.181775283s May 21 21:49:23.459: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.185300232s May 21 21:49:25.463: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.189173247s May 21 21:49:27.467: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.193167089s May 21 21:49:29.471: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.19713785s May 21 21:49:31.475: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.201159639s May 21 21:49:33.480: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.205918999s May 21 21:49:35.486: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.211983305s May 21 21:49:37.490: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.216255949s May 21 21:49:39.493: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.219118652s May 21 21:49:41.497: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.223803485s May 21 21:49:43.503: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.229086507s May 21 21:49:45.507: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.233515585s May 21 21:49:47.512: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.238390856s May 21 21:49:49.515: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.24113551s May 21 21:49:51.518: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.244590686s May 21 21:49:53.521: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.2477521s May 21 21:49:55.524: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.250670418s May 21 21:49:57.527: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.253277692s May 21 21:49:59.530: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.256198919s May 21 21:50:01.534: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.259960019s May 21 21:50:03.537: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.262998814s May 21 21:50:05.541: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.266932591s May 21 21:50:07.545: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.271587566s May 21 21:50:09.548: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.27481403s May 21 21:50:11.554: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.280598835s May 21 21:50:13.557: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.283689001s May 21 21:50:15.561: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.287147297s May 21 21:50:17.565: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.290942216s May 21 21:50:19.569: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.294981786s May 21 21:50:21.572: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.298429153s May 21 21:50:23.576: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.302043745s May 21 21:50:25.580: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.305955533s May 21 21:50:27.583: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.309019926s May 21 21:50:29.586: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.312297841s May 21 21:50:31.589: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.315189401s May 21 21:50:33.592: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.317899772s May 21 21:50:35.595: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.321187798s May 21 21:50:37.598: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.323978326s May 21 21:50:39.601: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.327809305s May 21 21:50:41.605: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.331787711s May 21 21:50:43.609: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.335164103s May 21 21:50:45.612: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.338241726s May 21 21:50:47.616: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.34225146s May 21 21:50:49.620: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.346161987s May 21 21:50:51.622: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.348758904s May 21 21:50:53.626: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.352024497s May 21 21:50:55.630: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.356203081s May 21 21:50:57.634: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.359929579s May 21 21:50:59.637: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.363277221s May 21 21:51:01.641: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.367351933s May 21 21:51:03.644: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.370477342s May 21 21:51:05.647: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.373757759s May 21 21:51:07.650: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.376565264s May 21 21:51:09.653: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.379687026s May 21 21:51:11.657: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.38320501s May 21 21:51:13.659: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.385704534s May 21 21:51:15.663: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.389771696s May 21 21:51:17.667: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.393375466s May 21 21:51:19.672: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.398154724s May 21 21:51:21.675: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.4010902s May 21 21:51:23.678: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.404058914s May 21 21:51:25.682: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.40822839s May 21 21:51:27.685: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.411781707s May 21 21:51:29.688: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.414606917s May 21 21:51:31.691: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.417614881s May 21 21:51:33.694: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.420735123s May 21 21:51:35.698: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.424054566s May 21 21:51:37.701: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.427267073s May 21 21:51:39.706: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.432285654s May 21 21:51:41.709: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.435281306s May 21 21:51:43.712: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.438272316s May 21 21:51:45.715: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.441151364s May 21 21:51:47.718: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.444383456s May 21 21:51:49.721: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.447485081s May 21 21:51:51.724: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.450649012s May 21 21:51:53.728: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.453924763s May 21 21:51:55.731: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.457872158s May 21 21:51:57.734: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.460567713s May 21 21:51:59.737: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.463791105s May 21 21:52:01.741: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.467060012s May 21 21:52:03.745: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.471681089s May 21 21:52:05.749: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.474882368s May 21 21:52:07.752: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.478666407s May 21 21:52:09.756: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.48224297s May 21 21:52:11.759: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.485543483s May 21 21:52:13.762: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.488485517s May 21 21:52:15.765: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.490886306s May 21 21:52:17.768: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.494153698s May 21 21:52:19.771: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.49713576s May 21 21:52:21.775: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.50093935s May 21 21:52:23.778: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.504001715s May 21 21:52:25.780: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.506252879s May 21 21:52:27.784: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.5101205s May 21 21:52:29.788: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.514037264s May 21 21:52:31.791: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.517733631s May 21 21:52:33.794: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.520717216s May 21 21:52:35.797: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.523800628s May 21 21:52:37.800: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.526758636s May 21 21:52:39.803: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.529165907s May 21 21:52:41.806: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.532337695s May 21 21:52:43.809: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.53530754s May 21 21:52:45.812: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.537939579s May 21 21:52:47.815: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.541518507s May 21 21:52:49.818: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.544420338s May 21 21:52:51.824: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.550113293s May 21 21:52:53.827: INFO: Pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.553542143s May 21 21:52:55.828: FAIL: wait for pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b" to succeed Expected success, but got an error: <*errors.errorString | 0xc0001ce5e0>: { s: "Gave up after waiting 5m0s for pod \"busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b\" to be \"Succeeded or Failed\"", } Gave up after waiting 5m0s for pod "busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b" to be "Succeeded or Failed" Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*PodClient).WaitForSuccess(0xc003a6b6c0, 0xc003a2cf80, 0x3d, 0x45d964b800) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:212 +0x2bb k8s.io/kubernetes/test/e2e/common.glob..func29.5.2(0x0, 0x0, 0xc003a6b6c0) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/security_context.go:255 +0x1ec k8s.io/kubernetes/test/e2e/common.glob..func29.5.3() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/security_context.go:265 +0x48 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc001902480) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc001902480) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:145 +0x2b testing.tRunner(0xc001902480, 0x4de37a0) /usr/local/go/src/testing/testing.go:1123 +0xef created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1168 +0x2b3 [AfterEach] [k8s.io] Security Context /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:175 STEP: Collecting events from namespace "security-context-test-5632". STEP: Found 7 events. May 21 21:52:55.834: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b: { } Scheduled: Successfully assigned security-context-test-5632/busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b to node2 May 21 21:52:55.834: INFO: At 2021-05-21 21:47:56 +0000 UTC - event for busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b: {multus } AddedInterface: Add eth0 [10.244.4.241/24] May 21 21:52:55.834: INFO: At 2021-05-21 21:47:56 +0000 UTC - event for busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b: {kubelet node2} Pulling: Pulling image "docker.io/library/busybox:1.29" May 21 21:52:55.834: INFO: At 2021-05-21 21:47:57 +0000 UTC - event for busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b: {kubelet node2} Failed: Failed to pull image "docker.io/library/busybox:1.29": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit May 21 21:52:55.834: INFO: At 2021-05-21 21:47:57 +0000 UTC - event for busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b: {kubelet node2} Failed: Error: ErrImagePull May 21 21:52:55.834: INFO: At 2021-05-21 21:47:58 +0000 UTC - event for busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b: {kubelet node2} BackOff: Back-off pulling image "docker.io/library/busybox:1.29" May 21 21:52:55.834: INFO: At 2021-05-21 21:47:58 +0000 UTC - event for busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b: {kubelet node2} Failed: Error: ImagePullBackOff May 21 21:52:55.837: INFO: POD NODE PHASE GRACE CONDITIONS May 21 21:52:55.837: INFO: busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b node2 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-05-21 21:47:55 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-05-21 21:47:55 +0000 UTC ContainersNotReady containers with unready status: [busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-05-21 21:47:55 +0000 UTC ContainersNotReady containers with unready status: [busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-05-21 21:47:55 +0000 UTC }] May 21 21:52:55.837: INFO: May 21 21:52:55.841: INFO: Logging node info for node master1 May 21 21:52:55.843: INFO: Node Info: &Node{ObjectMeta:{master1 /api/v1/nodes/master1 18cf10c1-c08b-4d36-bbe6-5aa86f02296e 45465 0 2021-05-21 19:55:07 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master1 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"d2:e0:bb:d8:54:80"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.202 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/master.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-21 19:55:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-21 19:55:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-21 19:57:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-21 19:57:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}}} {nfd-master Update v1 2021-05-21 20:04:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/master.version":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234763776 0} {<nil>} 196518324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324599808 0} {<nil>} 195629492Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-21 19:59:55 +0000 UTC,LastTransitionTime:2021-05-21 19:59:55 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-21 21:52:49 +0000 UTC,LastTransitionTime:2021-05-21 19:55:07 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-21 21:52:49 +0000 UTC,LastTransitionTime:2021-05-21 19:55:07 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-21 21:52:49 +0000 UTC,LastTransitionTime:2021-05-21 19:55:07 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-21 21:52:49 +0000 UTC,LastTransitionTime:2021-05-21 19:59:16 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.202,},NodeAddress{Type:Hostname,Address:master1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0b916e2f445c4d05b6a9058a788d9410,SystemUUID:00ACFB60-0631-E711-906E-0017A4403562,BootID:ab86499b-409f-44c9-86ff-e9bc113e4112,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[registry@sha256:1cd9409a311350c3072fe510b52046f104416376c126a479cef9a4dfe692cf57 registry:2.7.0],SizeBytes:24191168,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:f013255695f4515c5b21b11281c7e0fb491082d15ec5a96adb8217e015a9c422 tas-controller:latest localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[nginx@sha256:a97eb9ecc708c8aa715ccfb5e9338f5456e4b65575daf304f108301f3b497314 nginx:1.19.2-alpine],SizeBytes:22052669,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:50746f542c19fda01d88ae124ce58c5a326dad7cd24d3c2d19fdf959cc7f0c49 tas-extender:latest localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:5577654,},ContainerImage{Names:[alpine@sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a alpine:3.12.1],SizeBytes:5573013,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 21 21:52:55.844: INFO: Logging kubelet events for node master1 May 21 21:52:55.847: INFO: Logging pods the kubelet thinks is on node master1 May 21 21:52:55.856: INFO: kube-scheduler-master1 started at 2021-05-21 19:59:16 +0000 UTC (0+1 container statuses recorded) May 21 21:52:55.856: INFO: Container kube-scheduler ready: true, restart count 0 May 21 21:52:55.856: INFO: kube-apiserver-master1 started at 2021-05-21 20:03:10 +0000 UTC (0+1 container statuses recorded) May 21 21:52:55.856: INFO: Container kube-apiserver ready: true, restart count 0 May 21 21:52:55.856: INFO: kube-controller-manager-master1 started at 2021-05-21 19:59:16 +0000 UTC (0+1 container statuses recorded) May 21 21:52:55.856: INFO: Container kube-controller-manager ready: true, restart count 3 May 21 21:52:55.856: INFO: kube-multus-ds-amd64-z8khx started at 2021-05-21 19:57:42 +0000 UTC (0+1 container statuses recorded) May 21 21:52:55.856: INFO: Container kube-multus ready: true, restart count 1 May 21 21:52:55.856: INFO: docker-registry-docker-registry-56cbc7bc58-mft7s started at 2021-05-21 20:00:26 +0000 UTC (0+2 container statuses recorded) May 21 21:52:55.856: INFO: Container docker-registry ready: true, restart count 0 May 21 21:52:55.856: INFO: Container nginx ready: true, restart count 0 May 21 21:52:55.856: INFO: node-feature-discovery-controller-5bf5c49849-ktcdq started at 2021-05-21 20:03:57 +0000 UTC (0+1 container statuses recorded) May 21 21:52:55.856: INFO: Container nfd-controller ready: true, restart count 0 May 21 21:52:55.856: INFO: node-exporter-m7jht started at 2021-05-21 20:07:54 +0000 UTC (0+2 container statuses recorded) May 21 21:52:55.856: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:52:55.856: INFO: Container node-exporter ready: true, restart count 0 May 21 21:52:55.856: INFO: kube-proxy-zv2rb started at 2021-05-21 19:57:00 +0000 UTC (0+1 container statuses recorded) May 21 21:52:55.856: INFO: Container kube-proxy ready: true, restart count 2 May 21 21:52:55.856: INFO: kube-flannel-5lkd2 started at 2021-05-21 19:57:34 +0000 UTC (1+1 container statuses recorded) May 21 21:52:55.856: INFO: Init container install-cni ready: true, restart count 0 May 21 21:52:55.856: INFO: Container kube-flannel ready: true, restart count 2 W0521 21:52:55.868409 25 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 21 21:52:55.899: INFO: Latency metrics for node master1 May 21 21:52:55.899: INFO: Logging node info for node master2 May 21 21:52:55.902: INFO: Node Info: &Node{ObjectMeta:{master2 /api/v1/nodes/master2 d439093b-ce44-47e7-8b41-5739b7c49ca5 45506 0 2021-05-21 19:55:46 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master2 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"62:5a:fb:0b:f8:b0"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.203 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-21 19:55:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-21 19:55:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-21 19:57:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-21 19:57:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234763776 0} {<nil>} 196518324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324599808 0} {<nil>} 195629492Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-21 20:00:49 +0000 UTC,LastTransitionTime:2021-05-21 20:00:49 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-21 21:52:52 +0000 UTC,LastTransitionTime:2021-05-21 19:55:46 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-21 21:52:52 +0000 UTC,LastTransitionTime:2021-05-21 19:55:46 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-21 21:52:52 +0000 UTC,LastTransitionTime:2021-05-21 19:55:46 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-21 21:52:52 +0000 UTC,LastTransitionTime:2021-05-21 19:57:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.203,},NodeAddress{Type:Hostname,Address:master2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:495d1cf47bdb4c7e982c636c95de5648,SystemUUID:00A0DE53-E51D-E711-906E-0017A4403562,BootID:cca785c0-d61e-403e-91fd-d0d4f3fa573c,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 21 21:52:55.903: INFO: Logging kubelet events for node master2 May 21 21:52:55.905: INFO: Logging pods the kubelet thinks is on node master2 May 21 21:52:55.913: INFO: kube-apiserver-master2 started at 2021-05-21 20:03:00 +0000 UTC (0+1 container statuses recorded) May 21 21:52:55.913: INFO: Container kube-apiserver ready: true, restart count 0 May 21 21:52:55.913: INFO: coredns-7677f9bb54-lv5gk started at 2021-05-21 19:58:07 +0000 UTC (0+1 container statuses recorded) May 21 21:52:55.913: INFO: Container coredns ready: true, restart count 1 May 21 21:52:55.913: INFO: kube-controller-manager-master2 started at 2021-05-21 19:59:58 +0000 UTC (0+1 container statuses recorded) May 21 21:52:55.913: INFO: Container kube-controller-manager ready: true, restart count 2 May 21 21:52:55.913: INFO: kube-scheduler-master2 started at 2021-05-21 20:00:08 +0000 UTC (0+1 container statuses recorded) May 21 21:52:55.913: INFO: Container kube-scheduler ready: true, restart count 2 May 21 21:52:55.913: INFO: kube-proxy-shdjd started at 2021-05-21 19:57:00 +0000 UTC (0+1 container statuses recorded) May 21 21:52:55.913: INFO: Container kube-proxy ready: true, restart count 1 May 21 21:52:55.913: INFO: kube-flannel-tnf5x started at 2021-05-21 19:57:34 +0000 UTC (1+1 container statuses recorded) May 21 21:52:55.913: INFO: Init container install-cni ready: true, restart count 0 May 21 21:52:55.913: INFO: Container kube-flannel ready: true, restart count 1 May 21 21:52:55.913: INFO: kube-multus-ds-amd64-lwzkr started at 2021-05-21 19:57:42 +0000 UTC (0+1 container statuses recorded) May 21 21:52:55.913: INFO: Container kube-multus ready: true, restart count 1 May 21 21:52:55.913: INFO: dns-autoscaler-5b7b5c9b6f-dvlvw started at 2021-05-21 19:58:05 +0000 UTC (0+1 container statuses recorded) May 21 21:52:55.913: INFO: Container autoscaler ready: true, restart count 2 May 21 21:52:55.913: INFO: node-exporter-q52l5 started at 2021-05-21 20:07:54 +0000 UTC (0+2 container statuses recorded) May 21 21:52:55.913: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:52:55.913: INFO: Container node-exporter ready: true, restart count 0 W0521 21:52:55.927417 25 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 21 21:52:55.952: INFO: Latency metrics for node master2 May 21 21:52:55.952: INFO: Logging node info for node master3 May 21 21:52:55.954: INFO: Node Info: &Node{ObjectMeta:{master3 /api/v1/nodes/master3 23066049-f3f1-42a7-9cea-19e20ed4ccec 45464 0 2021-05-21 19:55:56 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:master3 kubernetes.io/os:linux node-role.kubernetes.io/master:] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"ae:a6:e4:e7:ba:02"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.204 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2021-05-21 19:55:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kubeadm Update v1 2021-05-21 19:55:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/master":{}}}}} {flanneld Update v1 2021-05-21 19:57:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-05-21 19:57:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}},"f:taints":{}}}}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{201234767872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{79550 -3} {<nil>} 79550m DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{200324603904 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-21 20:00:41 +0000 UTC,LastTransitionTime:2021-05-21 20:00:41 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-21 21:52:49 +0000 UTC,LastTransitionTime:2021-05-21 19:55:56 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-21 21:52:49 +0000 UTC,LastTransitionTime:2021-05-21 19:55:56 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-21 21:52:49 +0000 UTC,LastTransitionTime:2021-05-21 19:55:56 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-21 21:52:49 +0000 UTC,LastTransitionTime:2021-05-21 19:57:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.204,},NodeAddress{Type:Hostname,Address:master3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:660844f5cb0944868621042562b928e3,SystemUUID:008B1444-141E-E711-906E-0017A4403562,BootID:02066ff3-4833-4130-ba94-138c581e4cc0,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:04833b601fa130512450afa45c4fe484fee1293634f34c7ddc231bd193c74017 quay.io/coreos/etcd:v3.4.13],SizeBytes:83790470,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:45227747,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64@sha256:dce43068853ad396b0fb5ace9a56cc14114e31979e241342d12d04526be1dfcc k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.3],SizeBytes:40647382,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 21 21:52:55.954: INFO: Logging kubelet events for node master3 May 21 21:52:55.957: INFO: Logging pods the kubelet thinks is on node master3 May 21 21:52:55.965: INFO: node-exporter-s74rx started at 2021-05-21 20:07:54 +0000 UTC (0+2 container statuses recorded) May 21 21:52:55.965: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:52:55.965: INFO: Container node-exporter ready: true, restart count 0 May 21 21:52:55.965: INFO: kube-controller-manager-master3 started at 2021-05-21 20:03:00 +0000 UTC (0+1 container statuses recorded) May 21 21:52:55.965: INFO: Container kube-controller-manager ready: true, restart count 1 May 21 21:52:55.965: INFO: kube-scheduler-master3 started at 2021-05-21 20:03:10 +0000 UTC (0+1 container statuses recorded) May 21 21:52:55.965: INFO: Container kube-scheduler ready: true, restart count 1 May 21 21:52:55.965: INFO: kube-apiserver-master3 started at 2021-05-21 20:03:20 +0000 UTC (0+1 container statuses recorded) May 21 21:52:55.965: INFO: Container kube-apiserver ready: true, restart count 0 May 21 21:52:55.965: INFO: kube-proxy-hwwxt started at 2021-05-21 19:57:00 +0000 UTC (0+1 container statuses recorded) May 21 21:52:55.965: INFO: Container kube-proxy ready: true, restart count 2 May 21 21:52:55.965: INFO: kube-flannel-8sd6n started at 2021-05-21 19:57:34 +0000 UTC (1+1 container statuses recorded) May 21 21:52:55.965: INFO: Init container install-cni ready: true, restart count 0 May 21 21:52:55.965: INFO: Container kube-flannel ready: true, restart count 1 May 21 21:52:55.965: INFO: kube-multus-ds-amd64-zgdbl started at 2021-05-21 19:57:42 +0000 UTC (0+1 container statuses recorded) May 21 21:52:55.965: INFO: Container kube-multus ready: true, restart count 1 May 21 21:52:55.965: INFO: coredns-7677f9bb54-gjt42 started at 2021-05-21 19:58:03 +0000 UTC (0+1 container statuses recorded) May 21 21:52:55.965: INFO: Container coredns ready: true, restart count 1 W0521 21:52:55.977751 25 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 21 21:52:56.006: INFO: Latency metrics for node master3 May 21 21:52:56.006: INFO: Logging node info for node node1 May 21 21:52:56.009: INFO: Node Info: &Node{ObjectMeta:{node1 /api/v1/nodes/node1 62cfecb3-af08-42a4-ab85-25a317061b61 45501 0 2021-05-21 19:56:58 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node1 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"22:2e:2b:06:83:4a"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.207 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-21 19:56:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.3.0/24\"":{}}}}} {kubeadm Update v1 2021-05-21 19:56:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-21 19:57:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-21 20:04:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-21 20:06:20 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-21 20:06:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.3.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269628928 0} {<nil>} 196552372Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884628480 0} {<nil>} 174692020Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-21 20:00:36 +0000 UTC,LastTransitionTime:2021-05-21 20:00:36 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-21 21:52:51 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-21 21:52:51 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-21 21:52:51 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-21 21:52:51 +0000 UTC,LastTransitionTime:2021-05-21 19:57:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.207,},NodeAddress{Type:Hostname,Address:node1,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:94b7bb79c41d4a0492f63fb5fb3c5cc0,SystemUUID:00CDA902-D022-E711-906E-0017A4403562,BootID:1e94d819-8d68-4948-b171-5fd2d8fc7ff5,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:2b114e08442070e7232fcffc4cb89529bd5c9effe733ed690277a33772bf2d00 localhost:30500/barometer-collectd:stable],SizeBytes:1464382814,},ContainerImage{Names:[<none>@<none> <none>:<none>],SizeBytes:1002487865,},ContainerImage{Names:[opnfv/barometer-collectd@sha256:ed5c574f653e2a39e784ff322033a2319aafde7366c803a88f20f7a2a8bc1efb opnfv/barometer-collectd:stable],SizeBytes:825413035,},ContainerImage{Names:[localhost:30500/cmk@sha256:1d865c665dfeeec5a879dca7b9945cc49f55f10921b4e729f0da0cdec7dedbf7 cmk:v1.5.1 localhost:30500/cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[golang@sha256:1636899c10870ab66c48d960a9df620f4f9e86a0c72fbacf36032d27404e7e6c golang:alpine3.12],SizeBytes:301156062,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:253392289,},ContainerImage{Names:[kubernetesui/dashboard-amd64@sha256:3af248961c56916aeca8eb4000c15d6cf6a69641ea92f0540865bb37b495932f kubernetesui/dashboard-amd64:v2.1.0],SizeBytes:225733746,},ContainerImage{Names:[grafana/grafana@sha256:89304bc2335f4976618548d7b93d165ed67369d3a051d2f627fc4e0aa3d0aff1 grafana/grafana:7.1.0],SizeBytes:179601493,},ContainerImage{Names:[quay.io/prometheus/prometheus@sha256:d4ba4dd1a9ebb90916d0bfed3c204adcb118ed24546bf8dd2e6b30fc0fd2009e quay.io/prometheus/prometheus:v2.20.0],SizeBytes:144886595,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:60684726,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[directxman12/k8s-prometheus-adapter-amd64@sha256:b63dc612e3cb73f79d2401a4516f794f9f0a83002600ca72e675e41baecff437 directxman12/k8s-prometheus-adapter-amd64:v0.6.0],SizeBytes:53267842,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:a4dc6d912ce1a8dd4c3a51b1cfb52454080ed36db95bf824895d5ecb7175199f nfvpe/sriov-device-plugin:latest localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392673,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:9d07c391aeb1a9d02eb4343c113ed01825227c70c32b3cae861711f90191b0fd quay.io/coreos/kube-rbac-proxy:v0.4.1],SizeBytes:41317870,},ContainerImage{Names:[quay.io/coreos/prometheus-operator@sha256:a54e806fb27d2fb0251da4f3b2a3bb5320759af63a54a755788304775f2384a7 quay.io/coreos/prometheus-operator:v0.40.0],SizeBytes:38238457,},ContainerImage{Names:[kubernetesui/metrics-scraper@sha256:1f977343873ed0e2efd4916a6b2f3075f310ff6fe42ee098f54fc58aa7a28ab7 kubernetesui/metrics-scraper:v1.0.6],SizeBytes:34548789,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/coreos/prometheus-config-reloader@sha256:c679a143b24b7731ad1577a9865aa3805426cbf1b25e30807b951dff68466ffd quay.io/coreos/prometheus-config-reloader:v0.40.0],SizeBytes:10131705,},ContainerImage{Names:[jimmidyson/configmap-reload@sha256:d107c7a235c266273b1c3502a391fec374430e5625539403d0de797fa9c556a2 jimmidyson/configmap-reload:v0.3.0],SizeBytes:9700438,},ContainerImage{Names:[appropriate/curl@sha256:027a0ad3c69d085fea765afca9984787b780c172cead6502fec989198b98d8bb appropriate/curl:edge],SizeBytes:5654234,},ContainerImage{Names:[alpine@sha256:36553b10a4947067b9fbb7d532951066293a68eae893beba1d9235f7d11a20ad alpine:3.12],SizeBytes:5581415,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 21 21:52:56.010: INFO: Logging kubelet events for node node1 May 21 21:52:56.012: INFO: Logging pods the kubelet thinks is on node node1 May 21 21:52:56.028: INFO: kubernetes-metrics-scraper-678c97765c-nnrtl started at 2021-05-21 19:58:07 +0000 UTC (0+1 container statuses recorded) May 21 21:52:56.028: INFO: Container kubernetes-metrics-scraper ready: true, restart count 2 May 21 21:52:56.028: INFO: prometheus-operator-5bb8cb9d8f-mzlrf started at 2021-05-21 20:07:47 +0000 UTC (0+2 container statuses recorded) May 21 21:52:56.028: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:52:56.028: INFO: Container prometheus-operator ready: true, restart count 0 May 21 21:52:56.028: INFO: node-exporter-l5k2r started at 2021-05-21 20:07:54 +0000 UTC (0+2 container statuses recorded) May 21 21:52:56.028: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:52:56.028: INFO: Container node-exporter ready: true, restart count 0 May 21 21:52:56.028: INFO: var-expansion-f2a290f8-c2af-48aa-a767-0103a23cfdeb started at 2021-05-21 21:49:41 +0000 UTC (0+1 container statuses recorded) May 21 21:52:56.028: INFO: Container dapi-container ready: false, restart count 0 May 21 21:52:56.028: INFO: kube-multus-ds-amd64-wlmhr started at 2021-05-21 19:57:42 +0000 UTC (0+1 container statuses recorded) May 21 21:52:56.028: INFO: Container kube-multus ready: true, restart count 1 May 21 21:52:56.028: INFO: pod-submit-remove-77f7e5f0-2e1c-4de6-9e34-421ef3c1c2fb started at 2021-05-21 21:48:33 +0000 UTC (0+1 container statuses recorded) May 21 21:52:56.028: INFO: Container nginx ready: false, restart count 0 May 21 21:52:56.028: INFO: cmk-h8jxp started at 2021-05-21 20:07:00 +0000 UTC (0+2 container statuses recorded) May 21 21:52:56.028: INFO: Container nodereport ready: true, restart count 0 May 21 21:52:56.028: INFO: Container reconcile ready: true, restart count 0 May 21 21:52:56.028: INFO: prometheus-k8s-0 started at 2021-05-21 20:08:06 +0000 UTC (0+5 container statuses recorded) May 21 21:52:56.028: INFO: Container custom-metrics-apiserver ready: true, restart count 0 May 21 21:52:56.028: INFO: Container grafana ready: true, restart count 0 May 21 21:52:56.028: INFO: Container prometheus ready: true, restart count 1 May 21 21:52:56.028: INFO: Container prometheus-config-reloader ready: true, restart count 0 May 21 21:52:56.028: INFO: Container rules-configmap-reloader ready: true, restart count 0 May 21 21:52:56.028: INFO: nginx-proxy-node1 started at 2021-05-21 20:03:00 +0000 UTC (0+1 container statuses recorded) May 21 21:52:56.028: INFO: Container nginx-proxy ready: true, restart count 1 May 21 21:52:56.028: INFO: kube-flannel-k6mr4 started at 2021-05-21 19:57:34 +0000 UTC (1+1 container statuses recorded) May 21 21:52:56.028: INFO: Init container install-cni ready: true, restart count 1 May 21 21:52:56.028: INFO: Container kube-flannel ready: true, restart count 1 May 21 21:52:56.028: INFO: collectd-mc5kl started at 2021-05-21 20:13:40 +0000 UTC (0+3 container statuses recorded) May 21 21:52:56.028: INFO: Container collectd ready: true, restart count 0 May 21 21:52:56.028: INFO: Container collectd-exporter ready: true, restart count 0 May 21 21:52:56.028: INFO: Container rbac-proxy ready: true, restart count 0 May 21 21:52:56.028: INFO: cmk-webhook-6c9d5f8578-8pz6w started at 2021-05-21 20:07:00 +0000 UTC (0+1 container statuses recorded) May 21 21:52:56.028: INFO: Container cmk-webhook ready: true, restart count 0 May 21 21:52:56.028: INFO: termination-message-container00118259-bf56-4793-9429-ad99949e3c32 started at 2021-05-21 21:52:11 +0000 UTC (0+1 container statuses recorded) May 21 21:52:56.028: INFO: Container termination-message-container ready: false, restart count 0 May 21 21:52:56.028: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-czhnm started at 2021-05-21 20:04:29 +0000 UTC (0+1 container statuses recorded) May 21 21:52:56.028: INFO: Container kube-sriovdp ready: true, restart count 0 May 21 21:52:56.028: INFO: cmk-init-discover-node1-48g7j started at 2021-05-21 20:06:17 +0000 UTC (0+3 container statuses recorded) May 21 21:52:56.028: INFO: Container discover ready: false, restart count 0 May 21 21:52:56.028: INFO: Container init ready: false, restart count 0 May 21 21:52:56.028: INFO: Container install ready: false, restart count 0 May 21 21:52:56.028: INFO: kube-proxy-h5k9s started at 2021-05-21 19:57:00 +0000 UTC (0+1 container statuses recorded) May 21 21:52:56.028: INFO: Container kube-proxy ready: true, restart count 1 May 21 21:52:56.028: INFO: node-feature-discovery-worker-lh5hz started at 2021-05-21 20:03:47 +0000 UTC (0+1 container statuses recorded) May 21 21:52:56.028: INFO: Container nfd-worker ready: true, restart count 0 May 21 21:52:56.028: INFO: kubernetes-dashboard-86c6f9df5b-8rsws started at 2021-05-21 19:58:07 +0000 UTC (0+1 container statuses recorded) May 21 21:52:56.028: INFO: Container kubernetes-dashboard ready: true, restart count 1 W0521 21:52:56.040712 25 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 21 21:52:56.073: INFO: Latency metrics for node node1 May 21 21:52:56.073: INFO: Logging node info for node node2 May 21 21:52:56.075: INFO: Node Info: &Node{ObjectMeta:{node2 /api/v1/nodes/node2 3f64ce47-e96b-43b8-9c91-df57a4e26826 45431 0 2021-05-21 19:56:58 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux cmk.intel.com/cmk-node:true feature.node.kubernetes.io/cpu-cpuid.ADX:true feature.node.kubernetes.io/cpu-cpuid.AESNI:true feature.node.kubernetes.io/cpu-cpuid.AVX:true feature.node.kubernetes.io/cpu-cpuid.AVX2:true feature.node.kubernetes.io/cpu-cpuid.AVX512BW:true feature.node.kubernetes.io/cpu-cpuid.AVX512CD:true feature.node.kubernetes.io/cpu-cpuid.AVX512DQ:true feature.node.kubernetes.io/cpu-cpuid.AVX512F:true feature.node.kubernetes.io/cpu-cpuid.AVX512VL:true feature.node.kubernetes.io/cpu-cpuid.FMA3:true feature.node.kubernetes.io/cpu-cpuid.HLE:true feature.node.kubernetes.io/cpu-cpuid.IBPB:true feature.node.kubernetes.io/cpu-cpuid.MPX:true feature.node.kubernetes.io/cpu-cpuid.RTM:true feature.node.kubernetes.io/cpu-cpuid.STIBP:true feature.node.kubernetes.io/cpu-cpuid.VMX:true feature.node.kubernetes.io/cpu-hardware_multithreading:true feature.node.kubernetes.io/cpu-pstate.turbo:true feature.node.kubernetes.io/cpu-rdt.RDTCMT:true feature.node.kubernetes.io/cpu-rdt.RDTL3CA:true feature.node.kubernetes.io/cpu-rdt.RDTMBA:true feature.node.kubernetes.io/cpu-rdt.RDTMBM:true feature.node.kubernetes.io/cpu-rdt.RDTMON:true feature.node.kubernetes.io/kernel-config.NO_HZ:true feature.node.kubernetes.io/kernel-config.NO_HZ_FULL:true feature.node.kubernetes.io/kernel-selinux.enabled:true feature.node.kubernetes.io/kernel-version.full:3.10.0-1160.25.1.el7.x86_64 feature.node.kubernetes.io/kernel-version.major:3 feature.node.kubernetes.io/kernel-version.minor:10 feature.node.kubernetes.io/kernel-version.revision:0 feature.node.kubernetes.io/memory-numa:true feature.node.kubernetes.io/network-sriov.capable:true feature.node.kubernetes.io/network-sriov.configured:true feature.node.kubernetes.io/pci-0300_1a03.present:true feature.node.kubernetes.io/storage-nonrotationaldisk:true feature.node.kubernetes.io/system-os_release.ID:centos feature.node.kubernetes.io/system-os_release.VERSION_ID:7 feature.node.kubernetes.io/system-os_release.VERSION_ID.major:7 kubernetes.io/arch:amd64 kubernetes.io/hostname:node2 kubernetes.io/os:linux] map[flannel.alpha.coreos.com/backend-data:{"VtepMAC":"4e:d8:e9:66:bc:b7"} flannel.alpha.coreos.com/backend-type:vxlan flannel.alpha.coreos.com/kube-subnet-manager:true flannel.alpha.coreos.com/public-ip:10.10.190.208 kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock nfd.node.kubernetes.io/extended-resources: nfd.node.kubernetes.io/feature-labels:cpu-cpuid.ADX,cpu-cpuid.AESNI,cpu-cpuid.AVX,cpu-cpuid.AVX2,cpu-cpuid.AVX512BW,cpu-cpuid.AVX512CD,cpu-cpuid.AVX512DQ,cpu-cpuid.AVX512F,cpu-cpuid.AVX512VL,cpu-cpuid.FMA3,cpu-cpuid.HLE,cpu-cpuid.IBPB,cpu-cpuid.MPX,cpu-cpuid.RTM,cpu-cpuid.STIBP,cpu-cpuid.VMX,cpu-hardware_multithreading,cpu-pstate.turbo,cpu-rdt.RDTCMT,cpu-rdt.RDTL3CA,cpu-rdt.RDTMBA,cpu-rdt.RDTMBM,cpu-rdt.RDTMON,kernel-config.NO_HZ,kernel-config.NO_HZ_FULL,kernel-selinux.enabled,kernel-version.full,kernel-version.major,kernel-version.minor,kernel-version.revision,memory-numa,network-sriov.capable,network-sriov.configured,pci-0300_1a03.present,storage-nonrotationaldisk,system-os_release.ID,system-os_release.VERSION_ID,system-os_release.VERSION_ID.major nfd.node.kubernetes.io/worker.version:v0.7.0 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2021-05-21 19:56:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.4.0/24\"":{}}}}} {kubeadm Update v1 2021-05-21 19:56:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}} {flanneld Update v1 2021-05-21 19:57:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:flannel.alpha.coreos.com/backend-data":{},"f:flannel.alpha.coreos.com/backend-type":{},"f:flannel.alpha.coreos.com/kube-subnet-manager":{},"f:flannel.alpha.coreos.com/public-ip":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {nfd-master Update v1 2021-05-21 20:04:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:nfd.node.kubernetes.io/extended-resources":{},"f:nfd.node.kubernetes.io/feature-labels":{},"f:nfd.node.kubernetes.io/worker.version":{}},"f:labels":{"f:feature.node.kubernetes.io/cpu-cpuid.ADX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AESNI":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX2":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512BW":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512CD":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512F":{},"f:feature.node.kubernetes.io/cpu-cpuid.AVX512VL":{},"f:feature.node.kubernetes.io/cpu-cpuid.FMA3":{},"f:feature.node.kubernetes.io/cpu-cpuid.HLE":{},"f:feature.node.kubernetes.io/cpu-cpuid.IBPB":{},"f:feature.node.kubernetes.io/cpu-cpuid.MPX":{},"f:feature.node.kubernetes.io/cpu-cpuid.RTM":{},"f:feature.node.kubernetes.io/cpu-cpuid.STIBP":{},"f:feature.node.kubernetes.io/cpu-cpuid.VMX":{},"f:feature.node.kubernetes.io/cpu-hardware_multithreading":{},"f:feature.node.kubernetes.io/cpu-pstate.turbo":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTCMT":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTL3CA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBA":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMBM":{},"f:feature.node.kubernetes.io/cpu-rdt.RDTMON":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ":{},"f:feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":{},"f:feature.node.kubernetes.io/kernel-selinux.enabled":{},"f:feature.node.kubernetes.io/kernel-version.full":{},"f:feature.node.kubernetes.io/kernel-version.major":{},"f:feature.node.kubernetes.io/kernel-version.minor":{},"f:feature.node.kubernetes.io/kernel-version.revision":{},"f:feature.node.kubernetes.io/memory-numa":{},"f:feature.node.kubernetes.io/network-sriov.capable":{},"f:feature.node.kubernetes.io/network-sriov.configured":{},"f:feature.node.kubernetes.io/pci-0300_1a03.present":{},"f:feature.node.kubernetes.io/storage-nonrotationaldisk":{},"f:feature.node.kubernetes.io/system-os_release.ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID":{},"f:feature.node.kubernetes.io/system-os_release.VERSION_ID.major":{}}}}} {Swagger-Codegen Update v1 2021-05-21 20:06:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cmk.intel.com/cmk-node":{}}},"f:status":{"f:capacity":{"f:cmk.intel.com/exclusive-cores":{}}}}} {kubelet Update v1 2021-05-21 20:06:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:cmk.intel.com/exclusive-cores":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:intel.com/intel_sriov_netdevice":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.244.4.0/24,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{80 0} {<nil>} 80 DecimalSI},ephemeral-storage: {{450471260160 0} {<nil>} 439913340Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{201269633024 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cmk.intel.com/exclusive-cores: {{3 0} {<nil>} 3 DecimalSI},cpu: {{77 0} {<nil>} 77 DecimalSI},ephemeral-storage: {{405424133473 0} {<nil>} 405424133473 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{21474836480 0} {<nil>} 20Gi BinarySI},intel.com/intel_sriov_netdevice: {{4 0} {<nil>} 4 DecimalSI},memory: {{178884632576 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-05-21 20:00:39 +0000 UTC,LastTransitionTime:2021-05-21 20:00:39 +0000 UTC,Reason:FlannelIsUp,Message:Flannel is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-05-21 21:52:46 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-05-21 21:52:46 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-05-21 21:52:46 +0000 UTC,LastTransitionTime:2021-05-21 19:56:58 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-05-21 21:52:46 +0000 UTC,LastTransitionTime:2021-05-21 19:57:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.10.190.208,},NodeAddress{Type:Hostname,Address:node2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:2aa9b8566664435b84c4146a11c874db,SystemUUID:80B3CD56-852F-E711-906E-0017A4403562,BootID:befe5c4e-169e-4c36-9e45-742bb80d4660,KernelVersion:3.10.0-1160.25.1.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://19.3.14,KubeletVersion:v1.19.8,KubeProxyVersion:v1.19.8,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[localhost:30500/barometer-collectd@sha256:2b114e08442070e7232fcffc4cb89529bd5c9effe733ed690277a33772bf2d00 localhost:30500/barometer-collectd:stable],SizeBytes:1464382814,},ContainerImage{Names:[localhost:30500/cmk@sha256:1d865c665dfeeec5a879dca7b9945cc49f55f10921b4e729f0da0cdec7dedbf7 localhost:30500/cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[cmk:v1.5.1],SizeBytes:726676532,},ContainerImage{Names:[centos/python-36-centos7@sha256:ac50754646f0d37616515fb30467d8743fb12954260ec36c9ecb5a94499447e0 centos/python-36-centos7:latest],SizeBytes:650061677,},ContainerImage{Names:[nfvpe/multus@sha256:ac1266b87ba44c09dc2a336f0d5dad968fccd389ce1944a85e87b32cd21f7224 nfvpe/multus:v3.4.2],SizeBytes:276587882,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[nginx@sha256:df13abe416e37eb3db4722840dd479b00ba193ac6606e7902331dcea50f4f1f2 nginx:1.19],SizeBytes:133122553,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:82e0ce4e1d08f3749d05c584fd60986197bfcdf9ce71d4666c71674221d53135 k8s.gcr.io/kube-apiserver:v1.19.8],SizeBytes:118813022,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:8ed30419d9cf8965854f9ed501159e15deb30c42c3d2a60a278ae169320d140e k8s.gcr.io/kube-proxy:v1.19.8],SizeBytes:117674285,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:17e61a0b9e498b6c73ed97670906be3d5a3ae394739c1bd5b619e1a004885cf0 k8s.gcr.io/e2e-test-images/agnhost:2.20],SizeBytes:113869866,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:2769005fb667dbb936009894d01fe35f5ce1bce45eee80a9ce3c139b9be4080e k8s.gcr.io/kube-controller-manager:v1.19.8],SizeBytes:110805342,},ContainerImage{Names:[gcr.io/k8s-staging-nfd/node-feature-discovery@sha256:5d116c2c340be665a2c8adc9aca7f91396bd5cbde4add4fdc8dab95d8db43425 gcr.io/k8s-staging-nfd/node-feature-discovery:v0.7.0],SizeBytes:108309584,},ContainerImage{Names:[quay.io/coreos/flannel@sha256:34860ea294a018d392e61936f19a7862d5e92039d196cac9176da14b2bbd0fe3 quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8 quay.io/coreos/flannel:v0.13.0 quay.io/coreos/flannel:v0.13.0-amd64],SizeBytes:57156911,},ContainerImage{Names:[quay.io/coreos/kube-rbac-proxy@sha256:e10d1d982dd653db74ca87a1d1ad017bc5ef1aeb651bdea089debf16485b080b quay.io/coreos/kube-rbac-proxy:v0.5.0],SizeBytes:46626428,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:bb66135ce9a25ac405e43bbae6a2ac766e0efcac0a6a73ef9d1fbb4cf4732c9b k8s.gcr.io/kube-scheduler:v1.19.8],SizeBytes:46510430,},ContainerImage{Names:[localhost:30500/sriov-device-plugin@sha256:a4dc6d912ce1a8dd4c3a51b1cfb52454080ed36db95bf824895d5ecb7175199f localhost:30500/sriov-device-plugin:v3.3.1],SizeBytes:44392673,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[quay.io/prometheus/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee quay.io/prometheus/node-exporter:v0.18.1],SizeBytes:22933477,},ContainerImage{Names:[localhost:30500/tas-controller@sha256:f013255695f4515c5b21b11281c7e0fb491082d15ec5a96adb8217e015a9c422 localhost:30500/tas-controller:0.1],SizeBytes:22922439,},ContainerImage{Names:[localhost:30500/tas-extender@sha256:50746f542c19fda01d88ae124ce58c5a326dad7cd24d3c2d19fdf959cc7f0c49 localhost:30500/tas-extender:0.1],SizeBytes:21320903,},ContainerImage{Names:[prom/collectd-exporter@sha256:73fbda4d24421bff3b741c27efc36f1b6fbe7c57c378d56d4ff78101cd556654],SizeBytes:17463681,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:11443478,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 busybox:1.28],SizeBytes:1146369,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:682696,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:a319ac2280eb7e3a59e252e54b76327cb4a33cf8389053b0d78277f22bbca2fa k8s.gcr.io/pause:3.3],SizeBytes:682696,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} May 21 21:52:56.076: INFO: Logging kubelet events for node node2 May 21 21:52:56.078: INFO: Logging pods the kubelet thinks is on node node2 May 21 21:52:56.091: INFO: collectd-tz5h5 started at 2021-05-21 20:13:40 +0000 UTC (0+3 container statuses recorded) May 21 21:52:56.091: INFO: Container collectd ready: true, restart count 0 May 21 21:52:56.091: INFO: Container collectd-exporter ready: true, restart count 0 May 21 21:52:56.091: INFO: Container rbac-proxy ready: true, restart count 0 May 21 21:52:56.091: INFO: bin-falseb60b7859-07df-4a9d-8e7f-301dc83357a5 started at 2021-05-21 21:50:57 +0000 UTC (0+1 container statuses recorded) May 21 21:52:56.091: INFO: Container bin-falseb60b7859-07df-4a9d-8e7f-301dc83357a5 ready: false, restart count 0 May 21 21:52:56.091: INFO: adopt-release-xf7hc started at 2021-05-21 21:41:11 +0000 UTC (0+1 container statuses recorded) May 21 21:52:56.091: INFO: Container c ready: false, restart count 0 May 21 21:52:56.091: INFO: kube-proxy-q57hf started at 2021-05-21 19:57:00 +0000 UTC (0+1 container statuses recorded) May 21 21:52:56.091: INFO: Container kube-proxy ready: true, restart count 2 May 21 21:52:56.091: INFO: node-feature-discovery-worker-28kx4 started at 2021-05-21 20:03:47 +0000 UTC (0+1 container statuses recorded) May 21 21:52:56.091: INFO: Container nfd-worker ready: true, restart count 0 May 21 21:52:56.091: INFO: cmk-j2nnh started at 2021-05-21 20:07:00 +0000 UTC (0+2 container statuses recorded) May 21 21:52:56.091: INFO: Container nodereport ready: true, restart count 0 May 21 21:52:56.091: INFO: Container reconcile ready: true, restart count 0 May 21 21:52:56.091: INFO: node-exporter-c46fg started at 2021-05-21 20:07:54 +0000 UTC (0+2 container statuses recorded) May 21 21:52:56.091: INFO: Container kube-rbac-proxy ready: true, restart count 0 May 21 21:52:56.091: INFO: Container node-exporter ready: true, restart count 0 May 21 21:52:56.091: INFO: adopt-release-n9wdj started at 2021-05-21 21:41:11 +0000 UTC (0+1 container statuses recorded) May 21 21:52:56.091: INFO: Container c ready: false, restart count 0 May 21 21:52:56.091: INFO: kube-flannel-5p7gq started at 2021-05-21 19:57:34 +0000 UTC (1+1 container statuses recorded) May 21 21:52:56.091: INFO: Init container install-cni ready: true, restart count 2 May 21 21:52:56.091: INFO: Container kube-flannel ready: true, restart count 2 May 21 21:52:56.091: INFO: sriov-net-dp-kube-sriov-device-plugin-amd64-j7fm6 started at 2021-05-21 20:04:29 +0000 UTC (0+1 container statuses recorded) May 21 21:52:56.091: INFO: Container kube-sriovdp ready: true, restart count 0 May 21 21:52:56.091: INFO: kube-multus-ds-amd64-6q46t started at 2021-05-21 19:57:42 +0000 UTC (0+1 container statuses recorded) May 21 21:52:56.091: INFO: Container kube-multus ready: true, restart count 1 May 21 21:52:56.091: INFO: cmk-init-discover-node2-p7sdn started at 2021-05-21 20:06:37 +0000 UTC (0+3 container statuses recorded) May 21 21:52:56.091: INFO: Container discover ready: false, restart count 0 May 21 21:52:56.091: INFO: Container init ready: false, restart count 0 May 21 21:52:56.091: INFO: Container install ready: false, restart count 0 May 21 21:52:56.091: INFO: tas-telemetry-aware-scheduling-575ccbc9d4-8kddc started at 2021-05-21 20:10:49 +0000 UTC (0+2 container statuses recorded) May 21 21:52:56.091: INFO: Container tas-controller ready: true, restart count 0 May 21 21:52:56.091: INFO: Container tas-extender ready: true, restart count 0 May 21 21:52:56.091: INFO: busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b started at 2021-05-21 21:47:55 +0000 UTC (0+1 container statuses recorded) May 21 21:52:56.091: INFO: Container busybox-privileged-false-c7285625-d0df-4ac1-bb86-0b8bd61df11b ready: false, restart count 0 May 21 21:52:56.091: INFO: e2e-test-httpd-pod started at 2021-05-21 21:43:04 +0000 UTC (0+1 container statuses recorded) May 21 21:52:56.091: INFO: Container e2e-test-httpd-pod ready: false, restart count 0 May 21 21:52:56.091: INFO: terminate-cmd-rpa00907814-0b7b-4354-89ed-e127f8270277 started at 2021-05-21 21:48:02 +0000 UTC (0+1 container statuses recorded) May 21 21:52:56.091: INFO: Container terminate-cmd-rpa ready: false, restart count 0 May 21 21:52:56.091: INFO: var-expansion-b916002b-36f8-432b-ac19-25ef62c55a04 started at 2021-05-21 21:51:08 +0000 UTC (0+1 container statuses recorded) May 21 21:52:56.091: INFO: Container dapi-container ready: false, restart count 0 May 21 21:52:56.091: INFO: nginx-proxy-node2 started at 2021-05-21 20:03:00 +0000 UTC (0+1 container statuses recorded) May 21 21:52:56.091: INFO: Container nginx-proxy ready: true, restart count 2 W0521 21:52:56.107073 25 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. May 21 21:52:56.147: INFO: Latency metrics for node node2 May 21 21:52:56.147: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready STEP: Destroying namespace "security-context-test-5632" for this suite.